Post by MimJannat99 on Nov 9, 2023 6:48:40 GMT
Cache and select Main Settings . Then let's open the Indexer tab . lscache crawler settings Here are the most important settings for the crawler: Delay While browsing our website, the indexing robot sends requests in the background - one subpage after another. This can cause a lot of load on the server if the interval between these requests is too short. Setting the delay will let the LSCache robot know how often it can send requests.
The default value in this case is , microseconds . . seconds. We can increase it at our discretion to reduce the load, but this will automatically increase the indexing time. Run duration To prevent the server from hanging while your photo editor site is being scanned, we may limit the crawl duration . For example, if we set the startup time to seconds, then the robot will crawl the site for minute before taking a break.
At the end of the pause, which is defined by the next setting . Interpass Interval, the robot will restart exactly where it left off scanning before the pause. These intervals will continue until the entire site has been scanned. Interval between runs The interval defined in this field determines the length of the break mentioned above . If we set the value to seconds, then the robot's indexing of the site will stop for minutes after each -minute interval.
The default value in this case is , microseconds . . seconds. We can increase it at our discretion to reduce the load, but this will automatically increase the indexing time. Run duration To prevent the server from hanging while your photo editor site is being scanned, we may limit the crawl duration . For example, if we set the startup time to seconds, then the robot will crawl the site for minute before taking a break.
At the end of the pause, which is defined by the next setting . Interpass Interval, the robot will restart exactly where it left off scanning before the pause. These intervals will continue until the entire site has been scanned. Interval between runs The interval defined in this field determines the length of the break mentioned above . If we set the value to seconds, then the robot's indexing of the site will stop for minutes after each -minute interval.