The settings of Cache Warmer are located at System ▸ Page Cache Warmer ▸ Settings and grouped into the following sections:
Ignored Pages - allows to set URL patterns for pages that should be ignored by Cache Warmer. Consists of records, where Expression contains regular expression for URL.
/\?/- ignore all pages, that have GET params (filtered category pages, search results pages, etc.)
/\?[\w=]*&[\w=]*&[\w=]*/- ignore pages with more than 2 GET params
Read more about regular expression.
/.*Googlebot.*/to ignore Google crawler. And pages visited by Google crawler will not be added to the queue of cache warmer.
This section will help you to tune-up Page Cache Warmer crawler. The crawler is launched regularly based on cron schedule and begins to traverse the list of available URLs of the store:
To adjust the performance of crawler you can use the following options:
Forcibly make pages cacheable - Allows to override default behavior of Magento with regard to caching pages by changing content block attributes:
cacheable="false"for all blocks in home, category and product pages making them cacheable as a result.
/var/log/clean.log. For more info on this and previous setting, read more in this FAQ section.