Search results

  1. rsmith4321

    Cloudflare issue with LSCache crawler

    Based on what info? Cloudflare is a first caching layer, but it dumps the page cache pretty quickly and then hits the server. All the cache misses hit the Litespeed cache and it responds quickly without having to hit database and php. I've been using cloudflare for years with Nginx cache, I...
  2. rsmith4321

    Cloudflare issue with LSCache crawler

    Thanks for the help. I actually believe I figured out what was happening. I was using the automatic page optimization feature which is an additinal layer of page caching. So when the crawler would hit pages that were cached previously by Cloudflare, the headers would be incorrect and cause...
  3. rsmith4321

    Cloudflare issue with LSCache crawler

    I'm using Cloudflare with the APO features. I've noticed if I'm in developer mode bypassing the Cloudflare cache, the LSCache crawler works fine. However if Cloudflare cache is enabled, there are lots of pages sent to the blacklist. I've checked the firewall rules in Cloudflare to see if...
Top