Hi, I’m updating the robots.txt file, but the changes aren’t showing up on the live page. I still see the old file. Any idea why this might be happening?
Hi @PCHamp,
This is potentially just a caching delay. If you’ve already cleared the cache on your browser and it’s still happening, it could be a server-side cache which would fix itself (but should have by now).
If that still doesn’t do the trick, just double-check that you’ve uploaded the correct robots.txt file. When file names are the same, it’s easy to grab the wrong version of the file.
For reference, just in case: Configure your website's robots.txt and image meta tags for social post link previews
Josh
Hi Josh, thanks for getting back to me. I initially suspected it might be the Cloudflare cache, so I waited for a while. I updated the robots.txt file through Settings > Content > Pages > SEO & Crawlers. Is there anything else I need to do to ensure the changes take effect?