Suddenly I am having this problem, I only noticed it because I saw that the google search console does not scan my site since October 23rd.
I'm on 3.34.1 (this is my url) and having issues overriding the default robots.txt by adding my own file to the theme.
This is a custom result inserted after the second result.
Hello, A client of mine is going through a bit of a crisis. A developer (at their end) added Disallow: / to the robots.txt file.
Try to install PrestaShop in a folder instead of in the root (I did not test in the root). Go to configure -> shop -> seo & url -> generate ...
My problem is i have to change my robots.txt as i get notification from google search saying robots.txt blocked their crawler and sitemap ...
So I have no idea where this robots.txt file is generated from, where its located, how this is happening. Its a ghost file! I even overwrote ...
I'm trying to setup robots.txt, but I'm not ... My bad, I want these pages not to be crawled by robots. My question is if the sitemap is setup ...
I have a weird problem with the robots.txt file. My robots.txt code in the server is: Code: Select all # If the Joomla site is installed within ...
Configuring Your Ghost Installation With The Console ... txt file into the root of your Ghost folder. In ... Here is the final result (robots.txt is the last file ...
Over the last few weeks, my search results have dropped off since changing hosts. On the robots.txt tester. ... Disallow: /ghost/. Disallow: /p/.