html - <元名称 ="robots"> 不工作

Question

我有一个页面:

https://www.luckycheckout.com/goto/282/cs/1?ct=1

在 head 部分包含以下代码行:

<meta name="robots" content="noindex, nofollow" />

我的“robots.txt”文件中还有“Disallow:/goto”。

尽管如此，Google Search Console 仍提示该页面:

已编入索引，但已被 robots.txt 阻止

据我所知，一切都是有效且正确的，不应该被索引，任何人都可以解释谷歌在提示什么吗？

谢谢

Answer 1

您需要在robots.txt上删除此网站的Disallow文件:

When Googlebot next crawls that page and see the tag or header, Googlebot will drop that page entirely from Google Search results, regardless of whether other sites link to it.

Important: For the noindex directive to be effective, the page must not be blocked by a robots.txt file. If the page is blocked by a robots.txt file, the crawler will never see the noindex directive, and the page can still appear in search results, for example if other pages link to it.
source: https://support.google.com/webmasters/answer/93710

---

您还可以使用 Google Search Console 从 Google 索引中删除您拥有的网站。您可以在 Google Webmaster documentation 上找到更多信息.