Quantcast
Channel: WordPress.org Forums » [XML Sitemap & Google News] Support
Viewing all articles
Browse latest Browse all 54

Sitemap generated without default WordPress elements

$
0
0

Replies: 1

Even if the following is added in the Reading settings,

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

it is left out of the resulting robots.txt file.

If nothing is added, and only Google News Sitemap generation is on, reference to the sitemap is created but the robots.txt is still missing the above so it is broken. If other elements are added after the above in the Reading settings such as

User-agent: GPTBot
Disallow: /

that code is at the top of robots.txt and the default is still missing.

I have repeated this on more than 5 sites. Yoast’s block gets properly added to the virtual robots.txt file on all of the sites.


Viewing all articles
Browse latest Browse all 54

Trending Articles