Where did half your sitemap go?
A sitemap rarely breaks with an error page. It shrinks: a plugin update drops a post type, a pagination bug stops at page one, an index loses a child file. A sitemap monitor counts the URLs and tells you when the number moves more than it should.
- Unreachable or invalid
- Empty sitemap
- Big drop in URLs
- Big jump in URLs
What sends an alert
DOWN, confirmed from a second region like any outage, when the sitemap cannot be fetched, answers with anything other than a 2xx, is not valid sitemap XML, or lists no URLs at all. When it is fixed, you get a RECOVERED.
CHANGED, when the number of URLs moves by at least the threshold you set, in either direction. The default is 20%, and you can pick anything from 1 to 100. The alert says what happened in numbers, for example "sitemap URL count fell 31% (1000 to 690)". A sudden jump is reported too, because a sitemap that doubles overnight is often a crawl trap or a duplicate-URL bug.
Why doesn't steady growth set it off?
The count is compared with the last one that was accepted, and any change under the threshold becomes the new baseline. A site that publishes a few posts a week grows past 20% eventually, but never in one step, so it never alerts. A change past the threshold has to show up on two checks in a row before it counts, so a single bad response does not page anyone either.
Sitemap indexes and compressed files
Point the monitor at sitemap.xml or at a sitemap index; gzip-compressed files are read either way. For an index, the probe follows up to 50 child sitemaps on the same host, one level deep, and adds up their URLs. Each file is read up to 50 MB decompressed, which is the sitemap protocol's own limit. If a site is bigger than those caps the count is reported as "at least" that number, so a cap never looks like a drop.
Setting one up
In the dashboard, add a monitor, choose Sitemap, and give it the sitemap URL. If you paste the site's address instead, the form fills in /sitemap.xml for you. Sitemaps are checked once an hour, because a large index means many requests to your site per check. The monitor page keeps the last 100 changes with the counts before and after.
Which plans include it
Sitemap monitors are part of the Pro and Team plans and count as a monitor in the plan's allowance. You can upgrade from your account page; both plans start with a 14-day trial, one per account.
The other half of crawl health isrobots.txt monitoring, which alerts when the rules start blocking pages. Checking a sitemap by hand is covered inhow to monitor sitemap changes.
Start at app.yoping.me, then add the sitemap monitor once you are on Pro or Team.