Yes. The public check requires no account. A connected workspace is needed only for saved evidence, monitoring, and deeper workflows.

fact_checkFree tool · no account required

Free Robots.txt & Sitemap Checker

Q: Does Novaverb estimate missing numbers?

No. Missing evidence produces an unavailable or incomplete state instead of an invented metric.

Q: What can I do after this free check?

Connect the target to a Novaverb workspace to save evidence, monitor changes, and run site-wide analysis.

Check robots.txt and the default sitemap.xml for free. Inspect HTTP status, sitemap directives, file size, and the URL count in the fetched sitemap.

verifiedEvidence shown with sourcelock_openNo account requiredblockNo invented metrics

fact_check

Run a real check above

Submit a public URL, domain, or keyword. Novaverb will show only the evidence this tool can actually retrieve or measure.

Evidence model

Know what the result proves

Each free check separates measured evidence from interpretation, and interpretation from the deeper work available in a connected workspace.

database

1. Source

Live robots.txt and /sitemap.xml fetch. The result identifies where its evidence came from.

rule

2. Boundary

The checker fetches /robots.txt and /sitemap.xml and reads Sitemap directives. It does not recursively audit every child sitemap or prove Google indexing.

conversion_path

3. Next action

Use the finding to verify a problem, then connect a workspace when you need history, monitoring, or site-wide analysis.

Crawl Budget Management via Robots.txt & Sitemaps

Robots.txt and XML sitemaps work together to guide search engine crawlers. Robots.txt is a gatekeeper that tells bots which directories they are forbidden from crawling (like admin consoles or cart pages). Sitemaps act as a roadmap, declaring all indexable, high-quality URLs you want search engines to discover and index.

Best Practices for Robots.txt and Sitemaps

Declare Sitemap in Robots.txt: Add a 'Sitemap: https://yourdomain.com/sitemap.xml' directive at the end of your robots.txt so all crawlers can find it automatically.
Do Not Block CSS/JS: Never block search engines from crawling CSS or JavaScript files, as Googlebot needs to render the full page to evaluate mobile usability and layout.
Keep Sitemap Clean: Only include indexable URLs (HTTP 200 OK) in your XML sitemaps. Remove redirects (301), broken pages (404), or pages with 'noindex' tags.

Crawl Guideline

An incorrectly configured robots.txt file can accidentally block search engines from crawling your entire site, wiping out your organic traffic overnight. Always validate changes before uploading.

Common questions

Robots.txt & Sitemap Checker FAQ

Is this tool free?

Yes. You can run the public check without creating an account. A connected workspace is required only for saved evidence, monitoring, and deeper product workflows.

Where does the result come from?

Live robots.txt and /sitemap.xml fetch. The checker fetches /robots.txt and /sitemap.xml and reads Sitemap directives. It does not recursively audit every child sitemap or prove Google indexing.

Does Novaverb estimate missing numbers?

No. If the required evidence is unavailable, the tool returns an unavailable or incomplete state instead of inventing a metric.

What can I do after this free check?

Connect the target to a Novaverb workspace to keep evidence, run site-wide analysis, monitor changes, and move findings into an accountable workflow.

More free checks