Verify discovery files
Check whether the expected crawler guidance files are reachable from the storefront origin.
Storefront Health Check
Robots.txt and Sitemap Crawlability Check - Poodle Scanner
Use this page when search discovery or crawler guidance needs a quick sanity check before deeper SEO investigation.
robots.txt
sitemap.xml
Crawl guidance
Quick verdict
Use a current Storefront Health Check workflow for this review
This guide is for teams that need a repeatable decision from a visible set of checks. Storefront Health Check is currently enabled for scoring in the checked-in platform configuration. Use the reported rule results to prioritize the next review action instead of treating one score as the whole answer.
- Use when
- Use this page when search discovery or crawler guidance needs a quick sanity check before deeper SEO investigation.
- Current scope
- Storefront URL health checks
User intent
Check whether an ecommerce site exposes robots.txt and sitemap.xml crawler guidance.
Catch launch mistakes
Find missing or broken guidance after site launches, migrations, or domain changes.
Support SEO triage
Use the result to decide whether crawlability belongs in the immediate fix list.
Workflow
How Poodle Scanner fits the job
Enter the storefront URL
Start from the page or origin you want search engines to understand.
Run crawlability checks
Poodle Scanner fetches public guidance files and records the response.
Repair missing signals
Update site configuration, CMS output, or deployment files as needed.
Signals
What the scan helps surface
Check
robots.txt reachability
Reported as an observable result your team can review, export, or use as a cleanup cue.
Check
Sitemap declaration in robots.txt
Reported as an observable result your team can review, export, or use as a cleanup cue.
Check
sitemap.xml reachability
Reported as an observable result your team can review, export, or use as a cleanup cue.
Check
HTTP status and redirect behavior
Reported as an observable result your team can review, export, or use as a cleanup cue.
Implementation evidence
What this current product surface exposes
This guide describes the enabled Storefront Health Check workflow in the checked-in product configuration. The excerpt is evidence of the current product surface, not a customer setup instruction.
SITE-CHECKER:
enabled: true
waitlist: false
capabilities:
scoring: true
suggestions: falseFAQ
Questions about this workflow
What input does this storefront workflow accept?
Storefront Health Check catalogs accept text or RTF files with one site URL per non-empty line. Valid targets use HTTP or HTTPS; a missing scheme is normalized to HTTPS.
How should I use the Robots.txt and Sitemap Crawlability Check results?
Review the named configured result, decide whether the storefront needs follow-up, and use the current health-check workflow to keep the next review traceable.
Run the workflow
Turn the guide into a scan
Start with a product list or storefront URL, apply the right rule profile, and export the findings your team can act on.