Audits HTML & HTTP header canonicals (RFC 8288), verifies self-referencing URLs, unpacks XML sitemaps, uncovers JS hydration mismatches, and actively probes canonical targets for 404s, redirect loops, and noindex contradictions.
Audits HTML & HTTP header canonicals (RFC 8288), verifies self-referencing URLs, unpacks XML sitemaps, uncovers JS hydration mismatches, and actively probes canonical targets for 404s, redirect loops, and noindex contradictions.
Simultaneously inspects HTML document <head> declarations and RFC 8288 HTTP Link response headers to prevent conflicting signals and search indexation drops.
Compares static server HTML against client-rendered DOM states to detect hydration mismatches and flags invalid elements prematurely closing <head>.
Ingests direct XML sitemaps (.xml, .xml.gz, /sitemap), uncompresses gzip archives, expands recursive sitemap indexes, and audits child URLs up to user limits.
Actively verifies canonical targets for HTTP 404/5xx dead ends, traces 301/302 redirect chains up to 5 hops, detects circular loops, and catches noindex traps.
Applies severity-weighted deductions across 14 failure modes with critical safety caps (max -60) and strict score ceilings (max 70 for errors, max 89 for warnings).
Executes ultra-fast HTTP audits (~300ms) with automatic stealth Playwright browser escalation for Cloudflare challenges, SPAs, and anti-bot protected sites.
Templates & workflows
Audit primary landing pages and marketing URLs to verify self-referencing canonical tags, OpenGraph alignment, and target reachability.
{
"urls": "https://www.browsermesh.in/, https://startten.com/, https://befhue.com/",
"limit": -1,
"timeout": 30,
"scrapeMode": "auto",
"concurrency": 8,
"checkSocialTags": true,
"maxSitemapPages": 50,
"probeCanonicalTarget": true
}Automatically unpack XML sitemaps and recursively audit catalog, product, and blog pages for canonical conflicts, 404 targets, and uncanonicalized URLs.
{
"urls": "https://www.saravanabhavan.com/sitemap.xml, https://mistral.ai/sitemap.xml",
"limit": -1,
"timeout": 30,
"scrapeMode": "auto",
"concurrency": 8,
"checkSocialTags": true,
"maxSitemapPages": 50,
"probeCanonicalTarget": true
}Lightning-fast pure HTTP canonical audit across hundreds of URLs to detect missing canonicals, protocol downgrades, and redirect hops.
{
"urls": "https://example.com/page-1, https://example.com/page-2, https://example.com/page-3",
"limit": -1,
"timeout": 20,
"scrapeMode": "http",
"concurrency": 15,
"checkSocialTags": false,
"maxSitemapPages": 20,
"probeCanonicalTarget": true
}Canonical Conflict & SEO URL Detector
An enterprise-grade, high-performance Canonical Conflict, Dual-Layer Link Header & HTML Tag Validator, and Technical SEO URL Auditor for BrowserMesh.
Audits web pages for canonical tag configuration, cross-references HTML <head> declarations against RFC 8288 HTTP Link: rel="canonical" headers, uncovers client-side JavaScript hydration mismatches, auto-expands XML sitemaps, and actively probes canonical destinations for HTTP 404s, redirect loops, and noindex traps.
The definitive modern alternative to Screaming Frog SEO Spider (£209/yr), Sitebulb, Ahrefs Site Audit, and brittle custom Python scrapers.
?sort=price_asc), tracking parameters (?fbclid=..., ?utm_source=...), and pagination series (?page=2).Link headers that contradict CMS-generated HTML canonical tags.Inspects canonical configurations across both network layers:
<link rel="canonical" href="...">): Parses <head> declarations, resolves relative paths, checks for multiple tags, and detects placement in <body>.Link: <...>; rel="canonical"): Parses edge CDN and API gateway link headers, extracting destinations even for non-HTML assets (PDFs, downloadable whitepapers).<head> Closure Detection: Flags when non-metadata elements (<img>, <iframe>, misplaced <div>) before <link rel="canonical"> force the browser or Googlebot parser to close <head> early and relegate canonical tags into <body>..xml, .xml.gz, /sitemap).<sitemapindex> hierarchies, and audits child URLs up to the user-specified page limit.404 Not Found, 410 Gone, or 500 Server Error.Page A <-> Page B).noindex Traps: Detects if the canonical destination contains a <meta name="robots" content="noindex"> tag or X-Robots-Tag: noindex header.meta[property="og:url"] and Twitter Card meta[name="twitter:url"].Every yielded record strictly adheres to these 22 structured fields:
schema.ts)Built on BrowserMesh's modular split-file TypeScript ESM architecture:
index.ts: Plugin entry point, metadata declaration, and lifecycle hooks.scraper.ts: AsyncGenerator streaming runner, sitemap expansion, multi-engine executor, and active target prober.parser.ts: RFC 8288 link header parser, Cheerio HTML DOM extractor, premature head closure linter, and 0–100 scoring engine.config.ts: Scoring weights, deduction caps, Chrome User-Agent, and 22 output contract fields.schema.ts: Input parameters definition conforming to PluginSchema.Zero Runtime Dependencies: Uses native Node.js APIs (fetch, zlib, URL, crypto) and host Cheerio with needOwnDependencies: false.
This workflow executes natively within your local or peer BrowserMesh node using real Chromium browser automation. It navigates dynamically rendered single-page applications, executes interaction logic, avoids cloud proxy fees, and extracts clean structured datasets directly to your local machine with complete security and privacy.
Unlike legacy cloud scraping APIs that impose expensive per-request markups and risk IP bans, BrowserMesh routes execution through authentic residential environments. You pay zero cloud data transfer fees, experience full anti-bot stealth emulation, and retain 100% ownership of your extracted datasets without vendor lock-in.
2 records · 22 nested fields · real execution preview
Combine complementary browser automation and auditing workflows to verify site health, infrastructure, and search engine crawlability with 100% local execution.
Scan websites and XML sitemaps to detect 404 dead links, broken anchors, and redirect loops with zero cloud markups.
Discover who hosts any website. Detect cloud infrastructure, CDN edge networks, IP geo, and DNS routing instantly.
Audit on-page SEO factors, meta tags, heading structures, Core Web Vitals, and SERP snippet previews with local privacy.
Explore our comprehensive guides or reach out directly to our engineering support team.