Discovery
sitemap.xml, sitemap_index.xml, sitemap-*.xml, .xml.gz, and the files named in Sitemap: lines in robots.txt. Sitemap indexes are followed to their children, and missing children are reported.
GitHub Packages · MIT · Node ≥ 18
sitemap-beacon
Audit XML sitemaps against your built static site: every URL should be a real, indexable, canonical page, and every such page should be listed.
1 Point the
@mrlouiswrightscope at GitHub Packages in.npmrc@mrlouiswright:registry=https://npm.pkg.github.com2 Install
npm i -D @mrlouiswright/sitemap-beacon
Installing from GitHub Packages needs a token
Published to GitHub Packages, not npmjs.com. GitHub Packages needs a GitHub token with read:packages to install, even for public packages: add //npm.pkg.github.com/:_authToken=${GITHUB_TOKEN} to .npmrc or run npm login --registry=https://npm.pkg.github.com.
$ npx sitemap-beacon dist --base-url https://example.com --fail-on mediumsitemap-beacon — https://example.com8 page(s); 2 sitemap file(s) with 10 URL(s) on https://example.com HIGH sitemap_index.xml:4 sitemap_index.xml lists sitemap-posts.xml, which is not in the build [sitemap-child-missing] ↳ fix: Generate the child sitemap or remove it from the index.HIGH sitemap-pages.xml:6 <loc>/blog/copy.html</loc> is not an absolute http(s) URL [sitemap-loc-invalid] ↳ fix: Use the full URL, e.g. https://example.com/blog/copy.html.HIGH sitemap-pages.xml:9 https://example.com/private/secret.html is noindex (X-Robots-Tag in _headers) [sitemap-url-noindex] ↳ fix: Remove noindex pages from the sitemap, or remove the noindex.HIGH sitemap-pages.xml:10 https://example.com/tag.html is noindex (<meta name="robots">) [sitemap-url-noindex] ↳ fix: Remove noindex pages from the sitemap, or remove the noindex.HIGH sitemap-pages.xml:11 https://example.com/old.html is a meta-refresh redirect page (old.html) [sitemap-url-non-200] ↳ fix: List the destination URL instead.... 8 high, 5 medium, 5 low, 1 info✔ Passing (fail-on: none).
Why it exists
Sitemaps drift away from the site they describe. A page gets noindex but stays in the sitemap. A post is canonicalised to its new URL, but the old one is still listed. The build stamps every lastmod with the deploy time, so Google stops trusting the dates. A section is added and never makes it into the sitemap. sitemap-beacon reads your sitemaps (indexes, children and .xml.gz) alongside the built HTML and checks each one against the other. It reports the file, line, severity and a concrete fix, before you deploy.
CLI, library and GitHub Action. Node.js 18+, zero runtime dependencies. Works on any static build output (Astro, Next.js “output: 'export'”, Eleventy, Hugo, Jekyll, Docusaurus, VitePress, plain HTML) and runs offline: point it at the folder your build writes. By Louis Wright.
Features
Protocol
valid <urlset>/<sitemapindex> root and namespace, 50,000-URL and 50 MB limits, absolute and properly escaped <loc>, duplicates, and valid changefreq/priority (which Google ignores; reported as info).
Each URL vs the build
no page at that URL (or only a meta-refresh stub or an error page), noindex from meta robots or from X-Robots-Tag in _headers/vercel.json, canonicalised to a different URL, or another host or protocol.
lastmod
invalid W3C datetime, in the future, older than the page's own dateModified/article:modified_time, the same on every URL (a build timestamp), and an optional maximum age.
Coverage
indexable, self-canonical pages that are not in any sitemap. Use notInSitemap globs for pages you leave out on purpose.
Output
text, JSON, SARIF 2.1.0 and Markdown; --fail-on; exit codes 0/1/2; allowlist entries with expiry dates.
Usage
# Example
npx sitemap-beacon dist# Example
npx sitemap-beacon dist --base-url https://example.com --fail-on medium# Example
npx sitemap-beacon public --sitemap sitemap-index.xml --max-age-days 730# Example
npx sitemap-beacon out --clean-urls --not-in-sitemap "/tags/**,/page/*"CI / GitHub Action
permissions:
contents: read
security-events: write # only needed for the SARIF upload
jobs:
sitemap-beacon:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@11d5960a326750d5838078e36cf38b85af677262 # v4
with: { persist-credentials: false }
- run: npm ci && npm run build # produce the static site first
- uses: MrLouisWright/sitemap-beacon@v1
with:
path: dist
fail-on: high
sarif: sitemap-beacon.sarif
- uses: github/codeql-action/upload-sarif@v3
if: always()
with: { sarif_file: sitemap-beacon.sarif }Options & flags
| Flag | Description |
|---|---|
| Site | |
--base-url <url> | Public URL of the site, e.g. https://example.com (default: inferred from canonical/og:url) |
--include <globs> | Only check these pages (file or URL path globs, comma-separated) |
--exclude <globs> | Skip these pages |
--clean-urls | Pages are served without .html (about.html -> /about) |
| Checks | |
--sitemap <files> | Sitemap file(s) relative to the site dir (default: auto-detect) |
--max-age-days <n> | Report lastmod older than n days (info) |
--no-coverage | Do not report pages missing from the sitemap |
| Common | |
-c, --config <file> | JSON config (default: .sitemap-beacon.json or "sitemapBeacon" in package.json) |
-f, --format <fmt> | text (default) | json | sarif | markdown |
--json <file> | Also write a JSON report |
--sarif <file> | Also write SARIF 2.1.0 |
--markdown <file> | Also write Markdown (e.g. for a job summary) |
--fail-on <sev> | critical | high | medium | low | info | none (default: high) |
--list-rules | Print rules and default severities |
--no-fixes | Hide fix suggestions in text output |
--no-color | Disable colours |
Full reference, config file format and API in the README.
Support this project
Support open-source security tools
I build free, open-source tools that help developers ship safer websites. Every coffee helps keep them maintained, documented and free for everyone.
Buy me a coffee (opens Stripe in a new tab)Secure checkout by Stripe
More tools by Louis Wright
58 tools
Flagship Next.js 16 App Router libraries · pre-alpha · 2
- next-tonguePre-alphaCompiler-first, type-safe i18n for the Next.js 16 App Router.ICU messages compiled at build time, works with TurbopackLocale from route params, so pages stay in the static shellZero dependencies beyond next and react
- next-heraldPre-alphaTyped metadata, safe JSON-LD, sitemaps and an SEO CI check for the Next.js 16 App Router.Returns native Metadata, Sitemap and Robots objectsXSS-safe JSON-LD with an entity graph by defaultherald check: a dependency-free CI crawler for SEO mistakes
Sentinels security scanners & CI gates · 20
- binary-sentinelStatic PE and ELF triage in pure JavaScript: headers, sections, entropy, imports, imphash, packer hints, capabilities and hardening checks.
- cookie-sentinelAudit the cookies your site sets before attackers do.
- defang-sentinelDefang and refang indicators of compromise, and stop live malicious links from getting into threat reports, tickets and docs.
- dns-sentinelAudit your domains' DNS and email security before attackers or spammers find the gaps.
- dockerfile-sentinelSecurity linter for Dockerfiles and Docker Compose files: root containers, baked-in secrets, curl | sh, unpinned and end-of-life base images, privileged services, Docker socket mounts and exposed databases.
- dotenv-sentinelValidate .env files against .env.example or a schema, catch weak and default secrets, and keep .env files out of git, including its history.
- hash-sentinelCheck file hashes against your own threat feeds, MISP and optional public lookups, offline-first.
- header-sentinelFail CI when deployed URLs ship weak HTTP security headers.
- ioc-sentinelExtract indicators of compromise from threat reports, logs, emails and binaries, then export them as CSV, STIX 2.1, JSON or SARIF.
- license-sentinelA license compliance gate for npm projects, plus CycloneDX/SPDX SBOMs and a NOTICES file.
- malware-report-sentinelTurn a suspicious file into a structured malware triage report (Markdown, HTML or JSON) using static analysis only.
- phish-sentinelOffline phishing URL heuristics with an explainable score: lookalike and homograph domains, brand impersonation, IP hosts, user@host tricks, risky TLDs, shorteners, free hosting and redirect chains.
- redirect-sentinelFind open redirects and mixed content in a built site (offline) or a live crawl: http:// scripts and styles on HTTPS pages, insecure forms, client-side redirects fed by the URL, open redirect rules in _redirects/vercel.json/nginx, HTTPS downgrades, and optional safe redirect probing.
- sbom-diff-sentinelSee exactly what a pull request changes in your software bill of materials, and block the risky changes.
- securitytxt-sentinelValidate security.txt (RFC 9116) and robots.txt for your domains, or as local files in CI before you deploy them.
- sri-sentinelSubresource Integrity for your built site: generate, write and check it in CI.
- static-link-sentinelFail CI on broken links before you deploy.
- supply-chain-sentinelOne supply-chain gate for npm projects: risky dependency changes, license policy, new vulnerabilities and SBOM drift, and GitHub Actions hardening, with one config, one report and one exit code.
- tls-sentinelCheck TLS endpoints for expiring or untrusted certificates, hostname mismatches, missing intermediates, weak keys and signatures, TLS 1.0/1.1, weak ciphers and missing TLS 1.3.
- workflow-sentinelCatch insecure GitHub Actions workflows before they're merged.
Gauges package & repo quality · 8
- commit-gaugeA lightweight Conventional Commits linter for git hooks and CI, with clear fix-up suggestions.
- dead-deps-gaugeFind dependencies you declare but never use, and imports that are missing from package.json.
- engines-gaugeMake engines.node, your CI matrix, .nvmrc and your dependencies' engine requirements agree.
- monorepo-gaugeHygiene checks for npm, yarn and pnpm workspaces: circular internal deps, mismatched shared deps, version drift and missing fields.
- pkg-field-gaugeValidate package.json before you publish: exports/main/types consistency, files, repository, keywords and sideEffects.
- publish-gaugeCheck what npm publish will actually ship, before you publish it.
- readme-gaugeLint READMEs for missing sections, broken badges, stale install commands and missing usage examples.
- semver-gaugeA CI gate that checks your version bump matches what changed, and that the CHANGELOG has a real entry for it.
Beacons SEO & discoverability · 8
- answer-beaconCheck that your built static site is ready for answer engines and AI search: direct answers, FAQ schema, llms.txt, AI crawler access and E-E-A-T signals.
- canonical-beaconCheck canonical tags and hreflang clusters in your built static site: one canonical per page, pointing at a real, indexable, final URL, and hreflang clusters that are valid, self-referencing and reciprocal.
- duplicate-beaconDetect duplicate and near-duplicate titles, meta descriptions and page bodies across your built static site.
- heading-beaconAudit the heading structure of your built static site: one visible H1 per page, a logical H1 → H2 → H3 outline, and headings that actually say something.
- index-beaconCheck which pages of your built static site search engines are told not to index or follow, via meta robots and X-Robots-Tag, against the rules you actually intend.
- meta-beaconAudit titles, meta descriptions, Open Graph and Twitter/X cards across a built static site.
- orphan-beaconFind the pages in your built static site that nothing links to, and measure how many clicks every page is from the homepage.
- schema-beaconValidate JSON-LD and microdata against schema.org and Google rich-result requirements, across your whole built site.
Wardens privacy, compliance & accessibility · 8
- a11y-wardenWCAG 2.2 accessibility audit of static HTML for CI, with a baseline so you can adopt it on an existing site and only fail on new problems.
- consent-wardenCheck that your cookie banner actually behaves: nothing non-essential loads before opt-in, Reject is as easy as Accept, and consent can be withdrawn.
- dsar-wardenAssemble Data Subject Access Request exports from many systems into one structured, checksummed bundle, and catch the mistakes before you send it.
- gpc-wardenCheck that your built site honours Global Privacy Control: it reads the signal and suppresses sale/share trackers when it is on.
- pii-log-wardenFind and redact personal data in log files: emails, phone numbers, IP addresses, card numbers and national IDs.
- policy-drift-wardenCompare the trackers and third parties your built site actually loads with what its privacy policy says, and fail CI when they drift apart.
- retention-wardenLint your data-retention policy as code: every data category gets a period, a legal basis and an action at expiry.
- tracker-wardenInventory every third-party tracker, pixel and SDK your built static site loads, with vendor, company and category, and gate CI on an approved-vendor list.
Pulses web performance · 8
- bundle-pulseA CI gate for JavaScript and CSS bundle size: budgets on raw, gzip and brotli sizes, and a diff against your base branch.
- cache-pulseCheck that your static hosting config caches the right things: fingerprinted assets for a year, HTML revalidated, and nothing stale after a deploy.
- font-pulseAudit how your built site loads web fonts: font-display, preloads, WOFF2, subsetting, unused weights and total font payload.
- image-pulseFind oversized, unoptimised and wrongly formatted images in your built site, before they slow down your Largest Contentful Paint.
- lazy-pulseLazy-load what is below the fold, never the LCP image: a static lazy-loading audit for your built site.
- render-pulseFind the CSS and JavaScript that block first paint in your built site, with the defer, async, media or critical-CSS fix for each.
- thirdparty-pulseHow much does each third-party script cost your pages? Estimated bytes, requests and main-thread time per page and per vendor, checked against budgets.
- vitals-pulseFail CI when Core Web Vitals get worse: LCP, CLS and an INP proxy, gated on thresholds and on regressions against your baseline.