Regression Detection and Industry Benchmarks
Overview
AllAccessible doesn't just tell you where you are today — it watches for changes and puts your results in context. Regression detection emails you when your accessibility score drops unexpectedly or a new critical issue appears. Industry benchmarks (shown as Cohort Rank) show how your site compares to anonymized peers in your sector. This guide explains what each one does, where to find it, how to read it, and how to control the alerts.
Note: Benchmarks and regression alerts are informational signals to help you prioritize good-faith remediation. A high percentile or a quiet inbox is a good sign — but neither is the same as certified compliance. Full accessibility still depends on criteria that require manual review and testing with real assistive technology.
Who This Is For
Site owners who want to know the moment their accessibility slips
Anyone asking "is my score actually good?" and wanting peer context
Team members deciding how often — and whether — to receive alert emails
What You'll Learn
What regression detection watches for and how you're notified
What Cohort Rank / industry benchmarks show, and why yours might be hidden
Where to find both in your dashboard and account settings
How to turn regression alerts up, down, or off — and the plan defaults
Regression Detection
What It Watches For
After each nightly refresh of your audit data, AllAccessible compares your site's latest result to the one before it. It raises a regression when either of these is true:
Your score dropped more than 5 points. The score AllAccessible compares is your compliance score — the one that already accounts for fixes applied by the widget and by approved Agentic AI Fixes. So a real drop means your site genuinely became less accessible, not just that a number moved.
A new critical issue appeared that wasn't in your previous result — specifically one the widget can't auto-remediate on its own.
If both happen at once, the alert says so.
Because the score is measured net of fixes, issues that AllAccessible AI auto-remediates for you don't drag it down. When a new critical rule is one the platform handles automatically, the alert email still tells you how many were auto-remediated — so you know you're covered rather than being left to worry.
How You're Notified
Regression detection reaches you as an email alert, not a separate dashboard screen. When a regression fires, you'll get a message with a subject line like:
"⚠️ Accessibility score dropped 7.0 points on yoursite.com"
"⚠️ 2 new critical issues on yoursite.com"
The email links back to your dashboard so you can open Audits & Fixes and see what changed.
Why this matters: Routine site changes — a theme update, a new plugin, a batch of edited content — are the usual culprits behind accessibility drift. Regression alerts answer the question "my site looked fine last week, what changed?" without you having to check the dashboard every day.
📷 Example regression alert email showing the score-drop subject line and a link back to the dashboard
Controlling Regression Alerts
You manage regression alerts from your Notification preferences hub:
Open the user menu at the top right and choose Notifications (or go to Account settings → Open notifications).
Scroll to the Email schedule section.
Under the Alerts group, find the Score regressions row — described as "When your accessibility score drops more than 5 points or a new critical issue appears that the widget cannot auto-remediate."
Use the frequency dropdown to change how often these arrive, or clear the Enabled checkbox to switch them off.
A key rule: you can dial frequency down below your plan's default, but not up — the default reflects what your plan includes.
Plan defaults for regression alerts:
Plan | Default frequency |
Free | Monthly |
Starter | Weekly |
Enterprise | Real-time |
Legacy | Monthly |
📷 Notification preferences "Email schedule" section with the "Score regressions" row and its frequency dropdown
Note on the 5-point threshold: The score-drop trigger (5 points) and the new-critical trigger are set by AllAccessible; the notification hub lets you control how often and whether you're emailed, not the point threshold itself. If the cadence isn't working for you, contact support.
Industry Benchmarks (Cohort Rank)
What It Shows
Industry benchmarks answer "is my score good?" by comparing your site to a cohort of anonymized peers. You'll see this as the Cohort Rank card on your Live Monitoring page (the default page under Audits & Fixes).
The Cohort Rank card shows:
Your percentile — a big number like "82nd," labeled Percentile, with the scope note "vs. AllAccessible widget cohort."
Industry Avg — the average score across your cohort.
Your Score — your site's current score.
Difference — how far above or below the cohort average you sit, with an up or down arrow.
A Tip — an optional short recommendation when one is available.
Higher on the score card, you may also see a compact badge reading, for example, "Top 18% of E-commerce sites (n=42, cohort avg 74)" — a quick summary of the same comparison.
📷 Cohort Rank card showing the percentile, Industry Avg, Your Score, and Difference rows
How Your Cohort Is Defined
Your cohort is a group of sites that share three traits with you:
Industry vertical — one of 14 sectors: E-commerce, SaaS / Tech, Education, Healthcare, Government, Financial Services, Nonprofit, Media / Publishing, Hospitality / Travel, Real Estate, Manufacturing, Legal, Marketing Agency, or Other.
Site size — a page-count band: Small (1–50), Medium (51–500), Large (501–5,000), or Enterprise (5,000+).
Plan tier.
The comparison is rebuilt nightly, so your rank stays current as your score and your peers' scores change.
Why Your Benchmark Might Be Hidden
To keep comparisons fair and defensible, a percentile only appears once your cohort has at least 30 sites in it. Until then you'll see a message like "Cohort sample too small for benchmark (12/30 needed)" instead of a rank. This isn't an error — it just means not enough peers in your exact sector-and-size-and-tier group have data yet. As more sites join your cohort, your rank appears automatically.
Reading it honestly: A percentile compares you to peers — it is a relative position, not a compliance grade. Being in the "top 20%" of your sector means you're doing better than most similar sites, not that your site is fully accessible or certified. Use it to gauge momentum and set goals, then keep clearing real issues.
Common Questions
Q: Where do regression alerts show up — is there a page for them?
A: They arrive by email. There isn't a separate "regression alerts" screen in the dashboard; when one fires, the email links you back to Audits & Fixes so you can see what changed. Your periodic accessibility summary email also notes the score change.
Q: My score dropped but I didn't get an alert. Why?
A: A few reasons are normal: the drop was 5 points or less and no new critical issue appeared; your alert frequency is set to a longer cadence (so it's batched into your next digest); the regression email is switched off in your Notification preferences; or the site is muted in the subdomain mute list. Check the Score regressions row under Email schedule.
Q: A new "critical" issue was flagged but my score barely moved. Is that a bug?
A: No. Your score is measured after fixes are applied, so an issue AllAccessible AI auto-remediates won't hurt your score much even though it still appears in the underlying scan. The alert exists so you have visibility; the auto-remediation count tells you it's already handled.
Q: Why don't I see a Cohort Rank / percentile?
A: Most often your cohort doesn't yet have the 30 sites required to show a defensible percentile — you'll see a "sample too small" note instead. It can also appear once your site has enough audit history and an assigned sector.
Q: How is my industry decided, and can I change it?
A: Your sector is set on the AllAccessible side; sites without one are compared in a general "Other" group, and site size is derived automatically. If you'd like to be benchmarked against a specific sector, contact support.
Q: Does a high percentile mean my site is compliant?
A: No. The percentile shows how you compare to similar sites, not whether you meet WCAG 2.2 or any legal standard. Treat it as context for prioritization, not a certificate.
Troubleshooting
Issue: I'm Getting Too Many (or Too Few) Regression Emails
Cause: The alert frequency is tied to your plan default, and you may want a different cadence.
Solutions:
Go to Notifications → Email schedule → Score regressions.
Pick a less frequent cadence, or uncheck Enabled to stop them.
Remember you can only dial frequency down from your plan default, not above it.
Issue: My Cohort Rank Card Says "Sample Too Small"
Cause: Fewer than 30 sites are currently in your exact cohort (sector × size × tier).
Solution: No action needed — the percentile appears automatically once the cohort reaches 30. If you believe your sector is set incorrectly, contact support to review it.
Issue: The Benchmark Compares Me to the Wrong Kind of Site
Cause: Your site may not have a specific industry assigned and is being compared in the general "Other" cohort.
Solution: Contact support to set your industry vertical so you're grouped with the right peers.
Next Steps
Set your regression alert cadence under Notifications → Email schedule so drops reach you at a pace that fits your team.
Open Audits & Fixes → Live Monitoring and check your Cohort Rank to see where you stand against peers.
When a regression fires, clear the new issues — approve the repetitive ones in Agentic AI Fixes and work the rest on the Tasks board.
Related Articles
Understanding Audit Results and Tasks - Read your scores and severity, and decide what to fix first
Running an Accessibility Scan - Refresh your data and locate results
Approving Agentic AI Fixes - Clear common issues so regressions get auto-remediated
Generating a VPAT / Compliance Report - Document your accessibility posture
Last Updated: July 2026
Where: Audits & Fixes → Live Monitoring (Cohort Rank); Account → Notifications → Email schedule (Score regressions)
Plan note: Regression alert frequency defaults by plan (Free monthly, Starter weekly, Enterprise real-time); you can dial it down or off, not up.
