Use case · Alert fatigue
A fixed threshold checked every minute will eventually fire on nothing — so teams mute the channel and miss the real one. That's not carelessness; it's arithmetic. ValidAnytime replaces the fixed line with an anytime-valid detector, so looking more often makes you safer, not noisier — one alarm per real change, with a false-alarm budget across the whole fleet.
Free to start · no credit card
Count the alerts your team muted this month. Each one was rational: it had cried wolf so many times that ignoring it was the correct move. That's the trap — every mute is a small, sensible decision, and together they train the whole team to sleep through the one page that mattered. The runbook that says “wait for the second alert” is that training, written down.
Tighten the threshold and you catch more real events — and far more false ones. Loosen it and the noise stops, and so do the early warnings. No setting fixes both, because a fixed-sample test is being checked continuously: check a fixed 5%-error test 5 times and the real false-positive rate is already ~23%; at 20 looks it passes 64%. Add monitors and it compounds, with no global bound on false pages.
Latency, error rate, a model score, a KPI — send the number through one HTTP call or the SDK. Any numeric metric via the API.
Replay your history: the config must stay quiet on your normal weeks and fire on the incident you already know about before it can wake a human.
E-processes accumulate evidence instead of re-rolling the dice; online FDR bounds false discoveries across every stream. The pages you get are worth acting on.
Drag the slider: the fixed threshold piles up false alarms the more often you check; the evidence line stays flat and fires once. The same engine runs 24/7 on public AI-vendor signals in our Observatory — with its false-alarm budget stated on the page.
Fixed threshold — ≈ 7 false alarms
The more often you look, the more it cries wolf on stable noise.
ValidAnytime — 0 alert, 0 false
Watching — no evidence of a real change yet.
Roll 20 genuinely random healthy streams and watch nearly all of them stay quiet — the false-alarm bound, re-runnable yourself.
Illustrative run on a synthetic stream, scored by the same anytime-valid detector we run on your data. The metric labels above are just framing — the numbers and the detector’s behavior are identical. In onboarding, ValidAnytime replays your history and shows whether — and on which day — it would have caught your regression.
p99 latency — step + creep
Synthetic, illustrative — runs in your browser, nothing uploaded.
From the seeded demo — synthetic stream, real engine. Load it in the live dashboard →
Keep your APM and dashboards — they're great at showing what happened, and we don't claim to replace them or to integrate with them yet. ValidAnytime fixes the one thing fixed thresholds do badly: the alarm.
Point ValidAnytime at one stream and it replays your own history — free, no credit card.