ValidAnytime
  • Try it free
  • Observatory
  • Pricing
  • Docs
Sign inStart free
ValidAnytime

A guaranteed false-alarm budget across your whole fleet, valid no matter how often you look.

Made by Compiled Intelligence — a frontier AI lab working on quantitative finance from first principles; ValidAnytime is the monitoring we built for our own model fleets, productized.

Product

  • How it works
  • Pricing
  • Observatory
  • Try it free
  • Dashboard

Solutions

  • Who it's for
  • For LLM engineers
  • For MLOps engineers
  • For SRE & platform
  • LLM eval regression
  • Model drift detection
  • Alert fatigue

Developers

  • Docs
  • Quickstart
  • Python SDK
  • API reference

Learn

  • Benchmark
  • Detector guides
  • Glossary
  • Compare
  • Why dashboards lie
  • Blog
  • Anytime-valid 101
  • Winter Storm Uri case study
  • Incident ledger
  • Observatory methodology

Company

  • Contact
  • Privacy
  • Terms

Observatory alarms & product updates, by email

Rare emails only. We store your address and the tag “footer” — nothing else. Unsubscribe anytime.

© 2026 ValidAnytime. All rights reserved.

Every alarm ships with its guarantee_tag and theorem_ref.

Observatory
MI

Has MISO (Midwest)'s demand forecast drifted?

MISO · updated Jul 6, 22:08 UTC

No regime change detected

MISO (Midwest) — no forecast-error regime change detected

The day-ahead forecast's error has stayed within its calibrated band. Not a certificate that nothing happened.

quiet streak 7 monthsbudget ≈1 false page per BA-yearwatching since Jan 2021
2.68%
mean abs. forecast error

of demand (MAPE)

74,173 MW
mean demand
1,738 MW
typical error

median |error|

7,007 MW
worst-hour error

99th pctile |error|

The evidence, last two weeks

Because the baseline is the operator’s own forecast, seasonality is subtracted for free — what’s left is the miss. The detector pages only when that miss enters a new regime and clears the page line.

0 = the operator’s forecast is exactly rightforecast error — actual demand minus day-ahead forecast (MW)page line (≈1 false page per grid-year)accumulated evidence (anytime-valid log-statistic)Jun 22, 2026Jul 6, 2026
Real EIA-930 data for MISO (Midwest) — the last 336 hourly points. The forecast is the grid operator’s own day-ahead demand forecast (not ours); the error is actual − forecast, peaking at +10,424 MW in this window. The evidence statistic stayed under the page line: no regime change detected. That is not proof nothing happened. Back-in-band is a display heuristic, not a certificate of absence.

Forecast-error regime changes14 in the monitored history

Each is a dated page inside the stated budget. Labels attach only where a window overlaps a documented grid-stress event — never invented. We detect that the forecast’s error changed regime, not that the grid failed or why.

  • EndedDec 18, 2025 → Dec 19, 2025
    peak evidence
    10.11
    forecast miss at onset
    −5,158 MW
    load at onset
    24th pctile of this grid
    back in-band
    Dec 19, 2025
  • EndedDec 18, 2025 → Dec 19, 2025
    peak evidence
    10.61
    forecast miss at onset
    −4,458 MW
    load at onset
    35th pctile of this grid
    back in-band
    Dec 19, 2025
  • EndedFeb 25, 2025 → Feb 27, 2025
    peak evidence
    11.11
    forecast miss at onset
    −4,372 MW
    load at onset
    53th pctile of this grid
    back in-band
    Feb 27, 2025
  • EndedJan 23, 2025 → Jan 24, 2025January 2025 cold wave
    peak evidence
    9.66
    forecast miss at onset
    −4,490 MW
    load at onset
    85th pctile of this grid
    back in-band
    Jan 24, 2025
  • EndedJan 21, 2025 → Jan 22, 2025January 2025 cold wave
    peak evidence
    9.46
    forecast miss at onset
    +4,961 MW
    load at onset
    97th pctile of this grid
    back in-band
    Jan 22, 2025
  • EndedDec 22, 2023 → Dec 24, 2023
    peak evidence
    12.22
    forecast miss at onset
    −4,493 MW
    load at onset
    65th pctile of this grid
    back in-band
    Dec 24, 2023
  • EndedJun 30, 2023 → Jul 1, 2023
    peak evidence
    9.49
    forecast miss at onset
    −8,227 MW
    load at onset
    96th pctile of this grid
    back in-band
    Jul 1, 2023
  • EndedJun 5, 2023 → Jun 7, 2023
    peak evidence
    10.18
    forecast miss at onset
    −6,409 MW
    load at onset
    62th pctile of this grid
    back in-band
    Jun 7, 2023
  • EndedDec 26, 2022 → Dec 27, 2022December 2022 cold (Winter Storm Elliott)
    peak evidence
    9.36
    forecast miss at onset
    −12,207 MW
    load at onset
    77th pctile of this grid
    back in-band
    Dec 27, 2022
  • EndedDec 2, 2021 → Dec 4, 2021
    peak evidence
    9.22
    forecast miss at onset
    −4,866 MW
    load at onset
    48th pctile of this grid
    back in-band
    Dec 4, 2021
  • EndedJul 4, 2021 → Jul 6, 2021
    peak evidence
    11.51
    forecast miss at onset
    +5,059 MW
    load at onset
    71th pctile of this grid
    back in-band
    Jul 6, 2021
  • EndedJun 21, 2021 → Jun 22, 2021
    peak evidence
    9.41
    forecast miss at onset
    −6,791 MW
    load at onset
    81th pctile of this grid
    back in-band
    Jun 22, 2021
  • EndedFeb 15, 2021 → Feb 18, 2021Winter Storm Uri
    peak evidence
    10.98
    forecast miss at onset
    +4,096 MW
    load at onset
    88th pctile of this grid
    back in-band
    Feb 18, 2021
  • EndedJan 14, 2021 → Jan 16, 2021
    peak evidence
    9.84
    forecast miss at onset
    −4,226 MW
    load at onset
    72th pctile of this grid
    back in-band
    Jan 16, 2021

How this verdict is formed

The hourly error runs through a conformal band that learns MISO (Midwest)’s own normal forecast-error rate, into a Shiryaev–Roberts e-detector on a bounded rolling window. An alarm fires only when accumulated evidence crosses the page line — and because the statistic is anytime-valid, checking as often as you like never inflates the false-alarm rate. Full recipe, and exactly what we do not claim, on the methodology page.

Embed this badge

A live status pill for MISO (Midwest), refreshed every publish. Drop it in a README, status page, or dashboard — it always shows the current verdict and links back here. It reads no regime change while the forecast holds, and flips to forecast drift detected when the e-detector pages.

MISO (Midwest) demand-forecast monitor · ValidAnytimelive preview
Markdown
[![MISO (Midwest) demand-forecast monitor · ValidAnytime](https://validanytime.com/observatory/badge/MISO)](https://validanytime.com/observatory/MISO)
HTML
<a href="https://validanytime.com/observatory/MISO"><img src="https://validanytime.com/observatory/badge/MISO" alt="MISO (Midwest) demand-forecast monitor · ValidAnytime"></a>
Monitor your metricsBacktest your data