Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: METR/inspect-agents
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: main
Choose a base ref
...
head repository: METR/inspect-agents
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: reilly/monitor-context-gap-warning
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 1 commit
  • 2 files changed
  • 2 contributors

Commits on Oct 1, 2026

  1. feat(action_monitor): warn when a monitor rung holds much less contex… 

    …t than the agent

A rung with a smaller window than the agent summarises the conversation's
middle while the agent still sees those turns verbatim. That matters most on
fallbacks, which score whatever the head refuses. The approver now warns, once
per pairing, when any resolved rung holds under 90% of the agent's input
tokens, and says to use monitors whose window at least matches the agent's.
It also says when either window is unknown, so silence is not read as "checked".

Both sides are sized the way inspect's compaction sizes the agent
(`get_model_input_tokens`), which follows provider aliasing: `claude-opus-5`
and its cvp variants, absent from the pinned database, now resolve to 1M
instead of "unknown". `model_input_capacity` takes a resolved `Model` for
that; bare names keep the database lookup.

Advisory only. Under this rule both chains in monitoring-horizons warn for
every 1M agent: opus-4-5-20251101 (200k) and gpt-5.2/gpt-5 (272k input) are
last-resort rungs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
    @Reih02 @claude
    Reih02 and claude committed Oct 1, 2026
    Configuration menu
    Copy the full SHA
    8cca0f1 View commit details
    Browse the repository at this point in the history
Loading