Commits

Commits on Oct 5, 2026

fix: preserve tool output limits for scoring and replay (#898)
oliver-aisi
authored
475be65

Commits on Oct 1, 2026

fix: preserve deleted files in Git reference diffs (#894)
Garyouki
authored
173c872

Commits on Sep 30, 2026

fix: keep the filename when rescoring a single .eval file (#891)
marliechorgan
authored
aa1bc26
chore: bump huggingface-hub to >=1.2.0 (#892)

Rogan-Inglis
and
claude
authored
097bf62
fix: honour tool output exclusions in monitor views (#890)
Garyouki
authored
7fcdb54

Commits on Sep 29, 2026

feat(infra)!: remove the docker sandbox mode (#865)

Rogan-Inglis
and
claude
authored
18fafcb

Commits on Sep 28, 2026

fix(eval_sabotage): pin the sandbox to an explicit compose file (#866)

Rogan-Inglis
and
claude
authored
d4cab43
fix: parse 'X out of Y' monitor scores as X rather than Y (#885)

authored
c0a82fa
fix: stop bootstrapped ROC AUC confidence intervals crashing on tied scores (#884)

authored
0c116ae
fix: read --no-index diff from stdout (#882)

authored
57f292c
fix: preserve SAE side-task judge failures (#883)

authored
5792fe4
fix(docs): stop swe_django_sidetask vanishing from the docs (#861)

Rogan-Inglis
and
claude
authored
70e5e8b
docs: fix "Unrusted" typo in architecture diagram (#881)

bigsnarfdude
and
claude
authored
e8793e7

Commits on Aug 21, 2026

feat!: regenerate the vLLM main task dataset and pin its version (#863)

Rogan-Inglis
and
claude
authored
b9d19de

Commits on Aug 20, 2026

feat(monitor): distinguish parsed scores from fallback values (#875)
aedikala1
authored
b48c73d

Commits on Aug 19, 2026

Commits on Aug 12, 2026

fix: make the trio test suite pass, and say why where it cannot (#853)

Rogan-Inglis
and
claude
authored
3a378ed
feat!: run vllm and iac on k8s, and take all three sandboxes offline (#860)

Rogan-Inglis
and
claude
authored
aea8b86
fix: use anyio instead of asyncio primitives so trio runs work (#851)

Rogan-Inglis
and
claude
authored
9a0cc45

Commits on Aug 11, 2026

perf(analysis): compute ROC AUC from rank sums instead of pairwise comparisons (#857)

alejandro-publius
and
claude
authored
382d7bb

Commits on Aug 10, 2026

fix(analysis): validate inputs with raise rather than assert (#859)

alejandro-publius
and
claude
authored
c8dbe40
fix!: sanitize last_tool_calls monitor prompt (#854)
tvararu
authored
fbe4d5d

Commits on Jul 31, 2026

refactor(iac_fast)!: run through the sandbox API instead of the Docker SDK (#852)

Rogan-Inglis
and
claude
authored
6d7259e

Commits on Jul 30, 2026

fix(iac_fast)!: recover from a dead JSII kernel instead of bricking the sample (#850)

Rogan-Inglis
and
claude
authored
7d7e95b

Commits on Jul 28, 2026

fix(scaffolds)!: make react_scaffold compaction actually work (#847)

Rogan-Inglis
and
claude
authored
e9c9934
test(bash_arena): stop pure-logic tests paying for Docker prebuild (#848)

Rogan-Inglis
and
claude
authored
b5ed5a4
fix(iac_fast): bring the text editor back in line with inspect's (#849)

Rogan-Inglis
and
claude
authored
e5ffa80
feat(tools)!: make oversized tool output recoverable (#846)

Rogan-Inglis
and
claude
authored
8508cff
feat(eval): expose max_tool_output, message_limit and working_limit (#844)

Rogan-Inglis
and
claude
authored
889a89e
fix(swebench): correct SWEbenchInstance typing (#843)

Rogan-Inglis
and
claude
authored
90e196e
chore(deps)!: bump inspect-ai to >=0.3.250 (#842)

Rogan-Inglis
and
claude
authored
dab05da
fix(examples): pair iac monitor with its prompt's 0-100 score range (#839)

Rogan-Inglis
and
claude
authored
dc61339
fix(tools): raise tool errors from restricted_text_editor instead of returning them (#841)

Rogan-Inglis
and
claude
authored
2f37381
fix(iac_fast)!: require new_str for str_replace instead of deleting silently (#840)

Rogan-Inglis
and
claude
authored
e733b4d