Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
METR
/
inspect-test-utils
Public
Notifications
You must be signed in to change notification settings
Fork
2
Star
1
Code
Issues
1
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
Datepicker
All time
Commit history
Commits on Sep 5, 2026
Merge pull request #6 from METR/feat/citing-scanner
Show description for 06e6f92
pipmc
authored
06e6f92
View commit details
Copy full SHA for 06e6f92
Browse repository at this point
refactor: parametrize transcript fixtures directly rather than via flags
pipmc
committed
f535de0
View commit details
Copy full SHA for f535de0
Browse repository at this point
fix: annotate parametrized transcript fixtures for list invariance
pipmc
committed
a68e91b
View commit details
Copy full SHA for a68e91b
Browse repository at this point
test: cover both directions of independent reference-kind population
pipmc
committed
3f1ce24
View commit details
Copy full SHA for 3f1ce24
Browse repository at this point
docs: trim citing_scanner docstring to its summary line
pipmc
committed
82be706
View commit details
Copy full SHA for 82be706
Browse repository at this point
fix: address citing_scanner review findings
Show description for 7302b9d
pipmc
committed
7302b9d
View commit details
Copy full SHA for 7302b9d
Browse repository at this point
Commits on Sep 4, 2026
feat: add citing_scanner emitting message and event references
pipmc
committed
12b3b7b
View commit details
Copy full SHA for 12b3b7b
Browse repository at this point
Commits on Sep 2, 2026
Merge pull request #5 from METR/feat/hardcoded-429-simulation
Show description for 1842b14
rasmusfaber
authored
1842b14
View commit details
Copy full SHA for 1842b14
Browse repository at this point
Drop the eval-based rate-limit tests
Show description for 0d8561a
rasmusfaber
and
claude
committed
0d8561a
View commit details
Copy full SHA for 0d8561a
Browse repository at this point
Simulate SDK-swallowed retries, and test #5138 properly
Show description for 97cf8ac
rasmusfaber
and
claude
committed
97cf8ac
View commit details
Copy full SHA for 97cf8ac
Browse repository at this point
Record the ModelCall for refused requests
Show description for aca126d
rasmusfaber
and
claude
committed
aca126d
View commit details
Copy full SHA for aca126d
Browse repository at this point
Simulate 429s so adaptive concurrency can be tested
Show description for 350f810
rasmusfaber
and
claude
committed
350f810
View commit details
Copy full SHA for 350f810
Browse repository at this point
Commits on Aug 21, 2026
feat: let configurable_sandbox request a runtime class (#4)
Show description for b65e82e
revmischa
and
claude
authored
b65e82e
View commit details
Copy full SHA for b65e82e
Browse repository at this point
Commits on Aug 10, 2026
Merge pull request #3 from rasmusfaber/feat/network-sandbox-per-service-modes
Show description for 7151f32
rasmusfaber
authored
7151f32
View commit details
Copy full SHA for 7151f32
Browse repository at this point
feat(network_sandbox): support per-service network modes
Show description for 18a4531
rasmusfaber
and
claude
committed
18a4531
View commit details
Copy full SHA for 18a4531
Browse repository at this point
Commits on Jul 20, 2026
Merge pull request #1 from METR/pip/add-failing-scanner
Show description for f15f30f
pipmc
authored
f15f30f
View commit details
Copy full SHA for f15f30f
Browse repository at this point
Add failing_scanner for deterministic scan-error testing
Show description for adb1e76
pipmc
and
claude
committed
adb1e76
View commit details
Copy full SHA for adb1e76
Browse repository at this point
Initial commit
pipmc
committed
e3606b4
View commit details
Copy full SHA for e3606b4
Browse repository at this point
You can’t perform that action at this time.