Repositories list

• hawk

  Public
  Run Inspect AI evals in the cloud

  awsllmevals+ 1

  awsllmevalsinspect-ai

  Python

  •

  MIT License

  •5050 forks•8787 stars•146146 issues•163163 pull requests•Updated Oct 5, 2026Oct 5, 2026

• inspect_ai

  Public
  Inspect: A framework for large language model evaluations

  Python

  •

  MIT License

  •774774 forks•1111 stars•00 issues•00 pull requests•Updated Oct 4, 2026Oct 4, 2026

• inspect-agents

  Public
  A collection of METR wrappers around Inspect agents and of METR scanners for Inspect Scout. Intended to allow consistent usage and customization.

  Python

  •

  MIT License

  •44 forks•1010 stars•22 issues•2121 pull requests•Updated Oct 3, 2026Oct 3, 2026

• inspect_scout

  Public
  Python

  •

  MIT License

  •4747 forks•11 star•00 issues•22 pull requests•Updated Oct 2, 2026Oct 2, 2026

• ts-mono

  Public
  TypeScript monorepo

  TypeScript

  •2727 forks•00 stars•00 issues•00 pull requests•Updated Oct 2, 2026Oct 2, 2026

• inspect_k8s_sandbox

  Public
  A Kubernetes sandbox environment for use with inspect_ai

  Python

  •

  MIT License

  •3535 forks•33 stars•00 issues•00 pull requests•Updated Oct 2, 2026Oct 2, 2026

• activitywatch

  Public
  The best free and open-source automated time tracker. Cross-platform, extensible, privacy-focused.

  Python

  •

  Mozilla Public License 2.0

  •1k1k forks•00 stars•00 issues•11 pull request•Updated Sep 29, 2026Sep 29, 2026

• inspect-eagle

  Public
  macOS GUI to view large inspect samples. Integrated with Hawk

  Swift

  •00 forks•00 stars•00 issues•00 pull requests•Updated Sep 28, 2026Sep 28, 2026

• inspect-test-utils

  Public
  Utilities for testing Inspect AI

  Python

  •

  MIT License

  •22 forks•11 star•11 issue•00 pull requests•Updated Sep 22, 2026Sep 22, 2026

• inspect-tasks-public

  Public
  Python

  •

  Other

  •99 forks•44 stars•00 issues•66 pull requests•Updated Sep 9, 2026Sep 9, 2026

• inspect-metr-task-bridge

  Public
  Python

  •22 forks•11 star•11 issue•44 pull requests•Updated Sep 3, 2026Sep 3, 2026

• datadog-mcp

  Public
  Datadog MCP Server - Comprehensive monitoring and observability tools for Datadog via Model Context Protocol

  Python

  •2424 forks•00 stars•00 issues•00 pull requests•Updated Aug 27, 2026Aug 27, 2026

• inspect-eval-utils

  Public
  Python

  •

  MIT License

  •00 forks•00 stars•00 issues•00 pull requests•Updated Aug 27, 2026Aug 27, 2026

• MirrorCode

  Public
  Public repository for MirrorCode

  C

  •

  MIT License

  •1616 forks•00 stars•00 issues•00 pull requests•Updated Aug 19, 2026Aug 19, 2026

• task-assets

  Public
  Python

  •00 forks•00 stars•11 issue•11 pull request•Updated Aug 19, 2026Aug 19, 2026

• bombe-engine

  Public
  METR fork of CharlieBrej/Bombe: the Bombe puzzle engine, assets removed, with eval-specific modifications.

  C++

  •

  Creative Commons Attribution 4.0 International

  •00 forks•00 stars•00 issues•00 pull requests•Updated Aug 2, 2026Aug 2, 2026

• hcast-public

  Public
  HTML

  •

  Other

  •55 forks•2424 stars•33 issues•11 pull request•Updated Jul 28, 2026Jul 28, 2026

• public-tasks

  Public
  HTML

  •

  Other

  •2222 forks•133133 stars•77 issues•55 pull requests•Updated Jul 28, 2026Jul 28, 2026

• triframe_inspect

  Public
  Python

  •00 forks•44 stars•00 issues•00 pull requests•Updated Jul 16, 2026Jul 16, 2026

• .github

  Public
  00 forks•00 stars•00 issues•00 pull requests•Updated Jul 8, 2026Jul 8, 2026

• local_manual_scoring_tool

  Public
  Python

  •00 forks•00 stars•00 issues•11 pull request•Updated Jul 7, 2026Jul 7, 2026

• vivaria

  Public
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.

  aielicitationai-evaluation+ 1

  aielicitationai-evaluationevals

  TypeScript

  •

  MIT License

  •4040 forks•143143 stars•220220 issues•77 pull requests•Updated May 18, 2026May 18, 2026

• terraform-aws-iam-identity-center

  Public
  HCL

  •

  Apache License 2.0

  •3333 forks•00 stars•00 issues•00 pull requests•Updated May 8, 2026May 8, 2026

• inspect-action

  Public archive
  Running UK AISI's Inspect in the Cloud

  aiinspectelicitation+ 2

  aiinspectelicitationai-evaluationevals

  Python

  •

  MIT License

  •1111 forks•2525 stars•1919 issues•99 pull requests•Updated May 6, 2026May 6, 2026

• evaluation-resources

  Public
  SCSS

  •

  MIT License

  •44 forks•33 stars•00 issues•22 pull requests•Updated May 1, 2026May 1, 2026

• inspect-action-jonathan

  Public
  Running UK AISI's Inspect in the Cloud

  Python

  •

  MIT License

  •1111 forks•00 stars•00 issues•00 pull requests•Updated Apr 10, 2026Apr 10, 2026

• inspect-tinker-bridge

  Public
  Inspect tasks <> Tinker RL envs

  Python

  •

  MIT License

  •44 forks•88 stars•00 issues•00 pull requests•Updated Mar 10, 2026Mar 10, 2026

• eval-analysis-public

  Public
  Public repository containing METR's DVC pipeline for eval data analysis

  Python

  •5555 forks•335335 stars•1010 issues•44 pull requests•Updated Mar 6, 2026Mar 6, 2026

• Measuring-Late-2025-AI-on-OSS-Devs

  Public
  Python

  •22 forks•88 stars•00 issues•11 pull request•Updated Feb 24, 2026Feb 24, 2026

• Measuring-Early-2025-AI-on-Exp-OSS-Devs

  Public
  Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity: https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study…

  Python

  •22 forks•1717 stars•00 issues•11 pull request•Updated Feb 23, 2026Feb 23, 2026