Issues

• Eval-detection via environment leakage: agent can detect it's being evaluated via RUN_ID/TASK_ID/AGENT_TOKEN env vars

  METR/vivaria#1121 · Filter by author AUTHENSOR opened on Jul 14, 2026

• 404 on video on project website

  METR/vivaria#1120 · Filter by author BenWheatley opened on Jul 6, 2026

• ENG-206: Look into runs_mv refresh slowness

  METR/vivaria#1104 · Filter by author revmischa opened on Oct 1, 2025
  

• Add support for passthrough runs to either materialized view or generated fields in trace_entries_t

  METR/vivaria#993 · Filter by author sjawhar opened on Mar 26, 2025
  2

• Deduplicate logic in get_branch_usage and runs_mv

  METR/vivaria#992 · Filter by author sjawhar opened on Mar 24, 2025

• UTF-16 generated by setup-docker-compose.ps1 prevents docker up from working on windows

  bug
  METR/vivaria#971 · Filter by author metatrot opened on Mar 13, 2025

• Use scoring error type when runs fail during scoring

  METR/vivaria#931 · Filter by author sjawhar opened on Feb 10, 2025
  1

• viv task test --destroy-on-exit doesn't destroy the task if Vivaria restarts during task environment creation

  bug
  METR/vivaria#874 · Filter by author tbroadley opened on Jan 17, 2025
  4

• If Vivaria restarts during a run's initial intermediate scoring, then run gets a fatal error

  bug
  METR/vivaria#871 · Filter by author tbroadley opened on Jan 16, 2025
  7

• A user assigns a final score to a manually scored run

  manual scoring
  METR/vivaria#867 · Filter by author sjawhar opened on Jan 15, 2025

• Allow agents to be run without a --branch tag

  METR/vivaria#819 · Filter by author naterush opened on Dec 19, 2024
  1

• An agent starts and manages its own runs

  METR/vivaria#816 · Filter by author sjawhar opened on Dec 19, 2024

• Vivaria captures and save "artifacts" from a run

  manual scoring
  METR/vivaria#814 · Filter by author sjawhar opened on Dec 19, 2024
  1

• A user pauses an active run

  METR/vivaria#798 · Filter by author sjawhar opened on Dec 17, 2024

• Allow tasks to specify Docker Compose files

  enhancementtask-standard
  METR/vivaria#797 · Filter by author sjawhar opened on Dec 17, 2024

• Allow tasks to specify a full Dockerfile

  enhancementtask-standard
  METR/vivaria#796 · Filter by author sjawhar opened on Dec 17, 2024

• Better help message for viv --help

  METR/vivaria#791 · Filter by author neevparikh opened on Dec 16, 2024
  6

• Installing pyhooks on containers overwrites task family requirements

  METR/vivaria#744 · Filter by author mruwnik opened on Nov 30, 2024

• Transcripts server run pages have two scrollbars

  bug
  METR/vivaria#727 · Filter by author tbroadley opened on Nov 25, 2024

• Agent task link is hard coded when doing viv run with a local task_family_path arg

  METR/vivaria#722 · Filter by author amydeng2000 opened on Nov 25, 2024

• Add wall-clock time usage limits

  METR/vivaria#703 · Filter by author tbroadley opened on Nov 18, 2024

• User is instructed to run viv task ssh when it won't work

  METR/vivaria#700 · Filter by author ryanbloom opened on Nov 16, 2024

• Support multiple model providers in built-in Middleman

  METR/vivaria#687 · Filter by author ryanbloom opened on Nov 14, 2024

• actions.run_bash's last directory and env vars should be part of agent state

  METR/vivaria#674 · Filter by author tbroadley opened on Nov 12, 2024

• Add a UI indicator and/or a CLI command of the distribution of free GPUs on the cluster and the number of pending pods

  METR/vivaria#663 · Filter by author tbroadley opened on Nov 10, 2024 · k8s