We have some logic in pyhooks to log pauses when an agent's requests to Vivaria come back with a 429 or a similar retryable status code. However, this logic assumes that multiple parallel generation requests won't be made at the same time by the same agent branch.
Perhaps it's enough to change pyhooks to log pauses across an entire agent process, instead of creating one RetryPauser per request?
Or maybe we need logic that can handle pyhooks being called from multiple separate processes in the same agent?
We have some logic in pyhooks to log pauses when an agent's requests to Vivaria come back with a 429 or a similar retryable status code. However, this logic assumes that multiple parallel generation requests won't be made at the same time by the same agent branch.
Perhaps it's enough to change pyhooks to log pauses across an entire agent process, instead of creating one RetryPauser per request?
Or maybe we need logic that can handle pyhooks being called from multiple separate processes in the same agent?