Who we are
The AI Evaluator Forum is a network of organizations conducting independent, third-party evaluations of AI systems. The Forum brings together practitioners to share methods, align on norms of professional practice, and inform the broader standards and policy ecosystem. The Forum is not a legal entity in its own right and relies on voluntary participation from its members.
Why we exist
As AI systems grow more powerful and widely deployed, society faces critical questions about their capabilities, limitations, and risks. Answering those questions credibly requires rigorous assessment by organizations independent of the systems they evaluate. The Forum brings together organizations conducting independent, third-party evaluations of AI systems to share methods, align on norms of professional practice, and inform the broader standards and policy ecosystem.
How we work
Establish Standards
We develop shared requirements for credible third-party evaluations: conflict-of-interest disclosure and management, funding relationships, recusal, depth of system access, and transparency about the terms of an evaluation.
Foster Collaboration
Credible oversight cannot rest on a handful of organizations. We bring together evaluators across independent research organizations and academia to share knowledge, coordinate efforts, and broaden the field.
Advance Understanding
Through rigorous research and peer review, we improve public understanding of AI capabilities and risks — and support the development of stronger evaluation methodologies across the field.