Contribute

Help us with reviews & annotations

Alongside the main bench we run transfer evals against existing Fermi datasets — scoring modern models and reviewing where they (or the datasets' gold answers) go wrong. The notes from those reviews are exactly what we mine to build better questions. If you'd like to help review and annotate, dive in:

Have a question to add instead? Contribute a question →