Sign up for our newsletter and get notified of irregular updates ...
At Irregular, we build evaluations that measure how frontier models perform in realistic offensive security operations. Anthropic used CyScenarioBench, our benchmark for multi-stage offensive cyber ...
We studied a self-hosted system in which the same open-weights model powered both a coding agent and an AI application that the coding agent was asked to maintain. This architecture is particularly ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results