Irregular

What it is

A security research lab that builds offensive-security benchmarks and evaluation environments used to measure what frontier models can actually do in a cyber context. Runs third-party capability evaluations for major labs; named as the evaluation partner in Anthropic's July 2026 disclosure of live-internet leakage during cyber evals.