Benchmarks & research

jev-agent-failure-benchmark

@TokenTrim1PythonApache-2.0updated 2026-09-17

Benchmarking Jev (Typesafe.ai) against a strong LLM on the Who&When Pro agent-failure-attribution benchmark (text subset).

TokenTrim/jev-agent-failure-benchmark

Where it calls Jev

DEFAULT_ENDPOINT = "https://api.typesafe.ai/v1/systemone"

src/jevbench/backends/jev.py:29

The link points at the commit we read, so the line number still holds.

This one cannot run here

Its question set is assembled at runtime, or never written out literally in the code, so there is nothing to lift. The source link above will show you.

Other projects in this category