Agent tooling
Codex code-search plugin using Jev relevance filtering with auditable token metrics
const response = await fetchImpl('https://api.typesafe.ai/v1/systemone', {The link points at the commit we read, so the line number still holds.
These question sets are lifted from this project's source exactly as written.
from src/jev.mjs:4
relevancechoiceDoes candidate contain useful evidence for user_question or retrieval_objective?
Yes — The passage provides useful evidence, a relevant dependency, background, a test, or counterevidence.No — The passage does not provide useful evidence for this information need; shared keywords alone are insufficient.import { experimental_evaluate as evaluate } from 'ai';
const { answers } = await evaluate({
model: 'typesafe-ai/jev',
state,
questions: {
relevance: { type: 'choice', instructions: 'Does candidate contain useful evidence for user_question or retrieval_objective?',
criteria: { Yes: 'The passage provides useful evidence, a relevant dependency, background, a test, or counterevidence.', No: 'The passage does not provide useful evidence for this information need; shared keywords alone are insufficient.' } },
},
});