REFUSAL_JUDGE_PROMPT_VERSION
@forge/monorepo / backend/src / REFUSAL_JUDGE_PROMPT_VERSION
Variable: REFUSAL_JUDGE_PROMPT_VERSION
constREFUSAL_JUDGE_PROMPT_VERSION:"1"="1"
Defined in: backend/src/evaluation/judge.ts:33
The judge's prompt, and its version.
Version bumped on any wording change, including one that looks cosmetic. A grader prompt is an instrument; recalibrating it silently makes every historical comparison a comparison of two different instruments.
The prompt asks for one token because a judge that explains itself is a judge whose explanation varies — and the reason a case failed belongs to the case's expectation, which the harness already records.