containsGrader
@forge/monorepo / backend/src / containsGrader
Variable: containsGrader
constcontainsGrader:Grader
Defined in: backend/src/evaluation/graders.ts:91
contains — the output mentions every expected string.
Case-insensitive and whitespace-tolerant, because the expectation is that the fact appears, not that the model reproduced a casing. Partial credit, because "mentioned two of three" is genuinely different from "mentioned none" and collapsing them loses the signal a regression report needs.