JudgeModel
@forge/monorepo / backend/src / JudgeModel
Interface: JudgeModel
Defined in: backend/src/evaluation/judge.ts:44
What a judge implementation must provide. Injected so the harness runs with no provider in tests.
Properties
modelId
readonlymodelId:string
Defined in: backend/src/evaluation/judge.ts:45
Methods
complete()
complete(
input):Promise<{costMinorUnits:number;text:string; }>
Defined in: backend/src/evaluation/judge.ts:47
Must be called at temperature zero. The harness cannot enforce that, so an implementation must.
Parameters
input
system
string
user
string
Returns
Promise<{ costMinorUnits: number; text: string; }>