Skip to main content

HarnessRunResult

@forge/monorepo


@forge/monorepo / backend/src / HarnessRunResult

Type Alias: HarnessRunResult

HarnessRunResult = object

Defined in: backend/src/evaluation/index.ts:56

Properties

modelCalls

readonly modelCalls: number

Defined in: backend/src/evaluation/index.ts:62

Model calls made. Zero on a fully deterministic run, which is asserted rather than assumed.


results

readonly results: readonly EvalCaseResult[]

Defined in: backend/src/evaluation/index.ts:58


run

readonly run: EvalRun

Defined in: backend/src/evaluation/index.ts:57


unscoreable

readonly unscoreable: readonly string[]

Defined in: backend/src/evaluation/index.ts:60

Cases no grader could decide, by id. Non-empty means the harness needs attention, not the platform.