Skip to contents

Build the output schema for a scoring system

Source: R/01_ScoringSystem.R, R/02_ScoringSystem_methods.R
score_schema.Rd

Build the output schema for a scoring system

Usage

score_schema(scoring_system, keys, block = "pairwise", rationale = TRUE)

## S7 method for class <curriculum::ScoringSystem>
score_schema(scoring_system, keys, block = "pairwise", rationale = TRUE)

## S7 method for class <curriculum::ContinuousScoringSystem>
score_schema(scoring_system, keys, block = "pairwise", rationale = TRUE)

Arguments

scoring_system

ScoringSystem object.

keys

Character: Response keys. One per criterion under block = "joint"; ignored under block = "pairwise" (the default).

block

Character {"pairwise", "joint"}: Prompt block structure.

rationale

Logical: Whether to include the free-text justification field(s). Dropping them roughly halves the tokens the model must emit.

Value

rtemis.llm::Schema object.

Author

EDG