Get evaluator

Retrieve a single evaluator by its ID.

GET /v1/platform/evaluators/{evaluator_id}

Error

A valid request URL is required to generate request examples

200

{
  "code_evaluator": {
    "code": "<string>",
    "evaluator_id": "<string>",
    "language": "<string>"
  },
  "created_at": "<string>",
  "created_by": "<string>",
  "feedback_keys": [
    "<string>"
  ],
  "id": "<string>",
  "llm_evaluator": {
    "annotation_queue_id": "<string>",
    "commit_hash_or_tag": "<string>",
    "corrections_dataset_id": "<string>",
    "evaluator_id": "<string>",
    "num_few_shot_examples": 123,
    "prompt_id": "<string>",
    "prompt_repo_handle": "<string>",
    "use_corrections_dataset": true,
    "variable_mapping": {}
  },
  "name": "<string>",
  "run_rules": [
    {
      "corrections_dataset_id": "<string>",
      "dataset_id": "<string>",
      "dataset_name": "<string>",
      "group_by": "<string>",
      "id": "<string>",
      "num_few_shot_examples": 123,
      "session_id": "<string>",
      "session_name": "<string>",
      "use_corrections_dataset": true
    }
  ],
  "spend_usd": 123,
  "tenant_id": "<string>",
  "trace_count": 123,
  "updated_at": "<string>"
}

Authorizations

API KeyTenant IDBearer Auth

X-API-Key · string · header · required

Path Parameters

evaluator_id · string · required

Evaluator ID

Response

200

application/json

OK

code_evaluator · object

Show child attributes

created_at · string

created_by · string

feedback_keys · string[]

id · string

llm_evaluator · object

Embedded child evaluator (populated based on type)

Show child attributes

name · string

run_rules · object[]

Show child attributes

spend_usd · number

Sum of LLM-as-judge run rule spend for the requested period (omitted when feature is disabled).

tenant_id · string

trace_count · integer

type · enum<string>

Available options: llm, code

updated_at · string