Request body for creating an evaluation rule.
Checklist for agents and SDK clients:
evaluator.name
evaluator.scope
target=observation
target=experiment
GET /api/public/v2/datasets
id
filter[].value
llm_as_judge
code
filter
enabled=true
Request body for creating an evaluation rule.
Checklist for agents and SDK clients:
evaluator.nameandevaluator.scopetarget=observationortarget=experimenttarget=experimentand you want a dataset filter, callGET /api/public/v2/datasetsfirst and use datasetidvalues infilter[].valuellm_as_judge, fetch or inspect the evaluator first and provide a complete variable mapping for every evaluator variablecode, do not send variables or mappings; Langfuse stores the fixed code runtime mapping automaticallyfilterenabled=trueonly when you want live execution immediately