Eval Case

One repeatable test of an agent, lifted from a /wrong-answer report: the prompt that produced a bad answer, the node the answer had to read, the value it must not invent and the value it should state. Run N times against the agent; scored on the answer's own ThreadMessage record — did it look, did it invent, did it get it right. Stored under Feedback/_Evals/{agentId}/{case}, written as System. Compiled live from Source/.

Configuration: config => config.WithContentType<EvalCaseContent>().LiftOnActivation().StampConfirmationOnActivation().AddDefaultLayoutAreas().AddLayout(layout => layout.AddEvalCaseLayoutAreas().WithView("Tests", EvalCaseTestsArea.Tests).WithDefaultArea("Eval"))
Include global types: yes
Cell surface: no
Owns partition: no
Keeps history: yes
Sources: namespace:Source scope:subtree, shared=@Feedback/Feedback/Source/FeedbackContent, shared=@Feedback/Feedback/Source/WrongAnswerReport
Stamped fields: confirmedBy
Compilation status: 3
Last compile started at: 2026-09-26T17:55:10.3707188+00:00
Last compile succeeded at: 2026-11-01T14:59:01.6750028+00:00
Last compiled version: 131
Last compilation activity path: Feedback/EvalCase/_Activity/compile-202609261755107704ba1961699a841f5903d93e11812295e
Latest release path: Feedback/EvalCase/Release/20260926175511-RtNPqO3I
Requested release at: 2026-10-29T16:06:11.0984147+00:00
Requested release force: no
Requested release by: system-security
Last release request handled at: 2026-10-29T16:06:11.0984147+00:00
Latest assembly collection: local
Latest assembly path: Feedback_EvalCase/v131-c003e001-ebd985ed3248.dll
Latest assembly mvid: c765e8bf47f94e42bfe1c8ea3fea71c4
Compiled sources › Feedback/ eval case/ source/ eval runner: 639280035509883610
Compiled sources › Feedback/ eval case/ source/ eval scoring: 639261971584813440
Compiled sources › Feedback/ eval case/ test/ eval case tests: 639265641156572800
Compiled sources › Feedback/ eval case/ source/ eval case content: 639280035509381490
Compiled sources › Feedback/ eval case/ source/ eval case lifting: 639265641157016660
Compiled sources › Feedback/ eval case/ test/ eval case tests area: 639265641156039620
Compiled sources › Feedback/ feedback/ source/ feedback content: 639288867707677740
Compiled sources › Feedback/ feedback/ source/ wrong answer report: 639265641155323320
Compiled sources › Feedback/ eval case/ source/ eval case layout areas: 639280035508847990
Compiled sources › Feedback/ eval case/ source/ eval case confirmation: 639280035504570930
Current source versions › Feedback/ eval case/ source/ eval runner: 639280035509883610
Current source versions › Feedback/ eval case/ source/ eval scoring: 639261971584813440
Current source versions › Feedback/ eval case/ test/ eval case tests: 639265641156572800
Current source versions › Feedback/ eval case/ source/ eval case content: 639280035509381490
Current source versions › Feedback/ eval case/ source/ eval case lifting: 639265641157016660
Current source versions › Feedback/ eval case/ test/ eval case tests area: 639265641156039620
Current source versions › Feedback/ feedback/ source/ feedback content: 639288867707677740
Current source versions › Feedback/ feedback/ source/ wrong answer report: 639265641155323320
Current source versions › Feedback/ eval case/ source/ eval case layout areas: 639280035508847990
Current source versions › Feedback/ eval case/ source/ eval case confirmation: 639280035504570930
Current source fingerprint: ed54340b6a557e41
Build provenance: 2
Adopted module version: 1.10.8
Current module version: 1.11
Built module version: 1.10.8
Built module version mvid: c765e8bf47f94e42bfe1c8ea3fea71c4
Compiled framework version: c003e001
Compiled modules hash: 42d58c99467ba7b9c3f3e9c793cb52ea9e6f5c35256275e02a2cd1e64dfc5df8
Compiled dependencies › !input: i158a3ecdc1eb338e4f36723daebda6a3
Compiled dependencies › !toolchain: compat:c003e001
Compiled dependencies › Mesh weaver. aI: min:3.1.0.0
Compiled dependencies › Mesh weaver. data: compat:c003e001
Compiled dependencies › Mesh weaver. graph: compat:c003e001
Compiled dependencies › Mesh weaver. layout: compat:c003e001
Compiled dependencies › Mesh weaver. mesh. contract: compat:c003e001
Compiled dependencies › Mesh weaver. messaging. contract: compat:c003e001
Compiled dependencies › Mesh weaver. messaging. hub: compat:c003e001
Compiled dependencies › Mesh weaver. utils: compat:c003e001