Observation, Feedback, and Evaluation

Workspai separates live observation, structured feedback, and evaluation. This keeps telemetry useful without turning conversation text into an uncontrolled system of record.

Observe changes

npx workspai workspace watch --json

Watch publishes versioned events for relevant workspace changes. Consumers use those events to invalidate or refresh bounded evidence; an event is not itself a new verification verdict.

Record outcomes

npx workspai workspace feedback record --json

Feedback is a non-interactive stdin interface validated against the agent action outcome contract. Accepted records append to Workspace Intelligence history with scope and evidence references.

Evaluate value and cost

npx workspai workspace eval init --json
npx workspai workspace eval status --json
npx workspai workspace eval report --json
npx workspai workspace eval compare --json

Evaluation tracks retrieval payload, latency, model usage, cost provenance, and verified task outcomes. It does not store prompt or response bodies and does not convert model activity into proof of correctness.

See workspace watch, workspace feedback, and workspace eval.