Workspace Intelligence / JSON Schema

Workspai Workspace Intelligence Benchmark

A deterministic multi-scenario retrieval benchmark with an optional, separately classified evaluation measurement. Estimated retrieval reduction is never represented as measured model savings.

Schema version: workspace-intelligence-benchmark.v1
Contract path: contracts/workspace-intelligence/workspace-intelligence-benchmark.v1.json
Publication: json-schema
Defined fields: 63
Artifact bindings: 1

Why this contract exists

Architecture role

Defines a versioned interoperability boundary used by Workspai and contract-aware consumers.

Consumption boundary

• Workspai CLI
• Workspace Intelligence consumers
• IDEs and agents

Related commands

Commands are linked only when the runtime contract identifies a direct production relationship. Supporting contracts may be consumed without having a single producer command.

workspai workspace graph

Produced artifacts

These durable files are emitted by registered commands and validated against this contract.

Artifact path	Schema	Producer
.workspai/reports/workspace-intelligence-benchmark-last-run.json	workspace-intelligence-benchmark.v1	workspai workspace graph benchmark-suite --write

Field reference

Every declared schema property or published capability path is listed here. Required means the contract declares or publishes that field at the shown boundary.

Field path	Type	Required	Meaning	Constraints
$defs.corpus.artifactCount	integer	Yes	Defines the artifactcount value at this contract boundary.	minimum: 0
$defs.corpus.characterCount	integer	Yes	Defines the charactercount value at this contract boundary.	minimum: 0
$defs.corpus.estimatedTokens	integer	Yes	Defines the estimatedtokens value at this contract boundary.	minimum: 0
$defs.corpus.unreadableArtifacts	array	Yes	Defines the unreadableartifacts value at this contract boundary.	—
$defs.currentEvaluation.runId	string	Yes	Defines the runid value at this contract boundary.	minLength: 1
$defs.currentEvaluation.status	enum	Yes	Defines the status value at this contract boundary.	enum: live, completed, aborted
$defs.currentEvaluation.strategy	enum	Yes	Defines the strategy value at this contract boundary.	enum: full-corpus, grep, vector, graph, workspace-intelligence, custom
$defs.currentEvaluation.summary	reference	Yes	Defines the summary value at this contract boundary.	ref: workspace-intelligence-evaluation.v1.json#/properties/summary
$defs.currentEvaluation.taskId	string	Yes	Defines the taskid value at this contract boundary.	minLength: 1
$defs.scenario.estimatedReductionPercent	number	Yes	Defines the estimatedreductionpercent value at this contract boundary.	minimum: 0 · maximum: 100
$defs.scenario.estimatedTokensAvoided	integer	Yes	Defines the estimatedtokensavoided value at this contract boundary.	minimum: 0
$defs.scenario.id	string	Yes	Defines the id value at this contract boundary.	minLength: 1
$defs.scenario.matchCount	integer	Yes	Defines the matchcount value at this contract boundary.	minimum: 0 · maximum: 100
$defs.scenario.query	string	Yes	Defines the query value at this contract boundary.	minLength: 1
$defs.scenario.queryOrigin	string	Yes	Defines the queryorigin value at this contract boundary.	const: "graph-derived"
$defs.scenario.result	enum	Yes	Defines the result value at this contract boundary.	enum: matched, empty
$defs.scenario.retrievalCharacterCount	integer	Yes	Defines the retrievalcharactercount value at this contract boundary.	minimum: 0
$defs.scenario.retrievalEstimatedTokens	integer	Yes	Defines the retrievalestimatedtokens value at this contract boundary.	minimum: 0
$defs.scenario.targetEntityId	string	Yes	Defines the targetentityid value at this contract boundary.	minLength: 1
$defs.scenario.targetKind	string	Yes	Defines the targetkind value at this contract boundary.	minLength: 1
$defs.scenario.targetRetrieved	boolean	Yes	Defines the targetretrieved value at this contract boundary.	—
$defs.scenario.title	string	Yes	Defines the title value at this contract boundary.	minLength: 1
$defs.scenario.truncated	boolean	Yes	Defines the truncated value at this contract boundary.	—
corpus	reference	Yes	Defines the corpus value at this contract boundary.	ref: #/$defs/corpus
evaluation	object	Yes	Defines the evaluation value at this contract boundary.	additionalProperties: false
evaluation.availability	enum	Yes	Defines the availability value at this contract boundary.	enum: available, unavailable
evaluation.claimBoundary	string	Yes	Defines the claimboundary value at this contract boundary.	minLength: 1
evaluation.comparison	reference	No	Defines the comparison value at this contract boundary.	ref: workspace-intelligence-evaluation-comparison.v1.json
evaluation.current	reference	No	Defines the current value at this contract boundary.	ref: #/$defs/currentEvaluation
evaluation.provenance	enum	Yes	Defines the provenance value at this contract boundary.	enum: measured, mixed, estimated, unavailable
evaluation.trustedMeasuredReductionPercent	number \| null	Yes	Defines the trustedmeasuredreductionpercent value at this contract boundary.	—
generatedAt	string	Yes	Defines the generatedat value at this contract boundary.	format: date-time
graph	object	Yes	Defines the graph value at this contract boundary.	additionalProperties: false
graph.entityCount	integer	Yes	Defines the entitycount value at this contract boundary.	minimum: 0
graph.proofCount	integer	Yes	Defines the proofcount value at this contract boundary.	minimum: 0
graph.relationCount	integer	Yes	Defines the relationcount value at this contract boundary.	minimum: 0
graph.schemaVersion	string	Yes	Defines the schemaversion value at this contract boundary.	const: "workspace-knowledge-graph.v1"
graph.sourceArtifact	string	Yes	Defines the sourceartifact value at this contract boundary.	minLength: 1
graph.sourceHash	string	Yes	Defines the sourcehash value at this contract boundary.	pattern: ^[a-f0-9]{64}$
methodology	object	Yes	Defines the methodology value at this contract boundary.	additionalProperties: false
methodology.charsPerEstimatedToken	number	Yes	Defines the charsperestimatedtoken value at this contract boundary.	const: 4
methodology.claimBoundary	string	Yes	Defines the claimboundary value at this contract boundary.	minLength: 1
methodology.deterministic	boolean	Yes	Defines the deterministic value at this contract boundary.	const: true
methodology.id	string	Yes	Defines the id value at this contract boundary.	const: "multi-scenario-bounded-retrieval.v1"
methodology.networkRequired	boolean	Yes	Defines the networkrequired value at this contract boundary.	const: false
methodology.scenarioTargetPolicy	string	Yes	Defines the scenariotargetpolicy value at this contract boundary.	const: "evidence-backed-representative.v1"
retrievalSummary	object	Yes	Defines the retrievalsummary value at this contract boundary.	additionalProperties: false
retrievalSummary.matchedScenarioCount	integer	Yes	Defines the matchedscenariocount value at this contract boundary.	minimum: 0
retrievalSummary.medianEstimatedReductionPercent	number	Yes	Defines the medianestimatedreductionpercent value at this contract boundary.	minimum: 0 · maximum: 100
retrievalSummary.medianRetrievalEstimatedTokens	integer	Yes	Defines the medianretrievalestimatedtokens value at this contract boundary.	minimum: 0
retrievalSummary.p95RetrievalEstimatedTokens	integer	Yes	Defines the p95retrievalestimatedtokens value at this contract boundary.	minimum: 0
retrievalSummary.provenance	string	Yes	Defines the provenance value at this contract boundary.	const: "estimated"
retrievalSummary.scenarioCount	integer	Yes	Defines the scenariocount value at this contract boundary.	minimum: 1
retrievalSummary.status	enum	Yes	Defines the status value at this contract boundary.	enum: passed, partial, unavailable
scenarios	array	Yes	Defines the scenarios value at this contract boundary.	minItems: 1
schemaVersion	string	Yes	Defines the schemaversion value at this contract boundary.	const: "workspace-intelligence-benchmark.v1"
suite	object	Yes	Defines the suite value at this contract boundary.	additionalProperties: false
suite.id	string	Yes	Defines the id value at this contract boundary.	const: "agent-core.v1"
suite.title	string	Yes	Defines the title value at this contract boundary.	minLength: 1
suite.version	number	Yes	Defines the version value at this contract boundary.	const: 1
workspace	object	Yes	Defines the workspace value at this contract boundary.	additionalProperties: false
workspace.name	string	Yes	Defines the name value at this contract boundary.	minLength: 1
workspace.path	string	Yes	Defines the path value at this contract boundary.	minLength: 1

Canonical machine-readable definition

The raw synchronized contract remains authoritative. The educational sections above are projections of this definition.

Show raw JSON

{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://workspai.dev/schemas/workspace-intelligence/workspace-intelligence-benchmark.v1.json",
  "title": "Workspai Workspace Intelligence Benchmark",
  "description": "A deterministic multi-scenario retrieval benchmark with an optional, separately classified evaluation measurement. Estimated retrieval reduction is never represented as measured model savings.",
  "type": "object",
  "required": [
    "schemaVersion",
    "generatedAt",
    "workspace",
    "suite",
    "graph",
    "methodology",
    "corpus",
    "scenarios",
    "retrievalSummary",
    "evaluation"
  ],
  "properties": {
    "schemaVersion": {
      "const": "workspace-intelligence-benchmark.v1"
    },
    "generatedAt": {
      "type": "string",
      "format": "date-time"
    },
    "workspace": {
      "type": "object",
      "required": [
        "name",
        "path"
      ],
      "properties": {
        "name": {
          "type": "string",
          "minLength": 1
        },
        "path": {
          "type": "string",
          "minLength": 1
        }
      },
      "additionalProperties": false
    },
    "suite": {
      "type": "object",
      "required": [
        "id",
        "version",
        "title"
      ],
      "properties": {
        "id": {
          "const": "agent-core.v1"
        },
        "version": {
          "const": 1
        },
        "title": {
          "type": "string",
          "minLength": 1
        }
      },
      "additionalProperties": false
    },
    "graph": {
      "type": "object",
      "required": [
        "schemaVersion",
        "sourceArtifact",
        "sourceHash",
        "entityCount",
        "relationCount",
        "proofCount"
      ],
      "properties": {
        "schemaVersion": {
          "const": "workspace-knowledge-graph.v1"
        },
        "sourceArtifact": {
          "type": "string",
          "minLength": 1
        },
        "sourceHash": {
          "type": "string",
          "pattern": "^[a-f0-9]{64}$"
        },
        "entityCount": {
          "type": "integer",
          "minimum": 0
        },
        "relationCount": {
          "type": "integer",
          "minimum": 0
        },
        "proofCount": {
          "type": "integer",
          "minimum": 0
        }
      },
      "additionalProperties": false
    },
    "methodology": {
      "type": "object",
      "required": [
        "id",
        "charsPerEstimatedToken",
        "deterministic",
        "networkRequired",
        "scenarioTargetPolicy",
        "claimBoundary"
      ],
      "properties": {
        "id": {
          "const": "multi-scenario-bounded-retrieval.v1"
        },
        "charsPerEstimatedToken": {
          "const": 4
        },
        "deterministic": {
          "const": true
        },
        "networkRequired": {
          "const": false
        },
        "scenarioTargetPolicy": {
          "const": "evidence-backed-representative.v1"
        },
        "claimBoundary": {
          "type": "string",
          "minLength": 1
        }
      },
      "additionalProperties": false
    },
    "corpus": {
      "$ref": "#/$defs/corpus"
    },
    "scenarios": {
      "type": "array",
      "minItems": 1,
      "items": {
        "$ref": "#/$defs/scenario"
      }
    },
    "retrievalSummary": {
      "type": "object",
      "required": [
        "provenance",
        "scenarioCount",
        "matchedScenarioCount",
        "medianRetrievalEstimatedTokens",
        "p95RetrievalEstimatedTokens",
        "medianEstimatedReductionPercent",
        "status"
      ],
      "properties": {
        "provenance": {
          "const": "estimated"
        },
        "scenarioCount": {
          "type": "integer",
          "minimum": 1
        },
        "matchedScenarioCount": {
          "type": "integer",
          "minimum": 0
        },
        "medianRetrievalEstimatedTokens": {
          "type": "integer",
          "minimum": 0
        },
        "p95RetrievalEstimatedTokens": {
          "type": "integer",
          "minimum": 0
        },
        "medianEstimatedReductionPercent": {
          "type": "number",
          "minimum": 0,
          "maximum": 100
        },
        "status": {
          "enum": [
            "passed",
            "partial",
            "unavailable"
          ]
        }
      },
      "additionalProperties": false
    },
    "evaluation": {
      "type": "object",
      "required": [
        "availability",
        "provenance",
        "trustedMeasuredReductionPercent",
        "claimBoundary"
      ],
      "properties": {
        "availability": {
          "enum": [
            "available",
            "unavailable"
          ]
        },
        "provenance": {
          "enum": [
            "measured",
            "mixed",
            "estimated",
            "unavailable"
          ]
        },
        "current": {
          "$ref": "#/$defs/currentEvaluation"
        },
        "comparison": {
          "$ref": "workspace-intelligence-evaluation-comparison.v1.json"
        },
        "trustedMeasuredReductionPercent": {
          "type": [
            "number",
            "null"
          ]
        },
        "claimBoundary": {
          "type": "string",
          "minLength": 1
        }
      },
      "additionalProperties": false
    }
  },
  "additionalProperties": false,
  "$defs": {
    "corpus": {
      "type": "object",
      "required": [
        "artifactCount",
        "characterCount",
        "estimatedTokens",
        "unreadableArtifacts"
      ],
      "properties": {
        "artifactCount": {
          "type": "integer",
          "minimum": 0
        },
        "characterCount": {
          "type": "integer",
          "minimum": 0
        },
        "estimatedTokens": {
          "type": "integer",
          "minimum": 0
        },
        "unreadableArtifacts": {
          "type": "array",
          "items": {
            "type": "string"
          },
          "uniqueItems": true
        }
      },
      "additionalProperties": false
    },
    "scenario": {
      "type": "object",
      "required": [
        "id",
        "title",
        "query",
        "queryOrigin",
        "targetEntityId",
        "targetKind",
        "targetRetrieved",
        "result",
        "matchCount",
        "truncated",
        "retrievalCharacterCount",
        "retrievalEstimatedTokens",
        "estimatedTokensAvoided",
        "estimatedReductionPercent"
      ],
      "properties": {
        "id": {
          "type": "string",
          "minLength": 1
        },
        "title": {
          "type": "string",
          "minLength": 1
        },
        "query": {
          "type": "string",
          "minLength": 1
        },
        "queryOrigin": {
          "const": "graph-derived"
        },
        "targetEntityId": {
          "type": "string",
          "minLength": 1
        },
        "targetKind": {
          "type": "string",
          "minLength": 1
        },
        "targetRetrieved": {
          "type": "boolean"
        },
        "result": {
          "enum": [
            "matched",
            "empty"
          ]
        },
        "matchCount": {
          "type": "integer",
          "minimum": 0,
          "maximum": 100
        },
        "truncated": {
          "type": "boolean"
        },
        "retrievalCharacterCount": {
          "type": "integer",
          "minimum": 0
        },
        "retrievalEstimatedTokens": {
          "type": "integer",
          "minimum": 0
        },
        "estimatedTokensAvoided": {
          "type": "integer",
          "minimum": 0
        },
        "estimatedReductionPercent": {
          "type": "number",
          "minimum": 0,
          "maximum": 100
        }
      },
      "additionalProperties": false
    },
    "currentEvaluation": {
      "type": "object",
      "required": [
        "runId",
        "taskId",
        "strategy",
        "status",
        "summary"
      ],
      "properties": {
        "runId": {
          "type": "string",
          "minLength": 1
        },
        "taskId": {
          "type": "string",
          "minLength": 1
        },
        "strategy": {
          "enum": [
            "full-corpus",
            "grep",
            "vector",
            "graph",
            "workspace-intelligence",
            "custom"
          ]
        },
        "status": {
          "enum": [
            "live",
            "completed",
            "aborted"
          ]
        },
        "summary": {
          "$ref": "workspace-intelligence-evaluation.v1.json#/properties/summary"
        }
      },
      "additionalProperties": false
    }
  }
}