Commands
Core
Evaluators
Dataset
Templates
Experiment
Versions
Step-type
Evaluator-type
Step
Details
eigenpal workflow list|ls [options]
List workflows the caller can read.
Options
eigenpal workflow pull [options] <workflow-id>
Download the YAML definition of the workflow at its current version.
Arguments
Options
eigenpal workflow schema [options] <workflow-id>
Show the inferred output schema for a workflow (what it returns).
Arguments
Options
eigenpal workflow push [options]
Create or update a workflow from a YAML file.
Options
eigenpal workflow move [options] <workflow-id>
Move a workflow to a folder path, creating folders as needed
Arguments
Options
eigenpal workflow validate [options] [path]
Local-only validation. Without [path]: runs the templated three-way check (./workflow.yaml + ./evaluators.yaml + ./dataset/) in the project root. When the root has no workflow.yaml, discovers nested projects under eigenpal/workflows/<slug>/ or workflows/<slug>/ and validates each. With [path] pointing at a YAML file: validates that workflow.yaml only. For per-noun targeting use evaluators validate or dataset validate.
Arguments
Options
eigenpal workflow clear-local [options] [examples...]
Delete local execution artifacts under ./dataset/examples/. Keeps the latest run per example by default.
Arguments
Options
eigenpal workflow evaluators pull [options] <workflow-id>
Download the workflow’s evaluators YAML.
Arguments
Options
eigenpal workflow evaluators push [options] <workflow-id>
Overwrite the workflow’s evaluator config from a YAML file.
Arguments
Options
eigenpal workflow evaluators validate [options] [path]
Validate an evaluators YAML file against the EvalConfig schema. Defaults to ./evaluators.yaml.
Arguments
eigenpal workflow dataset list|ls [options] <workflow-id>
List eval examples for the workflow.
Arguments
Options
eigenpal workflow dataset pull [options] <workflow-id>
Download the workflow’s dataset as a ZIP archive.
Arguments
Options
eigenpal workflow dataset push [options] <workflow-id>
Replace or extend the workflow’s dataset from a ZIP or folder.
Arguments
Options
eigenpal workflow dataset example create [options] <workflow-id>
Create one eval example without re-uploading the dataset.
Arguments
Options
eigenpal workflow dataset example update [options] <workflow-id> <exampleId>
Patch one eval example. Omitted flags are left alone.
Arguments
Options
eigenpal workflow dataset example delete [options] <workflow-id> <exampleId>
Delete one eval example by id. Non-TTY shells require —yes.
Arguments
Options
eigenpal workflow dataset example get [options] <workflow-id> <exampleId>
Fetch one eval example with full triggerInput, expectedOutput, and metadata.
Arguments
Options
eigenpal workflow dataset validate [options] [path]
Validate a dataset folder against the examples/<name>/{input,expected,meta} convention. Defaults to ./dataset/.
Arguments
eigenpal workflow templates upload [options] <file>
Upload a DOCX or XLSX file as a new tmpl*… resource with an immutable tmpr*… revision.
Arguments
Options
eigenpal workflow templates list|ls [options]
List workspace templates.
Options
eigenpal workflow templates get|inspect [options] <template-id>
Inspect a tmpl*… resource: current tmpr*…, format, checksum, tokens, grammar.
Arguments
Options
eigenpal workflow templates download [options] <template-id>
Download current (or pinned) template bytes.
Arguments
Options
eigenpal workflow templates replace [options] <template-id> <file>
Append an immutable revision and advance the tmpl_… pointer.
Arguments
Options
eigenpal workflow templates delete [options] <template-id>
Delete the mutable tmpl*… pointer. Pinned tmpr*… revisions remain so workflows that set templateRevisionId still run.
Arguments
Options
eigenpal workflow templates smoke [options] <template>
Fill a local Office file or a tmpl_… resource with a JSON fixture and write the result. Local files never contact the server.
Arguments
Options
eigenpal workflow experiment|exp list|ls [options] <workflow-id>
List executions for the workflow, newest first.
Arguments
Options
eigenpal workflow experiment|exp run [options] <workflow-id>
Start a batch eval against the workflow’s dataset.
Arguments
Options
eigenpal workflow experiment|exp status [options] <workflow-id> <batchId>
Aggregate progress for a batch by batchId.
Arguments
Options
eigenpal workflow experiment|exp cancel [options] <workflow-id> <batchId>
Cancel every execution in a batch. Idempotent.
Arguments
Options
eigenpal workflow experiment|exp results [options] <workflow-id> [batchId]
Download eval results in CSV or JSON.
Arguments
Options
eigenpal workflow experiment|exp compare|diff [options] <batchIdA> <batchIdB>
Compare evaluator scores or actual outputs between two experiment batches.
Arguments
Options
eigenpal workflow experiment|exp watch [options] <workflow-id> <batchId>
Poll until terminal, then auto-pull results, replaces status --watch + results --out.
Arguments
Options
eigenpal workflow versions list|ls [options] <workflow-id>
List tagged workflow versions plus the current untagged snapshot when HEAD is untagged, newest first.
Arguments
Options
eigenpal workflow versions create [options] <workflow-id>
Create a tagged workflow version from YAML or by copying an existing snapshot.
Arguments
Options
eigenpal workflow versions promote [options] <workflow-id> <versionId>
Make an existing tagged workflow version current without creating another snapshot.
Arguments
Options
eigenpal workflow versions restore [options] <workflow-id> <versionId>
Restore a previous snapshot as a new untagged current version. Does not retag the source.
Arguments
Options
eigenpal workflow step-type list|ls [options]
List every step type the deployment supports.
Options
eigenpal workflow step-type get [options] <type>
Return the full schema and behavioral docs for one step type.
Arguments
Options
eigenpal workflow evaluator-type list|ls [options]
List every evaluator type with a one-line description.
Options
eigenpal workflow evaluator-type get [options] <type>
Fetch the JSON Schema for one evaluator type. Pipe through jq to inspect specific fields.
Arguments
Options
eigenpal workflow step exec [options] <type>
DISABLED, local mimic runners removed pending server-side redesign (EIG-104). Use run or workflow experiment run instead.