Upgrade
- Read the release notes and migration requirements.
- Pin compatible app, worker and sandbox artifacts to the release.
- Run the Helm upgrade and confirm the migration Job succeeds.
- Check login and run a workflow using storage and a model provider.
Keep maintenance running
Setsecrets.cron.existingSecret to a Secret containing CRON_SECRET. The chart requires that credential while maintenance is enabled. If you supply your own authenticated scheduler, explicitly set maintenance.enabled: false. Single-node installations run a supervised maintenance loop.
Collect JSON logs from stdout and retain audit records (log_type: audit). Configure Prometheus metrics and your tracing collector as needed.
Troubleshoot
Single-node storage selection
Single-node storage selection
Set
EIGENPAL_SINGLE_NODE_STORAGE_BACKEND=external when using an external S3-compatible bucket, including AWS S3 without a custom endpoint. Supply the bucket, region and credentials or supported workload identity. A fresh evaluation installation defaults to embedded storage.The container persists the choice. Switching backends requires an offline data migration and explicit confirmation through the stored backend marker. Supplying external storage settings without selecting a backend fails startup instead of silently using local storage.Pods or provider connections fail
Pods or provider connections fail
Check the first configuration-validation error, unresolved YAML placeholders, Secret keys and mounted paths. Test database, storage and provider connectivity from both app and worker.For internal CA trust, set one of
trustedCA.secretName or trustedCA.configMapName, plus the PEM entry’s key. Restart pods after CA rotation. Keep TLS verification enabled.Uploads fail or run out of space
Uploads fail or run out of space
Check ingress limits, direct-transfer settings, multipart/archive limits, browser storage origins and bucket CORS. For growing storage usage, confirm housekeeping succeeds and review retention settings.
Workers are slow or unhealthy
Workers are slow or unhealthy
Size replicas and
worker.concurrency against database pools, provider rate limits and storage capacity. Outbound webhook delivery has its own pool.The health thread checks the main-thread heartbeat. Script and template limits are clamped to the liveness budget; increasing a script timeout alone cannot extend execution indefinitely. Use the worker reference to inspect limits and units.Sandboxes, promotion or webhooks fail
Sandboxes, promotion or webhooks fail
For agents, check filesystem opt-in, the sandbox flag and backend credentials. Builder sessions require E2B even with remote inference.For promotion, read the pause reason in Environments. Check rollout intent, required local connections and closed Git requests.For outbound webhooks, use an endpoint reachable from the worker. Private destinations require the single-tenant delivery policy; loopback, link-local and metadata addresses remain blocked.
Origins, telemetry and tracing
Origins, telemetry and tracing
Preserve forwarded host information through proxies. Add allowed browser origins through
EIGENPAL_TRUSTED_ORIGINS when needed. Storage origins and bucket CORS have separate controls.EIGENPAL_TELEMETRY_ENABLED controls product telemetry. OTEL_ENABLED and OTEL_EXPORTER_OTLP_* configure tracing. Neither replaces audit-log retention.