docs(agent-eval): Outpost llms.txt in prompt and default LLMS URL

[leggetter]

Summary

Aligns the onboarding agent prompt template with the live Hookdeck Outpost documentation index (/docs/outpost/llms.txt), keeps eval harness defaults consistent, and hardens the Docs agent eval (CI slice) live Outpost step.

Changes

Prompt & eval harness

• hookdeck-outpost-agent-prompt.md: Documentation bullet and {{LLMS_FULL_URL}} placeholder describe the plain-text llms.txt index (correct production URL); remove optional / eval-runner wording from the template copy.
• run-agent-eval.ts: Default {{LLMS_FULL_URL}} to ${EVAL_DOCS_URL}/llms.txt (or production); always include the documentation-index line in local-docs mode; remove line-stripping when env was unset.
• .env.example, fixtures/placeholder-values-for-turn0.md: Match the above.

CI (docs-agent-eval-ci + execute-ci-artifacts)

• Concurrency on the eval job so only one workflow at a time mutates the shared CI Outpost project during execution.
• OUTPOST_CI_CLEANUP_TENANT: delete the fixture tenant before scripts and again on EXIT so destination limits do not break repeated runs.
• GET /configs: when managed config returns 200, require TOPICS to be empty, include *, or include OUTPOST_CI_PUBLISH_TOPIC (default user.created); otherwise fail fast with a clear message. Skips on non-200 or OUTPOST_SKIP_MANAGED_TOPICS_VERIFY=1.
• README.md: documents the above.

Related

• Website: /docs/outpost/llms.txt (hookdeck/website) serves the index the prompt points to.

[Copilot]

Pull request overview

Aligns the Outpost agent onboarding prompt and agent-eval harness defaults with the live Outpost documentation index at /docs/outpost/llms.txt, so the prompt and evaluator consistently point agents to the same docs entrypoint.

Changes:

• Update the agent prompt template to reference the llms.txt documentation index (instead of an optional “full bundle” URL).
• Make the eval runner default {{LLMS_FULL_URL}} to ${EVAL_DOCS_URL}/llms.txt (or production) and always include the docs-index line in local-docs mode.
• Update .env.example and placeholder fixtures to match the new llms.txt behavior/URL.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File	Description
docs/agent-evaluation/src/run-agent-eval.ts	Defaults LLMS_FULL_URL to docsUrl/llms.txt, always emits the docs-index line in local-docs mode, removes prior conditional line stripping.
docs/agent-evaluation/hookdeck-outpost-agent-prompt.md	Rewords the docs reference to point at llms.txt as the documentation index.
docs/agent-evaluation/fixtures/placeholder-values-for-turn0.md	Updates example placeholder value for {{LLMS_FULL_URL}} to the llms.txt URL.
docs/agent-evaluation/.env.example	Documents EVAL_LLMS_FULL_URL defaulting behavior (append /llms.txt).

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.