Skip to content

Add AI-powered release notes reviewer GitHub Action#23174

Open
ebembi-crdb wants to merge 1 commit intomainfrom
ai/release-notes-reviewer
Open

Add AI-powered release notes reviewer GitHub Action#23174
ebembi-crdb wants to merge 1 commit intomainfrom
ai/release-notes-reviewer

Conversation

@ebembi-crdb
Copy link
Copy Markdown
Contributor

Summary

  • Adds a GitHub Action that automatically reviews PRs touching release notes files (releases.yml or _includes/releases/**)
  • Extracts core reviewer logic from cockroach-education-ai-initiatives into .github/scripts/release_review/ — no running service required
  • Runs three checks: schema/format validation (HIGH), technical accuracy (HIGH), and GPT-4o content quality (MEDIUM)
  • Posts results as a neutral (advisory) check run and an updatable PR comment — never blocks merge

Setup required

Add OPENAI_API_KEY as a repository secret: Settings → Secrets and variables → Actions → New repository secret

GITHUB_TOKEN is provided automatically with the pull-requests: write and checks: write permissions declared in the workflow.

Test plan

  • Open a test PR to main that modifies src/current/_data/releases.yml or a file under src/current/_includes/releases/ and confirm the "Release Notes AI Review" workflow appears in the Checks tab
  • Confirm a PR comment is posted containing the <!-- docs-fast-agent-comment --> marker
  • Confirm the check run shows neutral conclusion (not blocking)
  • Open a PR that does not touch those paths and confirm the workflow does not run

Introduces a GitHub Action that automatically reviews PRs touching
release notes files using schema validation, technical accuracy checks,
and OpenAI GPT-4o content quality analysis.

- Copies core reviewer logic into .github/scripts/release_review/
- Adds standalone runner script (.github/scripts/run_release_review.py)
- Adds workflow that triggers on PRs to main touching releases.yml or
  _includes/releases/**
- Posts results as a neutral (advisory) check run and updatable PR comment
- Never blocks merge; requires OPENAI_API_KEY repository secret
@ebembi-crdb ebembi-crdb requested a review from a team as a code owner April 8, 2026 12:05
@netlify
Copy link
Copy Markdown

netlify bot commented Apr 8, 2026

Deploy Preview for cockroachdb-interactivetutorials-docs canceled.

Name Link
🔨 Latest commit 684bb95
🔍 Latest deploy log https://app.netlify.com/projects/cockroachdb-interactivetutorials-docs/deploys/69d644a02c09f900081a7e66

@netlify
Copy link
Copy Markdown

netlify bot commented Apr 8, 2026

Deploy Preview for cockroachdb-api-docs canceled.

Name Link
🔨 Latest commit 684bb95
🔍 Latest deploy log https://app.netlify.com/projects/cockroachdb-api-docs/deploys/69d644a02c09f900081a7e6a

@github-actions
Copy link
Copy Markdown

github-actions bot commented Apr 8, 2026

Files changed:

  • .github/scripts/release_review/__init__.py
  • .github/scripts/release_review/config.py
  • .github/scripts/release_review/github_client.py
  • .github/scripts/release_review/reporter.py
  • .github/scripts/release_review/reviewer.py
  • .github/scripts/release_review/schemas.py
  • .github/scripts/run_release_review.py
  • .github/workflows/release-notes-review.yml

@netlify
Copy link
Copy Markdown

netlify bot commented Apr 8, 2026

Deploy Preview for cockroachdb-docs canceled.

Name Link
🔨 Latest commit 684bb95
🔍 Latest deploy log https://app.netlify.com/projects/cockroachdb-docs/deploys/69d644a07d805b00086a45d7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant