FIELD GUIDE

Ellipsis Code Review: Define Repository Agents Without Handing Them Merge Authority

Editorial cutoff: October 25, 2026. Ellipsis is not simply an AI bot that leaves comments. Its documentation defines review workflows as repository configuration: each reviewer has a prompt, model, environment and budget, and the

Ellipsis is not simply an AI bot that leaves comments. Its documentation defines review workflows as repository configuration: each reviewer has a prompt, model, environment and budget, and the combined result can be published as a GitHub review.

What the evidence actually establishes

The documented code_review configuration is placed in a repository or an organization-wide settings repository. A push can start reviewers matching configured paths, which then report potential issues and may mark comments blocking or non-blocking. Output behavior can be silent, a comment, an approval or request changes according to configuration and GitHub constraints. Ellipsis also offers sessions, scoped environments, secrets and triggerable agents. Those capabilities expand the security surface beyond a passive pull-request summary.

How a development team should use or migrate it

Before enabling it organization-wide, select one low-risk repository and an intentionally narrow reviewer: inspect missing null handling in changed API routes, but do not change code. Set a budget cap, path filter and explicit review output policy. Test a known-defect PR and a clean PR with the same harness; manually label true positives, false positives and missed issues. Measure acceptance separately from detection accuracy, because a suggestion that developers accept may still be wrong. Keep the GitHub branch-protection rule independent of generated recommendations.

A realistic engineering example

One practical review policy uses separate reviewer roles. A correctness reviewer examines changed request handlers for unhandled errors; a privacy reviewer examines only files in authentication and logging directories; a documentation reviewer verifies that public API changes have release notes. Give each a narrow prompt and measurable output, not a vague instruction to improve code quality. In a staging pull request, include one deliberate true defect and one intentional pattern that should be allowed, then audit comments with human reviewers. A successful result is not “the agent approved the PR”; it is a reproducible evidence trail showing which findings were sound, which were noise and which guardrails prevented unwanted actions.

Security, licensing and production limits

The docs describe read-scoped tokens for reviewers while the platform posts review output; understand that comments and configured approval states may influence automation even without write access to repository contents. YAML from a pull request, test fixtures and source comments are untrusted context. Protect secrets injected into hosted environments, disallow unreviewed workflow changes, and distinguish logs and telemetry kept after an agent session from source checkout retention claims.

Who should choose it and what to compare

Ellipsis is well suited to teams that already manage policy as code and want programmable review specialization. Simpler teams may prefer Graphite, CodeRabbit or GitHub Copilot’s review interfaces. Choose on documented deployment and permission control, not unverified bug-catch rate claims.

Decision checklist

  • Which GitHub App scopes are granted?
  • Can a reviewer mark a PR approved without a human?
  • What is the per-session budget and expiration policy?
  • Where are logs and credentials retained?

Sources & Further Reading

CONTINUE EXPLORINGExplore related files ↗