Skip to content

For the complete documentation index, see llms.txt.

Understand findings

A finding is the unit of output the Friction Analyzer produces: a specific instruction failure, backed by evidence from real sessions. This page describes how findings are produced and what a finding object contains.

The Friction Analyzer (identifier friction_analyzer, version 0.0.25) analyzes one parent session per run, reading the raw session rather than a summary. It dispatches investigators across the session; each investigator reads only the ranges it cites and either creates a new finding or refines an existing one. Evidence is append-only: when new evidence establishes negative impact, an investigator promotes a finding from low to high confidence rather than rewriting its history. Findings accumulate across runs, so a recurring failure gathers more evidence over time.

An investigator authors these fields on a finding:

FieldTypeDescription
titlestringA short statement of the instruction failure.
severitylow, medium, high, criticalHow serious the failure is.
confidencelow or highHow well the evidence supports the finding. There are only these two levels.
evidencelist (at least one)Supporting occurrences, each a digest_range and an occurrence_summary. Ranges are unique.
summarystringWhat the finding is.
impactstringWhy it matters.
instruction_failurestringThe underlying instruction failure the evidence points to.
notesstringAdditional context.

When a finding is read back for reconciliation, it also carries an id, a version for optimistic concurrency, an evidence_count, up to three latest_evidence summaries, and a github_status with an optional github_issue_url.

A digest_range cites a range of the session digest the analyzer built for the run — a location within that digest, not the SHA-256 digest used to verify trace integrity elsewhere.

The worker never creates GitHub issues itself. It sends each finding as a mutation to the hosted Promptless Runtime, which projects the finding to a GitHub issue on the Runtime side. The projected issue reflects the finding — its title, summary, impact, instruction_failure, and cited evidence. The finding’s github_status and github_issue_url track that projection, so you can see whether an issue exists and open it. From there, high-confidence findings can move into remediation — see Remediate findings.