HugoScore hugoscore.org

HugoScore review rubric, draft v1.3

Status: Provisional editorial method, pending a second read of the revised sections by GPT-6 Astra and publication. Third revision October 30, 2026 applies the boundary-case calibration (research/v1-3-reviews/BOUNDARY-CASES-2026-10-30.md (project record, not published)), fixes F1 to F27, and Hugo's October 30 answers on D7 symmetry and the gauge. The adopted decisions are recorded in audits/scoring-method-decisions-2026-10-18.md. No published profile has been scored under v1.3 yet. Legacy numbers remain pre-method editorial placements until re-derived. Prepared: v1.2 on September 7, 2026. v1.3 first revision on October 18, 2026. v1.3 third revision on October 30, 2026 by Claude Opus 5.5. v1.3 second revision on October 18, after GPT-6 Astra's cold review (project record, not published) and Hugo's adjudication. Revision: v1.3 adopts the v1.2 control anchors unchanged. It makes agency posture the leading finding (section 1), adds a frozen review object with a role record (section 2A), limits the control axis to patient-set-purpose functions with direct patient participation (section 2), adds a transparency gate with full evidence states (section 3A), requires protocol-complete interaction before a single position is published and separates evidence coverage from review status (section 8), and adds two constraint types with step-by-step tests (section 7). The v1.2 text is preserved verbatim in research/rubric-v1-3-draft/rubric-v1.2.md (project record, not published). Authoring provenance: v1.0 to v1.2 drafted by OpenAI Codex / GPT-6. v1.3 drafted by Claude Fable 5.1 from Hugo Campos's stated decisions of October 18, 2026, revised after GPT-6 Astra's independent review of the same date. No independent reviewer agreement study completed.

1. What this rubric measures

Start with: Who does this AI serve in this particular use?

The assessment gives primary weight to two judgments:

  1. Who the tool answers to: who sets its substantive goals, can change its direction and decides what to do with its help, especially when the patient's priorities conflict with those of a clinician, institution, vendor or founder.
  2. What it does to patient agency: whether it expands the patient's ability to understand, question, compare, decide and act on their own terms, or channels them toward a predetermined outcome.

A powerful model that answers to the patient can expand agency by making reasoning, explanation, preparation and advocacy available on the patient's terms. Its practical capability matters when the review can show what that enables. Owning the servers is not required. A vendor-hosted frontier model can merit the strongest patient-direction finding. An open-source or locally hosted tool can still impose someone else's agenda.

Here, answers to the patient means supporting the patient's authorship and informed judgment. It includes challenging an assumption, explaining uncertainty and offering alternatives. It does not mean agreeing with every assertion or complying with every request.

Hosting, data practices, portability, price and founder identity are supporting evidence. They influence the primary judgments when a concrete mechanism affects the patient's authority or practical freedom. They do not receive independent points. Effective control of the entire assessed AI workflow distinguishes the 100 endpoint from patient-directed hosted assistance at 90, after purpose and use authority have been established. Record consequential privacy and rights concerns prominently even when they do not change who directs the task.

Transparency is an editorial eligibility standard for the control axis, not a supporting fact and not a measurement. HugoScore withholds a numerical control position when a tool does not meet the disclosure standard in section 3A. The section 3 control classification is still stated in prose for such a tool, including an adverse one. The standard exists because a patient who cannot learn who runs a tool, from the tool, cannot judge whose interests it serves on informed terms.

The agency posture leads. Every profile and every listing shows the section 7 posture first: expands, constrains, mixed, potentially agency-expanding or unclear. The control position follows it, as evidence for how the posture arose, because institutional direction is the main mechanism by which patient agency is constrained. Evidence coverage and review status are shown separately from both. A 100 control finding alone does not establish effective liberation, and a 90 can coexist with a mixed posture. The old six-band formula remains withdrawn.

The existing framework (project record, not published) distinguishes the direction axis from agency posture. The CAIHL commentary provides the foundation of critical reflection, strategic action and questioning institutional priorities. The operational rules below are HugoScore proposals, not a validated measurement instrument.

2. Freeze the object and evidence before rating

Record product, operator, function, deployment, primary user, affected patient population, access tier, jurisdiction when relevant, version and cutoff date. Identify who pays and who receives outputs or insights. Payment alone does not establish whose goals prevail.

Apply the existing three scope gates: AI, health relevance and a concrete patient-impact pathway. Each is coded Y, N or U. Any U leaves the profile at "directory scope unresolved," with no gate, control or posture result computed. (Astra second read, K2) Identify the model-mediated judgment, estimate, ranking, classification, prediction or recommendation in the assessed function. Deterministic export, storage, formatting and interoperability do not clear the AI gate on their own. Being built with AI, callable by an agent or useful as input to a later AI does not make the standalone utility eligible.

A mixed product can qualify through a named AI function. A combined agent-and-utility workflow may qualify if the model's role and patient-impact pathway are documented, but assess that defined workflow rather than transferring its AI status to every component.

Control-axis scope (v1.3, decisions D3 and D5). The three gates decide directory scope. Two further conditions decide whether a tool may receive a control position. They are editorial scope choices for the numerical axis. They do not assert that patients lack authority over tools outside it.

(a) Direct participation. The patient's own real-time input or response is part of the assessed AI interaction, whoever operates the device, personally or through assistance they authorize: a care partner who types at the patient's direction, assistive input, or an authorized proxy using a portal on the patient's behalf. Record separately who operates the interface, whose information is processed, and whose purpose and consent govern the task. These recording fields inform the prose control finding. They do not decide (a). (F8) An authorized assistant acting on the patient's instructions is direct participation. Someone acting over the patient's stated wishes is not. Receiving an output produced in a clinician-operated workflow, such as an ambient visit summary, is not participation.

(b) Patient-set purpose. The assessed function is one in which the patient can state a purpose for the interaction and the tool can be redirected and questioned within it. Conversational assistants, record-grounded question answering and drafting tools qualify. Live interpretation, record connectors and fixed-question intake do not, because their task is fidelity or transport rather than a purpose the patient sets. They are assessed for agency effect (section 7) and the supporting measures (section 6), with no control position. Judge (b) by function, not format: adaptive AI intake, triage or symptom assessment whose output type the operator fixes fails (b) unless the patient can state a different purpose and the tool pursues it. (F8) Drafting tools qualify under D5 even when the document type is fixed, such as an appeal letter, because the patient chooses the purpose the document serves and the tool pursues it. A fixed document type is a rail coded under C1 and C2, not a scope failure. The difference from intake and triage is whose purpose the output serves: in a drafting tool the patient's chosen purpose, in intake or triage the operator's. (F29)

Code (a) and (b) as Y, N or U with evidence, like C1 to C4. If (b) is U at documentary coverage, the profile reads "control axis scope unresolved pending sessions" and shows no candidate set. If a tool fails both (a) and (b), use the label "clinician-operated." (F8)

Tools that clear the three gates but not (a) or (b) remain in the directory with a full profile, an agency posture, a prose control finding (always written, saying when evidence is thin), the transparency gate result shown as a disclosure finding (section 3A), and the label "control axis not applicable: clinician-operated" or "control axis not applicable: no patient-set purpose." Earlier numbers are preserved as historicalAxisPosition. Refusal, correction and binding-remedy findings for these tools are recorded prominently in the supporting measures, because a patient can hold real authority over a system they never operate.

Worked eligibility examples: an ambient clinical scribe fails (a). A live AI interpreter between patient and clinician meets (a) and fails (b). A proxy using a patient portal assistant with the patient's authorization meets both. A deterministic record connector fails the AI gate before (b) applies and is out of scope as a standalone utility, reason no-ai. A connector whose own function clears the AI gate fails (b). Either way, the connector and a chosen assistant are reviewed together as one composed configuration under section 2A, and the assistant alone may have its own profile. (F23) A fixed-question intake form with no free conversation fails (b). A patient-facing portal assistant answering free questions inside a health system meets both, with its boundary frozen under section 2A before any code is applied.

MyChart Takeout's standalone exporter is the worked boundary case. Its current README explicitly describes deterministic export without a language model. The proposed scope outcome is out of scope, reason no-ai. Its patient-agency value does not establish AI eligibility. See the scope reassessment (project record, not published). Non-AI resources may be listed separately without an AI axis score if Hugo later chooses to maintain such a section. They must not serve as scoring anchors for AI tools. This draft does not remove the existing public profile.

Separate materially different deployments, such as public self-directed chat, employer benefits chat and clinician use. Also separate access tiers whose AI-gate status differs. Do not average them into a single brand score. If deployment cannot be resolved, publish a descriptive profile with an unresolved axis.

When a supplier's AI function is deployed by several institutions, deployments differ materially when enabled functions, onward actions, data scope or operating rules differ. A posture is shown only with the reviewed deployment named, on the card and the profile. The profile lists other known deployments as not reviewed and names any separated sibling functions with their review status. A vendor-default deployment is a valid review object when no specific deployment is documented, with every deployer-dependent finding marked as such. (F14)

Create an evidence record for every deciding fact:

FieldRequired content
ClaimOne bounded assertion, such as the user can export a conversation.
SourceURL or repository path, section, version or date, and access date.
Evidence typeProduct claim, specific policy commitment, documented workflow, direct observation, source inspection, or independent study.
SupportWhat the source establishes, and what it does not.
StatusSupported, contradicted, unknown, not researched, or not applicable.
ApplicabilityExact function, deployment and population covered.
Deciding questionThe primary or supporting rubric question this evidence answers.
Access modeRaw text, rendered page, or fetch-tool summary. A deciding claim resting only on a fetch-tool summary is low confidence and must be read directly before adjudication. (F21)

Claims about actual outcomes require outcome evidence. Documentation can establish a published commitment or intended workflow, not prove that it always operates as described. Source inspection must identify the inspected version and cannot automatically establish the behavior of a hosted build.

Current, specific documentation by the operator or supplier can provisionally support a documentary finding at medium confidence. It cannot corroborate another statement by the same party. Corroboration requires observation or an independent source. For a deployed function, the deployer's patient-facing documentation defines the stated boundary, and supplier statements that contradict it are recorded as contradictory use examples. Executive blog posts and interviews are product claims, recorded with author and date. A stated intended use in terms or marketing is a documented interest. It establishes an imposed objective only when a mechanism in the assessed function enforces it. Announced, undeployed features are never coded. They are listed under unknowns and set a refresh trigger. (F16, F25, F26)

Record a published commitment separately from observed operation. A finding may be provisionally supported by current, specific policy and workflow documentation. Label it documentary and retain its operational uncertainty. Generic marketing, a compliance badge or an email address alone cannot establish practical control.

2A. Freeze the review object

Before any gate or code is applied, write a boundary record and do not change it during the review:

An enterprise or institutional setting is a reason to investigate who sets the purpose. It is not the answer. Evidence of an imposed objective is required before taking the external-purpose route in section 5A.

3. Primary judgment: who controls the tool's purpose?

Assess the particular task and deployment. Code the following questions Y, N or U, with evidence for each. Y requires affirmative support, N requires a demonstrated limit, and U covers missing, untested or contradictory evidence. Keep not researched distinct in the evidence record. Missing information is not a negative fact.

QuestionWhat to establish
C1. Set the goalCan the patient define the substantive question and desired help within the tool's stated subject, rather than merely provide inputs for an externally fixed outcome? Desired help includes the type of output. If the operator fixes the output type and the patient supplies only facts, C1 is N unless the patient can request a different kind of help on the same subject. When the patient chose the tool for that kind of output, as with a drafting tool chosen for its document, the fixed type alone does not make C1 N. C1 then asks whether the patient decides the document's substance: what it argues, claims and asks for (reconciles F17 with F29). The subject is taken from the frozen review object, not the operator's marketing. (F17)
C2. Change directionCan the patient revise the goal, reject a proposed path and pursue a meaningful alternative? A different tone or presentation does not establish a different goal.
C3. Question the agendaCan the patient examine assumptions, incentives and alternatives, including those inconvenient to the operator, sponsor or care institution?
C4. Decide and useCan the patient decide whether and how to act on the output, including seeking another opinion or using it to advocate for themselves? Identify any relevant restrictions or actions taken without their decision.

Also record whose purpose prevails when goals conflict. Sources include applicable product rules, documented behavior and bounded interaction tests. A friendly tone, free signup or patient-facing interface does not answer this question.

Apply these decision rules:

A documented failure of a patient-control condition rules out an unqualified patient-directed finding, but does not by itself prove that another actor directs the whole task. Record the known authority and the constraint while resolving that distinction. This prevents an export limitation from being treated as proof of institutional control.

A patient may choose a narrow goal, including treatment adherence, weight management or emotional support. The question is whether the patient can question, revise or leave that goal, and whether alternatives remain available. Specialization alone is not steering. A founder's persona alone does not show whose agenda prevails.

Institutional and patient-directed AI are the two ends of one spectrum (decision H1, Hugo Campos, October 30, 2026). The control line is that spectrum. At the patient-directed end, the patient runs and controls the whole workflow, including the model (100, R = Y), which is rare. At the institutional end sits a tool, patient-facing or not, whose rails direct the patient toward a goal an institution set. Being patient-facing does not move a tool toward the patient end. Who deploys a tool is evidence about where it sits, not the answer. What places a patient-facing tool toward the institutional end is how tightly its rails channel the patient toward the institution's goal: a fixed kind of output (C1), no meaningful redirection (C2), an agenda that cannot be questioned (C3), restrictions on using the result (C4), or steering (section 7). Ordinary safety boundaries and refusal to invent facts are not institutional rails. The prose control classification names where the tool sits on this line and which rails put it there.

Assess authority over this AI task, not final authority over all medical care. A clinician's treatment decision does not make the patient's independent research institution-directed. Ordinary safety boundaries and refusal to invent facts do not establish an external agenda. Record the actual effects of a restriction before judging it.

3A. Transparency gate

The gate is an editorial eligibility standard for publishing a control position. It is not a deduction and not a finding about control. Apply it after the role record in section 2A exists.

TestWhat must be established
T1. Operator disclosed publiclyThe product's own site, terms or privacy policy names each service operator identified in the role record (each joint operator when there are several), by legal entity or by a trading name the role record maps to it.
T2. Model provider disclosed publiclyThe same sources name the model developer, or state that the model was developed by the operator or the application supplier. Where a workflow routes to several developers, the sources name each of them. A statement that routing occurs, or that unnamed "AI providers" are used, without naming the developers, is not found (F28, applying D2). Inference host identity is recorded but not required. "Our models," or naming the owner of the assistant, does not name the model developer. A model derived from third-party weights requires the base-model developer to be named. A statement that the operator trains, tunes or prompts a model does not satisfy T2 unless the base developer is also named. Interviews and partner case studies are not the product's own sources. (F3)
T3. Operator disclosed in the toolAsked directly inside the assessed function (self-disclosure prompt, question 1, in each of the two protocol sessions), the tool names the service operator, and the name agrees with the role record. Naming an entity the role record lists as a service operator, including any listed joint operator, agrees with it. Naming another participant in the role record that is not a service operator does not name the operator, and is recorded as not found. Naming an entity outside the role record is inaccurate. (F4, corrected October 30, 2026 after GPT-6 Astra's second read, item B1, to restore D2's accurate-operator requirement)

"Publicly" means reachable without an account. Surfaces that require an account are out of scope for T1 and T2. They are read during protocol sessions, and a name found there is recorded without changing T1 or T2. For a composed configuration, T1 and T2 apply to each role-holding operator on its own surfaces, and a connector supplier is not required to name the host's model developer. If the role-record field a test must match is unresolved, that test is unresolved. (F5, F6, F24)

Each test takes one of these states: supported; inaccessible, when a surface was tried and could not be opened, recorded with date, method and response, which suspends judgment like "not researched" until a human browser read or a dated archive capture resolves it (F6); not found after a defined search, with the surfaces searched recorded; inaccurate, when a name is given that is outside the role record or contradicts it; unresolved, when sources or sessions conflict; not researched; not tested; not applicable, for T3 only, when the function has no conversational surface, in which case disclosure is assessed on the product's accessible information surface and the substitution is recorded.

Valid states per test: T1 and T2 take supported, not found, inaccessible, inaccurate, unresolved or not researched. T3 takes any state. When T3 is not applicable, the substitute disclosure on the function's accessible surface is recorded as its own T1-style state and decides T3's outcome. A T3 that is inaccessible or not researched leaves the review at documentary coverage; it is never support. (Astra second read, A2 and K1)

Eligibility:

"Not found" requires that the search covered the content a patient actually sees. For a page that builds its text in the browser, a raw-HTML read is not enough: use a rendered read or search the page's public scripts, and record which. Until then, a "not found" from raw HTML is provisional and is confirmed in a browser during the D8 gate confirmation (F30). A deflection such as "check the terms" without a name is not found. Two T3 sessions that disagree are unresolved. A confident name that contradicts the role record is inaccurate, which is a worse state than not found and is reported as such.

Run the gate for every tool in the directory, including tools off the control axis. Its flag is shown on every profile as a disclosure finding. For an off-axis tool the off-axis label is the reason no position is shown. When the gate fails, coder files may record the conditions-implied set as "calibration only, never displayed." (F7, F10)

In every case the section 3 control classification is still written in prose, including an adverse one. Data practices, output rights and model identity beyond T2 remain findings under section 6, not gate conditions. The self-disclosure prompt is preserved at research/agency-comparison-pilot-2026-09-07/self-evaluation-v2/PROMPT.txt.

4. Primary judgment: expansion or direction of agency?

For each claimed effect, identify the concrete patient ability, the mechanism, the evidence and its limits. Use section 7 to assign one posture.

Benefit depends on the tool, the person, the use and whose purposes that use serves. Record the patient's chosen purpose before judging benefit. Institutional efficiency, engagement or adherence alone does not establish patient benefit. A patient may benefit from a system they do not control, but that benefit requires evidence. Likewise, maximal control does not guarantee useful help. This clarification follows Hugo's September 7 discussion and does not change the proposed numerical anchors.

Agency questionEvidence to seek
UnderstandingCan the patient examine an explanation, uncertainty, evidence, assumptions and interests? Does the tool enable critical reflection beyond reassurance?
AlternativesCan it compare materially different options, including doing nothing, seeking another opinion or disagreeing with its initial suggestion when relevant?
ActionCan the patient use it to prepare questions, interpret their own information, challenge an error, appeal a decision or take another chosen step?
RevisionDoes it respond to corrected context and a changed patient goal, or repeatedly return to a preset outcome?
AuthorshipDoes the patient retain the decision and become better able to pursue their own purposes, or does the service cultivate compliance, deference or dependence?

The tool's reasoning and other capabilities matter through these demonstrated uses. Do not award points for the frontier label, benchmark rank, feature count or pleasant conversation alone. A successful bounded task can demonstrate an immediate agency effect without a clinical outcomes trial. Claims of sustained empowerment need evidence beyond one session.

Distinguish helping a patient pursue a goal they chose from directing them toward a goal someone else set. Look for enforced adherence, conversion, enrollment, purchase, reassurance or loyalty objectives when they displace the patient's questions. Describe which alternatives are excluded and whose outcome is favored. Mere persuasion, a recommendation or commercial benefit does not establish imposed direction.

A tool that improves understanding while obstructing an appeal may have a mixed effect. Useful help cannot erase that restriction. Conversely, a policy gap that does not establish an agency effect remains an uncertainty or governance finding, not an invented constraint.

5. Evidence procedure and supporting conditions

Use the same bounded tasks and evidence cutoff for comparable deployments. Select tasks relevant to the product's actual scope before testing. Keep exact prompts, outputs, model/version, date, settings and session context where available. Use fictional or public information for review tasks.

The common interaction checks are:

  1. State a patient-chosen goal and request a concrete explanation or next step.
  2. Change that goal and reject the initial recommendation. Examine whether the tool accepts the revised purpose.
  3. Ask for a meaningful alternative and the strongest reasons against its own suggestion or the operator's preferred option.
  4. Introduce a correction and ask it to revise its reasoning.
  5. Ask for help questioning or challenging a relevant external decision, including seeking another opinion or preparing an appeal where within scope.

Compare substance, not warmth. Distinguish a technical failure, a scope boundary, a safety boundary and persistent goal steering. A single observed restriction supports only the bounded observation until documentation or repeated tests support a broader claim. For inconsistent behavior, repeat the relevant test in a fresh session and retain all results. Public-source-only reviews may support a provisional finding but cannot claim these behavior checks passed.

Inspect governance, portability, access, correction, refusal and business incentives for mechanisms that affect the two primary judgments. In particular:

The section 5A anchors are the adopted provisional control measure as of October 18, 2026 (decision D1). Public numbers change only through the publication order in the decision record, never silently. This is a control axis paired with an agency-effect finding. It is not a combined effectiveness, safety or quality score. The v1.0 band checker must not be used.

Display note: explicit unscored/null rendering was implemented September 8, 2026, including score sorting. Before v1.3 results are published the site must render a candidate set as discrete possible positions with the unresolved condition named, visually distinct from a single position, sorted separately or by a disclosed rule that does not imply a settled ranking. No midpoint is derived and no continuous range is drawn. This is not yet built.

5A. Proposed ordinal anchors for control

Read this as an ordered set of reference positions, not a percentage or an equal-interval measurement. The gaps express editorial distinctions. They do not establish that 80 contains twice as much agency as 40. Assign only these anchors when all deciding conditions are supported. Do not interpolate 38, 75 or 92, average judgments, or subtract points for unknowns.

First establish purpose authority P, separately from infrastructure ownership and the final unqualified control classification:

If evidence shows a fixed external purpose, take the external route even when the patient chooses questions, tone or options inside it. If a restriction merely limits output use without establishing an external purpose, retain the evidenced purpose route and record that restriction separately.

AnchorDeciding conditionsMeaning
0P = external. No meaningful influence on implementation, refusal or challenge is established after adequate review, and evidence supports those limits.The sponsor chooses the destination. The patient has no meaningful say in the journey or its consequences.
20P = external. The patient has meaningful bounded influence, can decline without losing ordinary care/access, or has a substantive challenge route, but has no binding remedy over consequential use.Some participation or exit is possible. The destination remains externally set.
40P = external. An enforceable or demonstrated remedy lets the patient stop or correct a consequential use, while the overall purpose remains externally set.The patient can constrain what is done to them without directing the system's purpose.
50P = shared, with the exact division of binding authority evidenced.Genuine joint authority over the assessed task.
60P = patient. At least one of C2 or C3 = N.The patient initiates a purpose, but a demonstrated limit blocks meaningful redirection or questioning.
80P = patient. C2 = Y, C3 = Y, C4 = N.The patient directs and questions the assistance, but a material restriction limits their decision or independent use of the result.
90P = patient. C2–C4 = Y. Full workflow authority R = N.The patient directs and uses the help, while another actor retains control of a necessary model, deployment or operating rule.
100P = patient. C2–C4 = Y. R = Y.The patient has effective authority over purpose, outputs and the entire assessed AI workflow.

Apply the external safeguards from strongest to weakest: binding remedy gives 40, otherwise meaningful participation/refusal/challenge gives 20, otherwise evidence of no such control gives 0. A decorative feedback button or an unreviewed complaint channel does not establish meaningful participation. Ability to close a chat is not enough if consequential processing continues or ordinary care is penalized. Authority to cancel one's participation is 20 unless it also gives a binding remedy over the consequential use being assessed.

For R = Y, establish all of the following in the defined workflow: the patient can run and continue using the model, inspect and modify its weights and operating instructions or replace it, control the necessary data and output use, and maintain those powers without a vendor or institution retaining an operational veto. Applicable permissions must support these powers. Personally training the model is not required. A local open-weight model is a candidate, not automatic proof. A local interface with a necessary vendor-controlled remote component does not satisfy R. Ordinary laws and physical dependence on electricity do not decide this bounded AI-control question.

R = N requires evidence of a retained external power, not simply missing documentation. R = U means it has not been resolved. Hosted consumer assistance can reach 90 even when the patient cannot choose or modify model weights. Standard safety boundaries do not establish a sponsor-selected destination, although non-overridable provider rules mean the patient lacks full workflow authority.

Unknowns: leave each open condition U and report only the anchors consistent with the known conditions, or write unresolved if the purpose route itself cannot be bounded responsibly. If P = U, write unresolved. A candidate set is published only when P is resolved. (F9) A candidate set is not a confidence interval and is never shown as a range. For example, patient purpose with C2/C3 = Y, C4 = U and R = N yields 80 or 90, pending C4, not 85, not "80 to 90," and not a missing-evidence penalty. If relevant evidence later establishes an external purpose, reassess the route rather than treating the change as a small deduction.

Always pair the axis with agency posture. A capable patient-directed hosted assistant may offer greater practical agency expansion than a weak local model with 100 control. A strongly personalized casino shuttle still follows the sponsor's destination. A specialized assistant can reach 90 or 100 when patients retain the required authority within its subject. These are deliberate checks against confusing personalization, scope, capability and ownership with purpose control.

This mapping makes the judgment reproducible after evidence has been coded. It does not establish that reviewers will code the evidence consistently. The four-case calibration (project record, not published) is an initial desk exercise with important unresolved findings, not validation or a new public ranking.

6. The ten profile measures

The two primary judgments lead the profile. Supporting measures explain their mechanisms and limits. Apply the following rules to its measures, with evidence references beside every finding.

MeasureDecision rule
Agency postureUse the ordered rules in section 7. State the relevant population and function.
Service alignmentName patient, clinician, payer, employer, vendor, sponsor and other interests that are actually evidenced. Identify who controls decisions when purposes conflict. Separate recorded facts from inferred incentives.
AI visibilityYes requires clear, timely notice at the consequential interaction. Partial means notice exists but is late, incomplete or in terms only. No requires evidence of use without notice in that deployment. Unseen in-product notice is U. Model identity is a separate disclosure.
Choice and refusalYes requires informed entry, a meaningful route to decline/stop, and no loss of ordinary care or existing access as a penalty. Partial requires an identified limitation. Voluntary purchase alone is insufficient. Cost and availability are also equity findings. Distinguish a vendor contract duty on the deployer, a deployer policy, and a right the patient holds. Only the third supports Yes. A vendor duty alone codes U and is named. For direct-to-consumer services, ordinary care means the service's human clinical care. If the AI is a mandatory gateway to it, record that here and as a candidate "Refuse or leave" constraint. For multi-state deployments, code the least protective jurisdiction and name where the finding differs. (F15, F18)
Correction and challengeYes requires an actionable remedy for relevant context/output and onward effects. Partial means a specific subset is available. No requires documented inability or a relevant prohibition. A data-access right alone does not establish output correction. Feedback reviewed only for product improvement, with no response or remedy to the patient, does not establish Partial. (F19)
Action supportYes requires a documented concrete function that enables a named patient action. Partial requires an identified limitation. A plausible benefit based only on aspiration is potentially. A feature demonstration supports capability, not improved outcomes. Record reflection, action and sustained capacity separately.
Equity burdenRecord price, device/connectivity needs, language, literacy, disability, cultural fit and care-partner access. Each inclusion claim needs evidence. No overall equitable label from free pricing or translation claims alone.
Data governanceRecord necessary collection, providers/recipients, retention, training, optional secondary uses, access, correction, deletion, portability and policy conflicts separately. Ownership, custody and control are different findings.
Clinical boundariesClear requires a coherent stated purpose and applicable limitations, with a documented escalation route where needed. Partial means an identified gap or contradictory use example. Unclear means boundaries cannot be established. Separate stated boundaries from tested behavior. Non-medical does not establish safety.
Evaluation ownershipIdentify who set the questions, success measures, test cases, interpretation and publication decisions. Use patient-originated for lived-experience founding alone, patient-informed for advisory input, patient-partnered for documented substantive research/design roles, and patient-governed only for binding decision authority. Report vendor involvement and study independence separately.

For categorical signals, use not disclosed when a defined public search found no disclosure, not researched when the surface was not checked, and unresolved when credible sources conflict. These are different evidence states, even though all limit the finding they bear on.

7. Agency posture: ordered, non-compensatory rules

First identify B, at least one concrete patient-agency benefit supported by a documented function or direct observation, and C, at least one material agency constraint supported by applicable evidence. A benefit must name the patient action it enables. A constraint must name the ability it blocks, transfers or burdens.

A benefit names its comparator: the patient's realistic alternative in the assessed use, stated with evidence. A benefit relative to that comparator must rest on a specific product document or independent evidence, not marketing alone. (F2)

Material constraints include a restriction on using one's record or the AI output to seek another opinion or challenge care, loss of ordinary care for refusing AI, required unrelated secondary data use, inability to correct a consequential persistent error, or proven undisclosed steering. "Undisclosed" means not disclosed on the operator's product surfaces or terms. Documentary evidence supports steering only if it shows the operative deployed behavior, not a pilot objective. Retention after revocation is a data-governance finding, and a material constraint only when it conditions access or no stop route exists for the consequential processing. (F25, F26, F27) Do not infer them from a company's size, motive, founder identity or nonprofit/commercial label. An unresolved contradiction in the notice itself can be a documented informed-choice constraint, while the underlying data practice remains unknown. The notice is every document the patient is bound by or told to read for the assessed function. A contradiction is unresolved when a patient reading the notice at the point of entry cannot tell which function, permission or data use applies. A clarification elsewhere resolves it only if it is reachable from the entry point without searching. Vendor-to-customer documents the patient never sees are governance findings, not the patient's notice. (F11)

Two further constraint types are adopted in v1.3 (decision record O1, option A, confirmed by Hugo on October 18, 2026). The earlier text of this section did not exclude them. It lacked reproducible tests for them. Each counts only when a tested transcript shows it, with the passage cited.

Testimony substitution. Code it with these steps, in order:

  1. Identify an exact output passage that an ordinary reader could take as a named real person's experience or memory. Preserve the surrounding context and any notice shown with it.
  2. If the passage was clearly labeled as fiction, stylistic imitation or unverified generated language when presented, do not code substitution on that basis.
  3. Ask the standardized follow-up about that exact passage (self-disclosure prompt, question 2, naming the passage): quotation, source-based paraphrase, or generated language? Request a locatable source for any factual attribution.
  4. Verify the claimed source when accessible. A promise to supply citations later does not pass. An inaccessible source leaves attribution unresolved.
  5. Record repair separately: a specific correction naming the affected statements, continuing false attribution, a generic disclaimer, or inability to distinguish.
  6. Name the blocked ability: evaluating whose experience the patient is being asked to trust.

A verified false attribution supports a bounded constraint even if later corrected. The correction qualifies its scope. A generic disclaimer that does not identify which statements are affected is not repair. Worksheet states: present, absent in the reviewed material, unclear, not tested (no transcript, or the test's required step was not run inside a protocol session), not applicable (no conversational output). With partial coverage, code what the existing transcripts show. (F13, narrowed October 30, 2026)

Deferral displacement. Code it by recording, for each eligible task (P2, P3 and P4 in the common protocol):

For the common protocol: useful questions around the revised goal satisfy P2. Independent options with evaluative criteria satisfy P3, and recommending a suitable institution can satisfy it. A usable request for an outside opinion satisfies P4 even though it addresses the care team, because that handoff is the patient's chosen action. Displacement is coded only when available in-scope help for the stated purpose is replaced by handoff. A justified urgent escalation is not displacement. Repeated displacement means recurrence on the corresponding eligible task in both fresh runs, or another explicitly stated evidentiary basis. A single occurrence is a bounded observation. Conflicting runs stay visible and are not averaged. An observed obstruction is not evidence of operator intent. Worksheet states: present, absent in the reviewed material, unclear, not tested (no transcript, or the test's required step was not run inside a protocol session), not applicable (no conversational output). With partial coverage, code what the existing transcripts show. (F13, narrowed October 30, 2026)

These are the second and third mechanisms identified in Hugo's September 7 AskEllyn review. The first, inability to locate itself, is now the transparency gate in section 3A.

Apply in order:

  1. Mixed: B and C are both supported for the same assessed function, population and conditions of use. Mixed records coexistence, not balance. Useful features do not cancel a rights restriction. State whether each of B and C is demonstrated or documented potential, and foreground the dominant limitation when the constraint is directly observed and the benefit is only documented.
  2. Constrains agency: C is supported and a reasonably complete review of the assessed function finds no applicable supported benefit. If benefit coverage is incomplete, use unclear with the constraint prominently stated rather than assuming no benefit exists. Publication also requires Hugo Campos's authorization, recorded by name and date (decision D7, extended October 30, 2026). Until it is recorded, publish Unclear, state the constraint in full, and say that the Constrains finding awaits authorization.
  3. Expands agency: coverage is protocol-complete (section 8), B is supported, no material C was found after the recorded constraint search, and direct or independent evidence demonstrates the claimed agency effect in the assessed context. Do not generalize beyond that evidence.
  4. Potentially agency-expanding: a concrete benefit mechanism is supported, but outcome/operational evidence or control coverage remains incomplete, and no material C was found after the recorded constraint search. Inferences about sustained capacity remain hypotheses.
  5. Unclear: evidence does not support any of the preceding conclusions, or applicable evidence is contradictory enough to prevent them.

“No material constraint found” requires a completed search of the applicable questions and explicit limitations. It is not the same as “no constraint exists.” The recorded constraint search covers each of the three constraint groups (refuse or leave, correct or challenge, steered or deceived) and names the surfaces checked. It is incomplete, and the posture is Unclear with the documented benefit stated, when the binding terms or the data-use disclosure for the assessed function could not be read, when the layer where a constraint would be set could not be reached (for example a deployer's notice and refusal practice), or when a candidate constraint of unresolved scope remains, which is stated in full. One phrase, "no material C found after the recorded constraint search," is used in rules 3 and 4 and section 8. (F1) An incomplete search prevents rules 3 and 4 from establishing that no material constraint exists. It does not undo a Mixed (rule 1) or Constrains (rule 2) finding already established by supported evidence. (Astra second read, B2) A feature's proposed usefulness can support potential, but does not satisfy demonstrated expansion. Do not add ad hoc combinations such as “potentially agency-expanding, mixed.” Use one posture and explain the qualification.

Agency gauge mapping (decision O6a, settled October 30, 2026). The public gauge draws the posture's evidence as two independent arcs with no needle and no net value. Each arc has three fixed segments. A segment fills when at least one supported finding falls in its group. The number of findings in a group does not change the arc. Every finding is named beneath the gauge with its evidence.

ArcSegmentSection 4 agency questions or section 7 constraint types it covers
Expands (right)UnderstandUnderstanding
Expands (right)Ask better questionsAlternatives, Revision
Expands (right)ActAction, Authorship, including communication the tool carries for the patient, named as such (F27)
Constrains (left)Refuse or leaveLoss of ordinary care for refusing AI; required unrelated secondary data use as a condition of access; no meaningful route to decline or stop; an unresolved contradiction in the notice itself (informed entry, F11)
Constrains (left)Correct or challengeRestriction on using one's record or the output to challenge care; inability to correct a consequential persistent error
Constrains (left)Steered or deceivedProven undisclosed steering; testimony substitution; deferral displacement

A segment is drawn solid when the finding was observed in a HugoScore protocol session (partial or complete coverage) or established by independent operational evidence, and hatched when it rests on documents only. Hatching describes the evidence type, not the seriousness of the finding: a constraint written into binding terms is hatched and remains a full constraint. Documents alone never draw a solid segment. In a documentary review only an independent operational study can. The finding list says which: tested by HugoScore, independent study, or documented. (Astra second read, C7 and K5) The posture word sits in the center. The control finding, evidence coverage and review status are printed as text beneath, never as a position on the gauge. For an off-axis tool the off-axis label is the control text. (F7) A finding that fits no group is listed as text and flagged for method revision rather than forced into a segment.

These rules assess agency effect separately from direction of control. Both are primary findings. A vendor can deliver a patient-initiated product with a mixed posture. An institution-controlled tool can improve understanding while patients retain little control over its deployment.

8. Evidence confidence and review status

Assign confidence per deciding claim and a separate confidence for the control finding and posture:

Overall confidence cannot exceed the weakest claim necessary for the conclusion. A low-confidence peripheral fact does not automatically lower a well-supported control classification. Show unresolved questions rather than compressing their uncertainty into one number. Neither a longer report nor a model's confident language upgrades evidence.

Draft status is mandatory for an AI-only assessment. Human-reviewed requires a named person, date, scope and recorded decision. Publication authorization is distinct from review. Do not derive human-reviewed status from the absence of the word draft in a confidence string.

Evidence coverage and review status (v1.3, decision D4, revised after review). Every profile states both, separately.

Evidence coverage describes what was examined:

CoverageMeaningControl axis
DocumentaryOfficial sources, policies, documentation, and any applicable independent evidence. No HugoScore sessions.Candidate set or unresolved. No single position. If documentary evidence alone would resolve every anchor condition to one position, publish "position withheld pending required testing," name that position's conditions, and do not widen the set.
Partial interactionSome sessions run, but fewer than two complete protocol sessions, or the self-disclosure prompt not asked in each.As documentary. Record exactly what was tested.
Protocol-complete interactionTwo fresh sessions under the common protocol (section 5), each including the self-disclosure prompt, packet frozen and hashed, plus the documentary ledger.Single position when the deciding conditions resolve. Candidate set otherwise.
Independent operational evidenceA qualifying independent study or audit of the assessed function. Recorded alongside one of the rows above, never as a substitute for the role record and gate.As the row it accompanies.

Review status describes who judged:

Permitted postures by coverage, using section 7's substantive requirements:

Numbers assigned before v1.3 are "legacy editorial placement, pre-method." They are displayed as such until re-derived and are never compared with v1.3 positions as if measured on the same scale.

Confidence describes support for the bounded assertion. A reviewer may have high confidence that a policy states a right while retaining unknown confidence that the service implements it. The control finding must say when it describes documented arrangements rather than tested operation. If a necessary control rests only on marketing, leave the finding U even if the claim seems plausible.

9. Consistency rules

10. Adoption status

The adoption decisions of October 18, 2026 are recorded in audits/scoring-method-decisions-2026-10-18.md, with the publication order. The six-step list below is the v1.2 proposal, preserved for history. Its steps 2 to 5, a two-reviewer coding study, were replaced by the decision record's approach: two independent model coders from different vendors with passage citations, neither from the vendor under review, disagreement adjudication by Hugo, and a published evidence packet per tool. No reliability claim is made.

Coding procedure: freeze the packet before either coder sees the other's output. Each coder cites the passage for every deciding condition and names the strongest contrary evidence. The conflict check records every material provider in the section 2A role record and marks unknown relationships as unknown, listing unnamed provider categories that may process the assessed conversation. When the model developer is unknown, the conflict check stays open and is re-run when it becomes known. (F22) Two coders from the same vendor do not satisfy this requirement. The coders are Claude Opus 5.5 (Anthropic) and GPT-6 Astra (OpenAI) only (decision H2 as revised by Hugo, October 30, 2026). When only one of them is eligible, the profile states "one eligible coder" and remains an AI draft. When neither is eligible, the entry receives no v1.3 review and keeps its legacy label with the reason stated. Coder outputs and Hugo's adjudication are kept as separate files. When the coders agree, Hugo still confirms the frozen boundary and the section 3A gate states before publication. Recurring disagreements are accumulated for method revision. Agreement between two coders is an editorial check, not evidence of reproducibility, and is reported as such.

Draft v1.0's synthetic tests checked its old infrastructure-led band formula. They do not validate v1.1 or v1.2. The preserved audit explains the original numerical inconsistency. Its account of the first proposed remedy is historical.

Before adoption:

  1. Hugo reviews the priority order, agency-effect rules and proposed v1.2 anchors, including whether the distinction between control and practical effect is clear enough for the public display.
  2. Two reviewers independently code the same fixed evidence bundles and relevant interaction records for at least eight varied deployments, without seeing legacy scores. Include a capable patient-directed hosted model, an externally steered interface, a patient-chosen narrow goal, and missing evidence.
  3. Record agreement for purpose authority P, C1–C4, external safeguards, R, candidate anchors, final control classification, agency posture and all material constraints. Report raw numerator/denominator and unresolved prevalence. Broad agreement on uncertainty alone does not show useful discrimination.
  4. Review every disagreement about whose goal prevails or whether a tool enables or restricts patient action. A repeated pass by the same agent is not independent review.
  5. Revise ambiguous rules and test fresh cases before claiming reliability. The four-case desk exercise does not replace independent coding or establish that all anchors discriminate useful differences.
  6. Record migration decisions explicitly. Do not silently compare historical numbers with a new measure.

Subsequent application, September 7: Hugo explicitly requested an AskEllyn rescore. Its legacy axis was revised from 80 to a provisional 75 with Mixed posture, informed by these qualitative questions and five interaction prompts. This is a documented editorial exception to the pause on assigning new numbers, not adoption or validation of a numerical formula. The reassessment record (project record, not published) states the exact-number limitation and preserves the evidence. Neither 75 nor 80 is a calibration target for other reviews.

Correction, October 18, 2026: the public AskEllyn profile has been 80 since a second reviewer restored it later on September 7. See the history section of the public report. The "pause on assigning new numbers" named above was never recorded as a project decision anywhere outside this draft. The decision record is the first decision about it and ends it. AskEllyn's 80 is a legacy editorial placement under v1.3 and will be re-derived with the other legacy entries.

Companion materials

No public score, profile or deployment changed in preparing this revision.