AlphaTest · Reports · integrator API

Adaptive diagnostic surface QC

QC FAIL · RELEASE BLOCKED

Observed 2026-07-21 08:04:59 UTC · reports-integrator-api-adaptive-diagnostic-20260721T080459Z

The documented and stable adaptive POSTs return the wrong test kind.

The literal adaptive materialization request returns mastery_gate from both the approved customer-website sandbox and stable Reports origin, but adaptive_diagnostic from the immutable adaptive candidate. Production tenant routes remain absent. The upstream Results production mint is also publicly callable. AcmeTest must not adopt this surface.

0/4production job operations availableOne critical release-identity defect reproduces.

Verify, do not trust

The rerunner performs 34 non-mutating contract probes against the approved docs, their published sandbox, stable origin, immutable candidate, and Results. It retains public bodies and allowlisted headers, immediately discards the ephemeral Results token and learner values, hashes the capture, and never writes a learning fact.

REPORT_URL="<this report URL>"
curl -fsS "$REPORT_URL/probe.sh" -o probe.sh
chmod +x probe.sh
./probe.sh

Exit 0 this QC-fail baseline reproduced · 1 drift · 2 a tenant route appeared; full D2/D5 re-audit · 3 missing dependency/target

Frozen run: 34-request matrix · targets/time · SHA-256 manifest · machine verdict.

Exact failing property

all requests
PropertyStable / documented surfaceImmutable adaptive candidateVerdict
POST response identityRequested att_diag_8K2m; returned att_7F3k9Returned att_diag_8K2mFAIL
POST response kindmastery_gate, gate fail, no diagnosticadaptive_diagnostic, scale 214.6, gate nullFAIL
Cache-ControlStable: private, no-store; documented: publicprivate, no-storeDOCS FAIL
Build receiptreports-unified-parked-a1-20260721; docs omit receiptreports-unified-adaptive-a1-20260721FAIL
GET adaptive detailadaptive · scale 214.6 · gate nullsame bytesPASS
Retry on each originstable wrong responsestable correct responseSTABLE DIVERGENCE
Tenant report routesdetail/history/readiness/materialize all 404detail 404FAIL-CLOSED
Production demo mint404not mountedPASS · ABSENT
Results production mintUnauthenticated 200; minted token lists 31,319 demo rowsn/aSECURITY FAIL
Results exact adaptive attemptn/a200, zero exact rowsTRANSPORT ONLY

Verbatim receipts: documented body · stable body · stable headers · candidate body · candidate headers.

Severity-ranked findings

JSON assessment
F-001 · Critical

The approved website's adaptive example is false on the wire

The published POST is sent for att_diag_8K2m, but returns att_7F3k9, mastery_gate, and a binary gate failure. This is a docs-to-runtime contract failure in the earliest approved artifact that owns the runnable example.

Reproduce: run probe.sh; exit 0 means the complete blocked baseline still exists.

F-002 · Critical

The stable origin is not the immutable adaptive release

The same POST is wrong at the stable origin and correct on the candidate. Unequal build receipts isolate a release-identity failure; identical per-origin retries rule out transient response drift.

F-003 · Critical

Results exposes a production credential path

Unauthenticated POST /dev/mint?tenantId=demo returns 200. Its ephemeral token authorizes a collection read reporting 31,319 rows whose schema includes learner identifiers. The audit immediately discarded the token and all row values; this is a security failure, not a recommended integration path.

F-004 · Critical

No tenant-backed adaptive report operation or evidence chain is released

Detail, history, readiness, and materialization all return 404. The exact Results adaptive lookup is empty; test_result_components, adaptive references, and Caliper read-back are absent. Owner status pages receive no runtime credit.

F-005 · High

Reports tenant isolation remains unverified

Reports tenant routes and its demo mint are absent, but no same-tenant success or disjoint tenant-A/B fixtures exist. Route absence is fail-closed; it is not evidence of future tenant isolation.

Full-surface verdicts

artifact audit
PASS

Architecture

200; explicit release gates, stateless composition ownership, and parked behavior.

PASS

Data dictionary

200; adaptive scale/KC/evidence fields are specified and synthetic examples are labeled.

FAIL

Customer website

The page and CSS return 200 and production status is honest, but its literal adaptive POST returns the mastery fixture.

FAIL

Implementation

The immutable adaptive build satisfies ITD-029, but the stable customer origin serves a different POST contract and receipt.

Standard API axes: 12/12 pinned

Write granularity ITD-016 · read shape 017 · query 018 · concurrency 019 · idempotency 020 · auth 021 · eventing 022 · error envelope 023 · tenant routing 024 · conformance 025 · privacy/retention 026 · list endpoints 027. Every axis is SHIP or DEFERRED.

Kind matrix

The documented sandbox, stable origin, and immutable candidate were driven with the same adaptive POST. Both runtime origins were also driven for adaptive and mastery GET, adaptive/formative history filters, mastery POST, retry stability, release identity, and cache policy. The customer-facing POST leaks mastery semantics; the candidate does not.

Security gate

REPORTS FAIL-CLOSED

No current Reports tenant-data route

Anonymous and reviewer-shaped Reports requests return 404, and the Reports demo mint returns 404. Its sandbox is fixed and tenant-free.

UPSTREAM SECURITY FAIL

Results production mint is public

A no-credential mint returned 200 and the minted demo token listed 31,319 tenant records. Cross-tenant isolation was not exercised and remains blocking-inconclusive; a publicly mintable tenant credential already fails the secure-default gate.

Upstream reality

AuthorityFresh evidenceVerdict
ResultsPublic production mint → authenticated list of 31,319; exact lookup empty; components/adaptive refs absentSECURITY FAIL · NO COMPOSITION PROOF
BankOwner page says adaptive admission closed pending non-null QTI/CASE-reconciled poolBLOCKED
Mastery EngineOwner page says adaptive runtime release pendingBLOCKED
Caliper / QTI / CASE / Content / Administration / OneRoster / AnalyticsNo end-to-end learner report receiptUNPROVEN

Machine-readable proof ledger. No local fixture or copied payload receives upstream-call credit.

Autonomous continuation

ROLL BACK · reports / integrator_api / customer_website

Fix the first published request, then re-promote one immutable runtime.

The customer website is the earliest approved deliverable whose own runnable adaptive example returns the wrong fixture. Rebuilding it also forces downstream implementation and release validation.

  1. Make the literal documented POST return att_diag_8K2m, adaptive_diagnostic, score 214.6, gate null, and private/no-store.
  2. Promote the immutable build emitting reports-unified-adaptive-a1-20260721 atomically to the stable Reports origin.
  3. Gate the customer-website URL, candidate, and stable origin on two byte-stable adaptive retries plus mastery/formative sibling checks.
  4. Keep production Reports tenant routes parked. Remove or strongly authenticate the Results production mint, then prove same-tenant and bidirectional cross-tenant behavior before any release.

Benchmark comparison

The freshly fetched Qualys SSL Labs assessment was READY on engine 2.4.2 with four A+ endpoints. This audit matches its exact-target component verdicts and one-command reassessment, then adds frozen bodies, allowlisted headers, hashes, semantic API assertions, three-surface comparison, proof-level limits, explicit inconclusives, and machine-readable rollback. Frozen benchmark summary.