CNA-VGAP-049: The XNA API census (331/331 types, 3,627/3,627 members) measures representation only and is a manually run script

CNA snapshot 009d40f5  ·  Known Issues › Verification gaps  ·  source links pinned to 009d40f5

Every member row of docs/xna-4-runtime-member-coverage.json records behavior_assessed false, and tools/audit_xna_runtime_surface.py is run by no workflow or CTest, so behavioural evidence exists only for the subsets named by individual tests and oracles.

Identifier

CNA-VGAP-049

Category

Verification gap

Subsystem

Testing & evidence

Status

Open

Verified against

CNA 009d40f5 (009d40f5dd085c4e674d3479675fac84b12b3e0a)

Evidence basis

Source-verified: read at TARGET, not executed

Tests touching this area

Yes: see Current tests

Affected contract

docs/xna-4-runtime-member-coverage.json and tools/audit_xna_runtime_surface.py

Expected behaviour

A compatibility census that is cited alongside behaviour claims either assesses behaviour or is regenerated by a gate so that representation stays current.

Actual behaviour at TARGET

All 3,627 rows in xna-4-runtime-member-coverage.json carry behavior_assessed: false. audit_xna_runtime_surface.py is referenced by documents only; no workflow, CMake file or CTest runs it.

Source locations

• docs/xna-4-runtime-member-coverage.json — member rows, behavior_assessed
• tools/audit_xna_runtime_surface.py — the census generator

Evidence

Checked by reading at 009d40f5 (a count of the behavior_assessed flags in the JSON); not executed.

Focused reproduction

No focused reproduction is known. Nothing has been invented here; the evidence above is what exists.

Current tests

Behavioural tests exist per subsystem; none is keyed to census rows.

Regression test

A CI step that regenerates the census and fails on drift, and a behaviour column filled from named tests or oracles.

Blast radius

Readers who take representation coverage for behavioural parity.

Workaround

No workaround is known.