Verification gaps

CNA snapshot c1c316b9  ·  Known Issues › Verification gaps  ·  source links pinned to c1c316b9

✓

Evidence basis: source-verified at the pinned commit. Claims on this page were checked by reading the CNA source at commit c1c316b9; unless a sentence says otherwise, nothing here was built or executed.

An implementation exists, but the evidence that it behaves correctly is insufficient. Every entry below exists at CNA c1c316b9; open an entry for its expected and actual behaviour, source locations, evidence and blast radius.

46 entries

IDTitleSubsystemStatusSeverityEvidence basis
CNA-VGAP-001Matrix camera builders have no XNA oracle and no full-matrix value testMath & geometryopenn/asource-verified
CNA-VGAP-002BoundingSphere::CreateFromBoundingBox and the SmoothStep/Hermite/CatmullRom helpers use different arithmetic from XNA 4.0, and no oracle measures last-bit agreementMath & geometryopenn/asource-verified
CNA-VGAP-003No test pins EffectParameter's divergences for CNA-constructed parameters, including a SetValue(Texture*) that GetValueTexture2D() does not read backGraphics & renderersopenn/asource-verified
CNA-VGAP-005The XNA audio facade on CNA's own ALSA mixer is covered by seven facade tests plus the XACT category suite; the SoundEffect, instance, dynamic-instance, Cue, SoundBank and WaveBank suites run only on SDL3Audio & mediaopenn/asource-verified
CNA-VGAP-006Media paths without tests: the natural song end on SDL3_mixer, the failed visualization install, MediaLibrary accessors after Dispose and SavePicture's IOExceptionAudio & mediaopenn/asource-verified
CNA-VGAP-007The SDL3 camera provider, system-tray icon and file-dialog result path have no test that drives themPlatformsopenn/asource-verified
CNA-VGAP-008Android and iOS have no device evidence at this snapshot: no Android workflow, iOS only in the Simulator, and lifecycle and packaged-content loading untested on a devicePlatformsopenn/asource-verified
CNA-VGAP-011No test exercises PlatformSelection.cmake's reserved-identifier refusal pathsBuild & CInarrowedn/asource-verified
CNA-VGAP-013No gate checks include reachability or compiles each public C++ header alone; the two scripts that did are stale campaign tools wired to nothingBuild & CIopenn/asource-verified
CNA-VGAP-014The physical source-partition validator checks only *.cpp/*.mm path prefixes, so headers, C sources and a TU in a renderer's src/ subdirectory (never compiled) all pass itBuild & CIopenn/asource-verified
CNA-VGAP-015CNA records and checks no easy-gl or meta-gl revision, although the snapshot needs meta-gl 20c8b2dc or later and easy-gl deda7a42 or laterBuild & CIopenn/asource-verified
CNA-VGAP-016A plain ctest run of the tests preset is not a trustworthy resultTesting & evidencenarrowedn/arecorded by CNA
CNA-VGAP-019The HEADLESS native-SDK-free and VULKAN link-closure gates run in no CI jobTesting & evidencenarrowedn/asource-verified
CNA-VGAP-020The hand-written CnaPlatformTests filter misses TerminalPresenterThroughPlatformTest and nine other platform suites, so the platform CI cells never select themTesting & evidenceopenn/asource-verified
CNA-VGAP-021No SpriteFont/DrawString pixel test exists for DIRECTX9 or FNA3DTesting & evidencenarrowedn/asource-verified
CNA-VGAP-022No test measures presentation cadence: PresentInterval::Two against ordinary vsync, or Vulkan's FIFO_RELAXED late-frame behaviourTesting & evidenceopenn/asource-verified
CNA-VGAP-023No browser renderer path is executed automatically: WEBGL2 has no test registrations and no workflow runs a renderer in a browserTesting & evidenceopenn/asource-verified
CNA-VGAP-025No CI workflow selects WEBGPU or SDL_GPU; their evidence is local and scripted headless-Chrome runs, and SDL_GPU's Direct3D 12 driver route has no native execution evidenceTesting & evidencenarrowedn/asource-verified
CNA-VGAP-026The Windows renderer families have no automatic native Windows execution: DIRECTX9 has no CI job and the DIRECTX11 lane is manualTesting & evidenceopenn/asource-verified
CNA-VGAP-027No workflow runs the roughly eighty SDL_Renderer_* renderer CTests, and they are not registered on Windows or EmscriptenTesting & evidenceopenn/asource-verified
CNA-VGAP-028Several XNB runtime readers are never exercised with externally produced files, although genuine XNA 4.0 outputs for some of them are already in the treeTesting & evidenceopenn/asource-verified
CNA-VGAP-029No fuzz target covers .cnj documents or the JSON parser, and .cnj files are read whole with no size boundTesting & evidenceopenn/asource-verified
CNA-VGAP-030Model drawing on VULKAN, SOFTWARE and the Direct3D renderers is checked in CI only at the stride draw boundary; the shared Model programs and the whole-corpus L7 rung run in CI for OPENGLES3 onlyTesting & evidenceopenn/asource-verified
CNA-VGAP-031The real-world Khronos comparison matrix passes on three renderers; the planned fourth (GLTF ROBUST row 12) is openTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-032Input behaviour on real hardware is unverified: the 15-task manual hardware checklist is blocked, and the focus-loss keyboard test checks only the bridge's accumulatorTesting & evidenceopenn/asource-verified
CNA-VGAP-033The three user-reported audio release blockers (high pitch, missing files, distortion) have never been compared against the original gameTesting & evidenceopenn/asource-verified
CNA-VGAP-034CNA's audio plan carries two undiagnosed test-suite crashes (AUD-15-021, AUD-15-022) that have not been re-run at this snapshotTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-035DynamicSoundEffectInstance's PendingBufferCount accounting is untested when the stream resamplesTesting & evidenceopenn/asource-verified
CNA-VGAP-036Android sensor conventions are unverified on hardware, and the default landscape remap is a reflection, not a rotationTesting & evidenceopenn/asource-verified
CNA-VGAP-037CNA::Devices extension tests use canned platforms or check only that the host call does not fail, and exist only in a CNA_DEVICES=ON buildTesting & evidenceopenn/asource-verified
CNA-VGAP-038No C++ storage test writes bytes through a StorageContainer stream and reads them backTesting & evidenceopenn/asource-verified
CNA-VGAP-039The process-spawning networking tests are compiled out on Windows, Emscripten, Android and iOS, and multi-machine behaviour has no test evidenceTesting & evidenceopenn/asource-verified
CNA-VGAP-041The CNA_STRICT_XNA_API purity check calls only the Microsoft::Devices sensor surface and one SamplerStateCollection indexerTesting & evidencenarrowedn/asource-verified
CNA-VGAP-044CnaTests' Wine test route does not prove which Direct3D implementation served a runTesting & evidenceopenn/asource-verified
CNA-VGAP-046No workflow runs the XNA reference-image corpus comparisons other than the EasyGL line pair, or the FNA value-differential harnessTesting & evidencenarrowedn/asource-verified
CNA-VGAP-047Test strength is never measured automatically: no coverage build, no scheduled fuzzing campaign and no mutation testingTesting & evidenceopenn/asource-verified
CNA-VGAP-049The XNA API census (331/331 types, 3,627/3,627 members) measures representation only and is a manually run scriptTesting & evidenceopenn/asource-verified
CNA-VGAP-051No CI configuration builds diagnostics at STATS or FULL or enables CNA_BUILD_INSPECTOR, so most Diagnostics tests and every Inspector test are never compiled in CIDiagnostics & Inspectoropenn/asource-verified
CNA-VGAP-052The Inspector's WebBridge security checks and Agent::Stop paths have no automated testDiagnostics & Inspectoropenn/asource-verified
CNA-VGAP-053No CI workflow builds the C API library or runs its testsC API & bindingsopenn/asource-verified
CNA-VGAP-054Destroying a caller-created GraphicsDevice while resources on it are still live is allowed by cna_graphics_device_destroy but untestedC API & bindingsopenn/asource-verified
CNA-VGAP-056The checked-in shader bytecode headers of VULKAN, SDL_GPU and the Direct3D renderers come from generators that no CTest or workflow runs and that have no --check modeTesting & evidenceopenn/asource-verified
CNA-VGAP-057EasyGL: a full-backbuffer SpriteBatch draw before a frame's first 3D draw is listed as open (Task 933) but has never been reproduced, and the reported scene is untestedTesting & evidenceopenn/asource-verified
CNA-VGAP-058No dedicated test drives the production audio shutdown path (static destruction of the SDL3 device at exit with callbacks in flight): the teardown tests call DestroyMixer, and plan item AUD-15-016 is uncheckedTesting & evidenceopenn/asource-verified
CNA-VGAP-059The VibrateController shutdown-ordering tests never open a haptic device or destroy a Game-owned SDL3 platform after SDL_Quit, and CNA's own plan keeps SDLCORE-011 open for that reasonTesting & evidenceopenn/asource-verified
CNA-VGAP-060HeadlessPlatform::InjectEvent, the display-free event seam, has no caller and no testPlatformsopenn/asource-verified