Verification gaps

CNA snapshot 3b43bd86  ·  Known Issues › Verification gaps  ·  source links pinned to 3b43bd86

✓

Evidence basis: source-verified at the pinned commit. Claims on this page were checked by reading the CNA source at commit 3b43bd86; unless a sentence says otherwise, nothing here was built or executed.

An implementation exists, but the evidence that it behaves correctly is insufficient. Every entry below exists at CNA 3b43bd86; open an entry for its expected and actual behaviour, source locations, evidence and blast radius.

44 entries

IDTitleSubsystemStatusSeverityEvidence basis
CNA-VGAP-001Matrix camera builders have no XNA oracle and no full-matrix value testMath & geometryopenn/asource-verified
CNA-VGAP-002BoundingSphere::CreateFromBoundingBox and the SmoothStep/Hermite/CatmullRom helpers use different arithmetic from XNA 4.0, and no oracle measures last-bit agreementMath & geometryopenn/asource-verified
CNA-VGAP-003No test pins EffectParameter's divergences for CNA-constructed parameters, including a SetValue(Texture*) that GetValueTexture2D() does not read backGraphics & renderersopenn/asource-verified
CNA-VGAP-005The XNA audio facade on CNA's own ALSA mixer is covered by seven facade tests plus the XACT category suite; the SoundEffect, instance, dynamic-instance, Cue, SoundBank and WaveBank suites run only on SDL3Audio & mediaopenn/asource-verified
CNA-VGAP-006Media paths without tests: the natural song end on SDL3_mixer, the failed visualization install and SavePicture's IOExceptionAudio & medianarrowedn/asource-verified
CNA-VGAP-007The SDL3 camera provider and file-dialog result path have no test that drives them, and the tray is tested only against a stand-in SDLPlatformsnarrowedn/asource-verified
CNA-VGAP-008Android and iOS have no device evidence at this snapshot: no Android workflow, iOS only in the Simulator, and lifecycle and packaged-content loading untested on a devicePlatformsopenn/asource-verified
CNA-VGAP-011No test exercises PlatformSelection.cmake's reserved-identifier refusal pathsBuild & CInarrowedn/asource-verified
CNA-VGAP-013No gate checks include reachability or compiles each public C++ header aloneBuild & CInarrowedn/asource-verified
CNA-VGAP-014The physical source-partition validator checks only *.cpp/*.mm path prefixes, so headers, C sources and a TU in a renderer's src/ subdirectory (never compiled) all pass itBuild & CIopenn/asource-verified
CNA-VGAP-015CNA records and checks no easy-gl or meta-gl revision, although the snapshot needs meta-gl 20c8b2dc or later and easy-gl deda7a42 or laterBuild & CIopenn/asource-verified
CNA-VGAP-016A plain ctest run of the tests preset is not a trustworthy resultTesting & evidencenarrowedn/arecorded by CNA
CNA-VGAP-019The HEADLESS native-SDK-free link-closure gates run in no CI jobTesting & evidencenarrowedn/asource-verified
CNA-VGAP-020The hand-written CnaPlatformTests filter misses TerminalPresenterThroughPlatformTest and nine other platform suites, so the platform CI cells never select themTesting & evidenceopenn/asource-verified
CNA-VGAP-021No SpriteFont/DrawString pixel test exists for DIRECTX9 or FNA3DTesting & evidencenarrowedn/asource-verified
CNA-VGAP-022No test measures presentation cadence: PresentInterval::Two against ordinary vsyncTesting & evidenceopenn/asource-verified
CNA-VGAP-023No browser renderer path is executed automatically: WEBGL2 has no test registrations and no workflow runs a renderer in a browserTesting & evidenceopenn/asource-verified
CNA-VGAP-025WEBGPU and SDL_GPU run in CI only through subsystem suites and a macOS smoke set; their renderer suites run only on CNA's own runnerTesting & evidencenarrowedn/asource-verified
CNA-VGAP-026The Windows renderer routes have no automatic native Windows execution: the DIRECTX9 and SDL_GPU legs of the Windows workflow are manualTesting & evidenceopenn/asource-verified
CNA-VGAP-028Several XNB runtime readers are never exercised with externally produced files, although genuine XNA 4.0 outputs for some of them are already in the treeTesting & evidenceopenn/asource-verified
CNA-VGAP-029No fuzz target covers .cnj documents or the JSON parser, and .cnj files are read whole with no size boundTesting & evidenceopenn/asource-verified
CNA-VGAP-030Model drawing on SOFTWARE, SDL_GPU, WEBGPU, FNA3D and DIRECTX9 is checked in CI at most at the stride draw boundary; the shared Model programs and the whole-corpus L7 rung run in CI for OPENGLES3 onlyTesting & evidenceopenn/asource-verified
CNA-VGAP-031The real-world Khronos comparison matrix passes on one surviving renderer; GLTF ROBUST row 12 needs fourTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-032Input behaviour on real hardware is unverified: the 15-task manual hardware checklist is blocked, and the focus-loss keyboard test checks only the bridge's accumulatorTesting & evidenceopenn/asource-verified
CNA-VGAP-033The three user-reported audio release blockers (high pitch, missing files, distortion) have never been compared against the original gameTesting & evidenceopenn/asource-verified
CNA-VGAP-034CNA's audio plan carries two undiagnosed test-suite crashes (AUD-15-021, AUD-15-022) that have not been re-run at this snapshotTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-035DynamicSoundEffectInstance's PendingBufferCount accounting is untested when the stream resamplesTesting & evidenceopenn/asource-verified
CNA-VGAP-036Android sensor conventions are unverified on hardware, and the default landscape remap is a reflection, not a rotationTesting & evidenceopenn/asource-verified
CNA-VGAP-037CNA::Devices extension tests use canned platforms or check only that the host call does not fail, and exist only in a CNA_DEVICES=ON buildTesting & evidenceopenn/asource-verified
CNA-VGAP-039The process-spawning networking tests are compiled out on Windows, Emscripten, Android and iOS, and multi-machine behaviour has no test evidenceTesting & evidenceopenn/asource-verified
CNA-VGAP-041The CNA_STRICT_XNA_API purity check calls only the Microsoft::Devices sensor surface and one SamplerStateCollection indexerTesting & evidencenarrowedn/asource-verified
CNA-VGAP-044CnaTests' Wine test route does not prove which Direct3D implementation served a runTesting & evidenceopenn/asource-verified
CNA-VGAP-046No automatic workflow runs the XNA reference-image corpus comparisons other than the EasyGL line pair, or the FNA value-differential harnessTesting & evidencenarrowedn/asource-verified
CNA-VGAP-047Test strength is never measured automatically: no coverage build, no scheduled fuzzing campaign and no mutation testingTesting & evidenceopenn/asource-verified
CNA-VGAP-049The XNA API census (331/331 types, 3,627/3,627 members) measures representation only and is a manually run scriptTesting & evidenceopenn/asource-verified
CNA-VGAP-051No CI configuration builds diagnostics at STATS or FULL or enables CNA_BUILD_INSPECTOR, so most Diagnostics tests and every Inspector test are never compiled in CIDiagnostics & Inspectoropenn/asource-verified
CNA-VGAP-052The Inspector's WebBridge security checks and Agent::Stop paths have no automated testDiagnostics & Inspectoropenn/asource-verified
CNA-VGAP-053No CI workflow builds the C API library or runs its testsC API & bindingsopenn/asource-verified
CNA-VGAP-054Destroying a caller-created GraphicsDevice while resources on it are still live is allowed by cna_graphics_device_destroy but untestedC API & bindingsopenn/asource-verified
CNA-VGAP-056The checked-in shader bytecode headers of SDL_GPU and DIRECTX9 come from generators that no CTest or workflow runs and that have no --check modeTesting & evidenceopenn/asource-verified
CNA-VGAP-057EasyGL Task 933 (a full-backbuffer SpriteBatch draw breaking that frame's 3D rendering) rests on one recorded sample run: no test reproduces the reported scene, and the migration guide still lists it as openTesting & evidencenarrowedn/asource-verified
CNA-VGAP-059The VibrateController shutdown-ordering tests never open a haptic device or destroy a Game-owned SDL3 platform after SDL_Quit, and CNA's own plan keeps SDLCORE-011 open for that reasonTesting & evidenceopenn/asource-verified
CNA-VGAP-060HeadlessPlatform::InjectEvent, the display-free event seam, has no caller and no testPlatformsopenn/asource-verified
CNA-VGAP-061SDL_GPU is the default renderer on Windows, macOS and iOS but is not qualified thereTesting & evidenceopenn/arecorded by CNA