Verification gaps

CNA snapshot 009d40f5  ·  Known Issues › Verification gaps  ·  source links pinned to 009d40f5

✓

Evidence basis: source-verified at the pinned commit. Claims on this page were checked by reading the CNA source at commit 009d40f5; unless a sentence says otherwise, nothing here was built or executed.

An implementation exists, but the evidence that it behaves correctly is insufficient. Every entry below exists at CNA 009d40f5; open an entry for its expected and actual behaviour, source locations, evidence and blast radius.

56 entries

IDTitleSubsystemStatusSeverityEvidence basis
CNA-VGAP-001Matrix camera builders have no XNA oracle and no full-matrix value testMath & geometryopenn/asource-verified
CNA-VGAP-002BoundingSphere::CreateFromBoundingBox and the SmoothStep/Hermite/CatmullRom helpers use different arithmetic from XNA 4.0, and no oracle measures last-bit agreementMath & geometryopenn/asource-verified
CNA-VGAP-003No test pins EffectParameter's divergences for CNA-constructed parameters, including a SetValue(Texture*) that GetValueTexture2D() does not read backGraphics & renderersopenn/asource-verified
CNA-VGAP-004The Linux evdev controller-mapping reader is tested only on hand-written entries in CI; the real-database test always skipsInputopenn/asource-verified
CNA-VGAP-005The XNA audio facade on CNA's own ALSA mixer is covered by seven facade tests plus the XACT category suite; the SoundEffect, instance, dynamic-instance, Cue, SoundBank and WaveBank suites run only on SDL3Audio & mediaopenn/asource-verified
CNA-VGAP-006Media paths without tests: the natural song end on SDL3_mixer, the failed visualization install, MediaLibrary accessors after Dispose and SavePicture's IOExceptionAudio & mediaopenn/asource-verified
CNA-VGAP-007The SDL3 camera provider, system-tray icon and file-dialog result path have no test that drives themPlatformsopenn/asource-verified
CNA-VGAP-008Android and iOS have no device evidence at this snapshot: no Android workflow, one iOS simulator frame, and lifecycle and packaged-content loading untested on a devicePlatformsopenn/asource-verified
CNA-VGAP-009GraphicsDeviceManager's iOS/Android back-buffer orientation branch has no testPlatformsopenn/asource-verified
CNA-VGAP-010No CI workflow builds or tests the OPENGL4 rendererBuild & CIopenn/asource-verified
CNA-VGAP-011No test exercises PlatformSelection.cmake's reserved-identifier and unknown-name refusal pathsBuild & CIopenn/asource-verified
CNA-VGAP-012No CI workflow selects CNA_PLATFORM=WAYLAND, so the native Wayland backend's suites run only on a developer's machineBuild & CIopenn/asource-verified
CNA-VGAP-013No gate checks include reachability or compiles each public C++ header alone; the two scripts that did are stale campaign tools wired to nothingBuild & CIopenn/asource-verified
CNA-VGAP-014The physical source-partition validator checks only *.cpp/*.mm path prefixes, so headers, C sources and a TU in a renderer's src/ subdirectory (never compiled) all pass itBuild & CIopenn/asource-verified
CNA-VGAP-015CNA records and checks no easy-gl or meta-gl revision, although the snapshot needs meta-gl 20c8b2dc or later and easy-gl deda7a42 or laterBuild & CIopenn/asource-verified
CNA-VGAP-016A plain ctest run of the tests preset is not a trustworthy resultTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-017graphics-ext shader-package drift guards have holes: no reproducibility check for shadow_caster, none run in CI, desktop clustered-forward fragment unpinnedTesting & evidenceopenn/asource-verified
CNA-VGAP-018No test asserts RenderPipeline's fixed post-process order; the order-named tests only count passesTesting & evidenceopenn/asource-verified
CNA-VGAP-019ModuleLinkClosure_* link-closure gates report CTest SKIP in every Ninja tree, so no Ninja-preset run and no CI job ever evaluates themTesting & evidenceopenn/asource-verified
CNA-VGAP-020The hand-written CnaPlatformTests filter misses TerminalPresenterThroughPlatformTest and eight other platform suites, so the platform CI cells never select themTesting & evidenceopenn/asource-verified
CNA-VGAP-021No SpriteFont/DrawString pixel test exists for DIRECTX9, DIRECT2D, GDI, METAL, CANVAS, SVG_DOM, PORTABLEGL or FNA3DTesting & evidenceopenn/asource-verified
CNA-VGAP-022No test measures presentation cadence: PresentInterval::Two against ordinary vsync, or Vulkan's FIFO_RELAXED late-frame behaviourTesting & evidenceopenn/asource-verified
CNA-VGAP-023Most browser renderer paths are never executed automatically: WEBGL1/WEBGL2 have no test registrations, CANVAS has no registered browser run, and SVG_DOM runs only through a manual scriptTesting & evidenceopenn/asource-verified
CNA-VGAP-024METAL's CI lane proves construction, clear/present and capability reporting but no representative 3D pixelsTesting & evidenceopenn/asource-verified
CNA-VGAP-025No CI workflow selects WEBGPU or SDL_GPU; WebGPU evidence is local Linux and scripted headless Chrome, and SDL_GPU's Direct3D 12 and Metal driver routes have no native execution evidenceTesting & evidenceopenn/asource-verified
CNA-VGAP-026The Windows renderer families have no automatic native Windows execution: DIRECTX9 has no CI job, the DIRECTX11/12, DIRECT2D and GDI lanes are manual, and Direct2D's release gate is blockedTesting & evidenceopenn/asource-verified
CNA-VGAP-027No workflow runs the roughly eighty SDL_Renderer_* renderer CTests, and they are not registered on Windows or EmscriptenTesting & evidenceopenn/asource-verified
CNA-VGAP-028Several XNB runtime readers are never exercised with externally produced files, although genuine XNA 4.0 outputs for some of them are already in the treeTesting & evidenceopenn/asource-verified
CNA-VGAP-029No fuzz target covers .cnj documents or the JSON parser, and .cnj files are read whole with no size boundTesting & evidenceopenn/asource-verified
CNA-VGAP-030Model drawing on VULKAN, SOFTWARE and the Direct3D renderers is checked in CI only at the stride draw boundary; the shared Model programs and the whole-corpus L7 rung run in CI for OPENGLES3 onlyTesting & evidenceopenn/asource-verified
CNA-VGAP-031The real-world Khronos comparison matrix passes on three renderers; the planned fourth (GLTF ROBUST row 12) is openTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-032Input behaviour on real hardware is unverified: the 15-task manual hardware checklist is blocked, and the focus-loss keyboard test checks only the bridge's accumulatorTesting & evidenceopenn/asource-verified
CNA-VGAP-033The three user-reported audio release blockers (high pitch, missing files, distortion) have never been compared against the original gameTesting & evidenceopenn/asource-verified
CNA-VGAP-034CNA's audio plan carries two undiagnosed test-suite crashes (AUD-15-021, AUD-15-022) that have not been re-run at this snapshotTesting & evidenceopenn/arecorded by CNA
CNA-VGAP-035DynamicSoundEffectInstance's PendingBufferCount accounting is untested when the stream resamplesTesting & evidenceopenn/asource-verified
CNA-VGAP-036Android sensor conventions are unverified on hardware, and the default landscape remap is a reflection, not a rotationTesting & evidenceopenn/asource-verified
CNA-VGAP-037CNA::Devices extension tests use canned platforms or check only that the host call does not fail, and exist only in a CNA_DEVICES=ON buildTesting & evidenceopenn/asource-verified
CNA-VGAP-038No C++ storage test writes bytes through a StorageContainer stream and reads them backTesting & evidenceopenn/asource-verified
CNA-VGAP-039The process-spawning networking tests are compiled out on Windows, Emscripten, Android and iOS, and multi-machine behaviour has no test evidenceTesting & evidenceopenn/asource-verified
CNA-VGAP-040Avatar rendering evidence uses a synthetic one-bone quad; no renderer test draws the bundled 19-bone avatar contentTesting & evidenceopenn/asource-verified
CNA-VGAP-041The CNA_STRICT_XNA_API purity check compiles only the Microsoft::Devices sensor surfaceTesting & evidenceopenn/asource-verified
CNA-VGAP-042FREEDIRECT is built and tested by no workflow, has been verified on Linux only, and its free-direct and free-api siblings are unpinnedTesting & evidenceopenn/asource-verified
CNA-VGAP-044Wine test routes and the DIRECTX12 Proton route do not prove which Direct3D or Direct2D implementation served a runTesting & evidenceopenn/asource-verified
CNA-VGAP-046No workflow runs the XNA reference-image corpus comparisons or the FNA value-differential harness, and the one reachable image check runs in a workflow that installs no PillowTesting & evidenceopenn/asource-verified
CNA-VGAP-047Test strength is never measured automatically: no coverage build, no scheduled fuzzing campaign, and the Direct2D mutation checker only dry-runsTesting & evidenceopenn/asource-verified
CNA-VGAP-049The XNA API census (331/331 types, 3,627/3,627 members) measures representation only and is a manually run scriptTesting & evidenceopenn/asource-verified
CNA-VGAP-051No CI configuration builds diagnostics at STATS or FULL or enables CNA_BUILD_INSPECTOR, so most Diagnostics tests and every Inspector test are never compiled in CIDiagnostics & Inspectoropenn/asource-verified
CNA-VGAP-052The Inspector's WebBridge security checks and Agent::Stop paths have no automated testDiagnostics & Inspectoropenn/asource-verified
CNA-VGAP-053No CI workflow builds the C API library or runs its testsC API & bindingsopenn/asource-verified
CNA-VGAP-054Destroying a caller-created GraphicsDevice while resources on it are still live is allowed by cna_graphics_device_destroy but untestedC API & bindingsopenn/asource-verified
CNA-VGAP-055Process exit with live EasyGL-family resources whose creating thread has already ended is untested; a binding recorded SIGABRT on an earlier CNA revisionC API & bindingsopenn/ainferred (probable)
CNA-VGAP-056The checked-in shader bytecode headers of VULKAN, SDL_GPU and the Direct3D renderers come from generators that no CTest or workflow runs and that have no --check modeTesting & evidenceopenn/asource-verified
CNA-VGAP-057EasyGL: a full-backbuffer SpriteBatch draw before a frame's first 3D draw is listed as open (Task 933) but has never been reproduced, and the reported scene is untestedTesting & evidenceopenn/asource-verified
CNA-VGAP-058No dedicated test drives the production audio shutdown path (static destruction of the SDL3 device at exit with callbacks in flight): the teardown tests call DestroyMixer, and plan item AUD-15-016 is uncheckedTesting & evidenceopenn/asource-verified
CNA-VGAP-059The VibrateController shutdown-ordering tests never open a haptic device or destroy a Game-owned SDL3 platform after SDL_Quit, and CNA's own plan keeps SDLCORE-011 open for that reasonTesting & evidenceopenn/asource-verified
CNA-VGAP-060HeadlessPlatform::InjectEvent, the display-free event seam, has no caller and no testPlatformsopenn/asource-verified