mirror of
https://github.com/mulgadc/spinifex.git
synced 2026-10-19 10:52:04 +00:00
Josh Siviour
12a1e4aedc
The GPU model table was only ever used to report VRAM, so wrong or missing entries were cosmetic. Bedrock's capacity check is the first code that rejects on VRAM, which turns every latent data error into an admission decision. Correct seven entries verified against pci.ids — most seriously 1002:7448, labelled Instinct MI300X at 192GB when it is a Radeon Pro W7900 at 48GB, a 4x over-report that admits a model which then OOMs at weight load. Record the smallest capacity where one PCI ID spans several cards, since under-reporting refuses an endpoint an operator can see and override while over-reporting fails later and looks like a vLLM bug. Widen the table so common datacenter, workstation and consumer cards resolve without an operator-supplied override, and apply GPUModelOverrides to the pool devices as well as the advertised model, so the override reaches the code that actually gates. An override with no memory_mib is left alone rather than wiping discovered VRAM, since the config cannot distinguish it from a deliberate zero. MemoryMiB 0 stays the "undiscoverable" sentinel, but checkCapacity no longer counts it as a device with no VRAM: an otherwise-free device now reports which card is unknown and how to fix it.