MiMo-V2.6-Flash VRAM requirements: about 217 GB at Q4 and 1M context

How this is calculated

The published Flash configuration has 48 layers and hidden size 4,096. Nine layers use global attention with four KV heads. The other 39 use a 128-token sliding window with eight KV heads. Both use 192-wide keys and 128-wide values. Using one head count for the entire model would size one of those groups incorrectly, so the preset tracks their widths separately. The global cache grows with context, while local buffers stop at the window size. At 32,768 tokens their combined FP16 cache is about 0.78 GB, producing a 191.20 GB total. At 1,048,576 tokens the total reaches 216.95 GB, or about 202.05 GiB. Q4_K_M uses an approximate 0.56-byte weight factor. That scenario doesn't reproduce the exact precision mix of Xiaomi's release, and the general runtime allowance doesn't separately model image/audio activations or the optional five-layer speculative decoder.

Verdict

MiMo Flash is much easier to place in memory than Pro, but its all-resident weights still exceed ordinary single-GPU capacity. Three nominal 80 GB GPUs offer 240 GB in aggregate, which exceeds this estimate on paper. That comparison doesn't guarantee a valid three-way tensor split, enough memory on each shard, or a compatible serving kernel. Select the runtime and checkpoint first, inspect its parallelism constraints, and measure the workload before treating the aggregate memory figure as a deployment plan.