Models / DeepSeek-V2generated from capability-matrix.json
DeepSeek-V2
DeepSeek-V2 and V2-Lite: a compressed attention cache plus experts.
chatexperts: sparse +sharedsafetensors, GGUF
Get it
No vetted checkpoint yet. You can pull any GGUF of this family by repo and quant. goinfer checks it fits before downloading, but nobody here has timed it.
goinfer-chat pull <owner>/<repo>:<quant>What hasn't been shown
- No vetted checkpoint, so there's no fit verdict, no speed and no tool-calling result for this family.
How sure we are
Against the released model100.0%
picks the same next token as HuggingFace
0.99924
closest the raw scores get at their worst position (cosine, 1.00000 is identical; bar starts at 0.95)
real-oracle 100.0%/0.99924 · what parity-gated means
Measured speed · decode, tokens per second
not measured — no vetted checkpoint to measure
Architecture, for the curious
- model_type
- deepseek_v2
- design
- latent-KV (MLA)
- experts
- sparse +shared
- attention window
- none
- QK-norm
- no
- RoPE
- partial
- norm
- RMSNorm, pre-norm
- activation
- SwiGLU
- tied head
- no
- modality
- text
- GPU-resident
- eligible
registry description: DeepSeek-V2/V2-Lite: MLA + DeepSeekMoE (softmax routing)