Models / Qwen2-MoEgenerated from capability-matrix.json
Qwen2-MoE
Qwen1.5 and Qwen2 mixture-of-experts.
chatexperts: sparse +sharedsafetensors, GGUF
Get it
No vetted checkpoint yet. You can pull any GGUF of this family by repo and quant. goinfer checks it fits before downloading, but nobody here has timed it.
goinfer-chat pull <owner>/<repo>:<quant>What hasn't been shown
- No vetted checkpoint, so there's no fit verdict, no speed and no tool-calling result for this family.
How sure we are
Against the released model100.0%
picks the same next token as HuggingFace
0.99954
closest the raw scores get at their worst position (cosine, 1.00000 is identical; bar starts at 0.95)
real-oracle 100.0%/0.99954 · what parity-gated means
Measured speed · decode, tokens per second
not measured — no vetted checkpoint to measure
Architecture, for the curious
- model_type
- qwen2_moe
- design
- softmax-GQA
- experts
- sparse +shared
- attention window
- none
- QK-norm
- no
- RoPE
- full
- norm
- RMSNorm, pre-norm
- activation
- SwiGLU
- tied head
- no
- modality
- text
- GPU-resident
- eligible
registry description: Qwen1.5/2 MoE (sparse + always-on shared expert)