#mixture-of-experts
-
DeepSeek-V4.1 Flash: Squeezing the KV Cache Fourfold for Long Context
A technical breakdown of the new DeepSeek model, whose main goal is not better quality but a radical compression of the key-value cache. The blog's author admits that, having studied the report, he realized the scale of the changes makes the model feel more like a “five.”
-
Qwen prepares the Flash-Next model: 125 billion parameters with 6 billion active
A page for a new language model in the Qwen family — Flash-Next — has been spotted on the ModelScope platform; judging by the name, its release is expected very soon.