#мoe
-
Tencent Releases Open MoE Model Hy3 with 295 Billion Parameters
Tencent has unveiled the Hy3 language model under the Apache 2.0 license, which, according to its developers, outperforms models in its class and comes close to flagship open-source solutions with substantially larger parameter counts.