News Brief3 min read
Tencent Open-Sources Hy4 Preview: 770B MoE Foundation Model with 1M Context
Tencent has open-sourced Hy4 Preview, a 770-billion parameter Mixture-of-Experts model activating 49B parameters per token with a 1M token context window on Hugging Face.