Deep Dive6 min read
K2 Horizon Deep Dive: Inside MBZUAI's 375B MoE Flagship and the True Open-Source Benchmark
MBZUAI and IFM have open-sourced K2-Horizon-375B-A23B under Apache 2.0, providing weights, code, and pre-training data alongside a 524K context window and 87% GPQA score.