# MBZUAI Releases K2 Horizon Open Models Up to 375B Parameters

On September 3, 2026, the Institute of Foundation Models at MBZUAI (Mohamed bin Zayed University of Artificial Intelligence) released K2 Horizon, a comprehensive suite of six Apache 2.0-licensed models spanning 900M, 3.7B, 7B, 32B, 36B-A4B, and 375B-A23B parameters. Positioned by researchers as the largest fully open AI release in machine learning history, the project delivers an unprecedented level of transparency by publishing unquantized neural weights, pre-training source code, data curation recipes, filtering heuristics, and evaluation pipelines under unrestricted commercial licensing terms.

The K2 Horizon deployment arrives during what machine learning economists describe as a decisive turning point for open-weight foundation models. Over the summer of 2026, labs across China and Europe released capable open models, including Alibaba's Qwen series, DeepSeek-V3, and Zhipu's GLM family. However, the majority of contemporary open releases function under modified licenses that restrict commercial thresholds, withhold pre-training datasets, or conceal reinforcement learning methodologies. By contrast, MBZUAI's publication of full data curation pipelines and unencumbered Apache 2.0 terms establishes a transparent benchmark that allows enterprise engineering teams to inspect the underlying corpus for copyright liabilities, synthetic data ratios, and domain representation.

At the top of the spectrum, the 375B-A23B flagship incorporates a fine-grained Mixture-of-Experts (MoE) architecture that routes each token through 23B active parameters out of 375B total weights. This sparse execution paradigm allows the model to compete directly with proprietary frontier giants like Claude Opus 5 and GPT-6 Astra across code generation, mathematics, and multi-step reasoning, while reducing inference memory bandwidth constraints. At the opposite end, the 900M and 3.7B dense variants deliver sub-10 millisecond token latency on standard workstation hardware and mobile edge processors, creating a unified architectural family that spans resource-constrained consumer devices to multi-node sovereign data centers.

 <a aria-hidden="true" id="executive-fast-facts"></a>  Fast Facts 

- **Release Date:** September 3, 2026
- **Model Family Matrix:** Six distinct configurations: 900M, 3.7B, 7B, 32B dense architectures, plus 36B-A4B (4B active) and 375B-A23B (23B active) MoE variants
- **Licensing Standard:** Full Apache 2.0 (unconditional commercial rights, modification, and redistribution)
- **Transparency Level:** Comprehensive disclosure of model weights, pre-training corpus ratios, synthetic generation recipes, and evaluation code
- **Flagship Architecture:** 375B-A23B Mixture-of-Experts activating 23B parameters per forward pass across dynamic router gates
- **Primary Objective:** Deliver an open, commercially viable foundation layer to eliminate enterprise dependence on proprietary frontier APIs
 

## K2 Horizon Architecture and Open Weight Governance

The structural design of the K2 Horizon model family reflects significant maturation in large-scale model pre-training, balancing raw parameter capacity against the mechanical realities of enterprise inference economics. The suite is divided into two primary architectural paradigms: dense autoregressive models designed for deterministic low-latency execution, and sparse Mixture-of-Experts networks optimized for frontier reasoning throughput.

The dense tier encompasses the 900M, 3.7B, 7B, and 32B configurations. These models utilize grouped-query attention (GQA) with rotary position embeddings (RoPE), enabling long-context stability across 128K token windows without catastrophic memory fragmentation. The 900M parameter model is specifically calibrated for on-device embedding generation, edge classification, and real-time input parsing, requiring less than 2GB of VRAM when quantized to FP8 or INT4 precision. Meanwhile, the 7B and 32B variants serve as workhorse enterprise engines, designed to execute high-volume text summarization, internal search re-ranking, and structured information extraction within single-GPU server instances.

The frontier capabilities of K2 Horizon reside in its two Mixture-of-Experts implementations: the 36B-A4B intermediate model and the 375B-A23B flagship. In the 375B-A23B architecture, MBZUAI adopted a fine-grained expert routing mechanism inspired by modern sparse neural scaling laws. Rather than employing a small number of monolithic experts, the model partitions its feed-forward layers into 128 smaller expert pathways, routing incoming tokens to the top 8 experts through a learned auxiliary-loss-free gating network. This design ensures that while the model maintains a massive parametric memory of 375B weights for broad world knowledge, each individual token only activates 23B parameters during forward computation.

This sparse routing strategy cuts floating-point operations (FLOPs) per token by approximately 85% compared to an equivalent 375B dense network, enabling high-throughput deployment across clusters of standard NVIDIA H100 or H200 accelerators. In addition, because MBZUAI released the complete pre-training data composition, organizations operating in regulated environments can verify that the 15-trillion-token training corpus was filtered using rigorous deduplication algorithms, language-specific classifiers, and strict PII removal pipelines. This level of auditability provides legal and compliance teams with unprecedented assurance compared to closed models operating behind proprietary black-box APIs.

## Open Model Release Comparison (2026)

The table below contrasts K2 Horizon against other prominent open-weight releases across model capacity, licensing constraints, and data transparency:

| Model | Parameters | License | Training Data Published | Code Published | Commercial Use |
|---|---|---|---|---|---|
| **K2 Horizon 375B** (MBZUAI) | 375B (23B active) | Apache 2.0 | Yes | Yes | Yes (Unrestricted) |
| **K2 Horizon 36B** (MBZUAI) | 36B (4B active) | Apache 2.0 | Yes | Yes | Yes (Unrestricted) |
| **Qwen3.8-2.4T** (Alibaba) | 2.4T (95B active) | Apache 2.0 | Partial | Yes | Yes (Unrestricted) |
| **Kimi K3** (Moonshot AI) | Undisclosed | Proprietary | No | No | Commercial License Required |
| **GLM-5.3-Flash** (Zhipu) | Undisclosed | Proprietary | No | Partial | Yes (With Limits) |
| **Llama 4** (Meta) | 405B | Llama License | No | Yes | Yes (Under 700M MAU) |
| **Muse Spark 1.3** (Meta) | Undisclosed | Proprietary | No | No | Cloud Service Only |

## Real-World Utility &amp; Policy Implementation

Deploying open foundation models within private enterprise infrastructure requires shifting focus from prompt engineering to infrastructure sizing, quantization trade-offs, and continuous domain alignment. Because K2 Horizon provides unrestricted access to model weights and architecture code, organizations can self-host models entirely within private clouds, virtual private clouds (VPCs), or on-premises data centers, eliminating data egress and third-party data retention concerns.

### The 4-Step Open Model Adoption Playbook

1. **Conduct Workload-to-Parameter Mapping:** Align specific business requirements with K2 Horizon parameter tiers to prevent compute waste. Deploy the 900M and 3.7B dense models for client-side edge tasks, mobile assistants, and local document indexing. Reserve the 7B and 32B models for standard operational pipelines such as customer support classification, knowledge base querying, and internal code reviews. Deploy the 375B-A23B MoE engine exclusively for complex reasoning, multi-file software engineering, and mission-critical synthesis.
2. **Audit Training Data Recipes for Legal Clearance:** Utilize MBZUAI's published dataset documentation to perform intellectual property and data governance reviews. Legal and compliance teams can inspect the exact training proportions, web scrape filters, and synthetic data pipelines used during pre-training. This documentation satisfies rigorous risk management standards under the EU AI Act and national copyright frameworks, providing defensibility that proprietary API providers refuse to grant.
3. **Execute Parameter-Efficient Domain Fine-Tuning:** Rather than attempting full-parameter fine-tuning on the massive 375B flagship, implement parameter-efficient fine-tuning (PEFT) techniques such as QLoRA or Low-Rank Adaptation (LoRA) targeting the attention projection matrices and MoE gating networks. Fine-tune on internal enterprise knowledge bases, legal precedents, or clinical records to achieve specialized domain mastery while preserving the model's generalized foundational reasoning.
4. **Establish Self-Hosted Runtime Monitoring and Guardrails:** When self-hosting open models, the responsibility for content moderation, jailbreak defense, and hallucination control rests entirely with internal infrastructure engineers. Deploy dedicated runtime guardrail proxies (such as vLLM with integrated logit bias filters or NeMo Guardrails) in front of model endpoints. Monitor token generation latency, memory cache fragmentation, and token output distributions to ensure predictable production reliability.

  Next Steps 

1. **Benchmark the 375B-A23B Model on Domain Workloads:** Stand up an evaluation instance of the K2 Horizon 375B-A23B model using optimized serving frameworks like vLLM, TensorRT-LLM, or SGLang on dedicated GPU infrastructure. Measure task accuracy against current proprietary API endpoints across proprietary test sets to determine whether self-hosting provides an advantageous cost-to-performance ratio.
2. **Evaluate Edge Efficiency with the 900M Dense Variant:** Pilot the 900M parameter model for local client-side workflows, offline mobile environments, or latency-sensitive classification pipelines. With FP8 quantization, the model can execute within constrained device memory budgets, eliminating API network round-trips and lowering recurring cloud inference bills.
3. **Formalize Open-Weight Governance and Audit Documentation:** Integrate K2 Horizon's transparent training documentation into corporate AI compliance archives. Ensure that legal, security, and technology procurement teams log model provenance, Apache 2.0 license adherence, and private hosting configurations to maintain compliance readiness for internal and external regulatory audits.