logo
Kurashizu Blogwhere ideas flow
  • Home
  • News
  • Blog
  • About
  • Home
  • News
  • Blog
  • About

© 2026 Kurashizu. All rights reserved.

Admin·New Post·Service Status
Powered by Cloudflare·30.10.26
← Back to news

Kolibri: A Sovereign Open-Weight Model

Original article
aleph-alpha.com|253 points|45 comments|by bastitx|Oct 3, 2026

Kolibri: A Sovereign Open-Weight Model

Released on the anniversary of German Reunification (October 3, 2026), Aleph Alpha has officially unveiled Kolibri, a new frontier in sovereign AI.

🛠️ Technical Architecture

Kolibri is engineered as an English-German Mixture-of-Experts (MoE) Transformer. Its architecture is designed for high efficiency, balancing a large knowledge base with lean execution.

MetricSpecification
Total Parameters78 Billion
Active Parameters3 Billion
LicenseApache 2.0
AvailabilityFull weights on Hugging Face

🚀 The Evolution of the Training Pipeline

Kolibri is not a standalone effort but the result of a rigorous, iterative development cycle. The team first established a robust training infrastructure by creating Kolibri Origin (a 30B total / 3B active model with a limited ≈65k\approx 65\text{k}≈65k token context window).

The pipeline was designed to be manual and fragile fully automated and resilient, ensuring that hardware failures or connectivity drops did not interrupt the process.

The Development Workflow

By investing heavily in this pipeline, Aleph Alpha significantly reduced the time between the release of Kolibri Origin and the current Kolibri model, while drastically increasing overall performance.


🛡️ Defining "Sovereignty"

For Aleph Alpha, sovereignty is not a buzzword but a dual-dimensional framework:

"Sovereignty combines two dimensions: how we built the model, and how it transfers to our customers."

The Sovereignty Checklist

  • Supply-Chain Integrity: Total transparency and accountability for every stage, from initial data ingestion to final evaluation.
  • Deployment Autonomy: Customers maintain full control over where the model is hosted and ensure their intellectual property remains secure.
  • Inherited Compliance: Because of the model's structure and deployment freedom, regulatory compliance is a built-in feature.

Kolibri is specifically tailored for mission-critical operations in highly regulated sectors, such as:

  • 🏛️ Public Administration
  • 🏭 Industrial Manufacturing
  • 🚀 Aerospace

📈 Performance and the Pareto Frontier

Kolibri is designed to optimize the trade-off between intelligence and operational overhead. In economic terms, it sits on the Pareto Frontier.

Pareto Frontier≈max⁡(Quality) given min⁡(Serving Cost)\text{Pareto Frontier} \approx \max(\text{Quality}) \text{ given } \min(\text{Serving Cost})Pareto Frontier≈max(Quality) given min(Serving Cost)

This means no other compared model provides higher quality at the same cost, nor the same quality at a lower cost. Because it only uses 3B active parameters, it can be run on-premise, eliminating the need to send sensitive data to external inference providers.

Foundational Benchmarks

Kolibri competes with models possessing up to four times its active parameter count (e.g., Nemotron 3 Super).

Performance Comparison Table (Scores on a 0–100 scale; higher is better)

BenchmarkKolibriKolibri OriginQwen3.6-35B-A3BNemotron 3 Super (120B-A12B)Mistral Small 4 (119B-A6B)
AIME 202596.981.984.691.779.8
AIME 2025 (DE)87.573.582.985.672.3
AIME 202696.081.591.090.483.1
AIME 2026 (DE)90.075.284.487.578.5
GPQA (diamond)84.368.183.478.074.7
GPQA (diamond, DE)81.358.580.676.672.9
AA-Omniscience Index-32.8-64.0-15.3-36.5-24.0
BrowseComp29.44.426.929.1—
τ3\tau^3τ3-bench banking38.15.710.615.55.7
τ2\tau^2τ2-bench retail69.958.571.667.562.9
τ2\tau^2τ2-bench airline76.758.770.772.740.0
τ2\tau^2τ2-bench telecom94.767.599.168.141.5
BFCL v4 overall61.436.467.261.058.0
LiveCodeBench v685.959.282.582.071.2
HumanEval+92.776.892.894.792.8
LongBench Pro64.5—70.862.956.4
AA-LCR68.3—69.767.052.3

Summary of Capabilities

Kolibri acts as a balanced generalist, providing competitive results across several key domains:

  1. Mathematics & Coding: High proficiency in AIME and HumanEval+.
  2. Knowledge: Strong performance in GPQA (both English and German).
  3. Agentic Behavior: Specialized for banking, retail, and telecom workflows.
  4. Long Context: Capable of handling extensive documents via AA-LCR.

Model Performance Visualization Placeholder Figure 1: Performance vs. throughput for post-trained models in English and German.

While public benchmarks provide a baseline, Aleph Alpha continues to develop internal evaluation suites to better reflect the nuanced requirements of their professional vertical customers.