IFM/K2-Horizon-375B-A23B

One-line: Flagship of IFM’s fully-open K2 Horizon fleet (Sept 3, 2026) — frontier-class agentic tool use at 23B active params, with weights, training data, code, and intermediate checkpoints all published; ⚠ large (375B total, ~750GB BF16).

⚠ All scores are lab-reported (IFM model card tables). No independent benchmark (Artificial Analysis / LMArena) published yet; The New Stack and independent reviewers note self-reported figures only. IFM’s launch blog also carries a self-audit that revised Terminal-Bench 2.1 from 70.2 → 66.9 after a reward-hacking/verification audit.

Coding benchmarks

BenchmarkScoreSource
HumanEval——
HumanEval+——
MBPP——
LiveCodeBench——
Aider polyglot——
SWE-bench Verified——
SWE Bench Pro (strict)42.6lab-reported
SWE-Atlas-QnA (strict)48.4lab-reported
Terminal-Bench 2.170.2 (66.9 audited)lab-reported
SciCode42.7lab-reported

Agentic / tool-use benchmarks

BenchmarkScoreSource
BFCL——
τ-Bench——
τ³-Banking34.0lab-reported
Toolathlon Verified65.3lab-reported
MCPMark67.7lab-reported
Automation Bench Public25.3lab-reported
Apex-Agents (pass@1)24.8lab-reported
BrowseComp72.8lab-reported
WildClawBench50.9lab-reported
GDPVal-AA (Elo)1,441lab-reported
ToolACE——
GAIA——

Reasoning (context only)

BenchmarkScoreSource
MMLU / MMLU-Pro——
GPQA Diamond87.3lab-reported
MATH——
AIME 2025——
Humanity’s Last Exam (no tools)32.0lab-reported
AA-LCR (long-context)76.0lab-reported

Efficiency

  • Active params: 23B (total 375B, 192 experts / 8 per token, 1 shared)
  • Context length: 524,288 tokens (512K, native from midtraining)
  • VRAM (fp16 rough): ⚠ large — ~750 GB (BF16); FP8 variant (~375GB) and 8×H200 vLLM/SGLang recipes provided. Not single-GPU; consumer use needs heavy quantization or API.

What makes it notable

  • Largest fully-open launch to date: weights + 15T-token pretraining data + training code + W&B logs + intermediate checkpoints (LLM360 lineage — IFM/Abu Dhabi, ex-MBZUAI).
  • Agentic tool use punches above its size: Toolathlon Verified 65.3 beats all listed open references incl. GLM 5.2 max (59.9); τ³-Banking 34.0 ≈ GLM 5.2 max (34.6); Terminal-Bench 2.1 70.2 beats Nemotron 3 Ultra (53.9) and Inkling xhigh (55.1) — audited 66.9 still ahead.
  • Trained via 5 expert RL branches (knowledge, IF, search, tool use, reasoning) merged before SFT; reasoning_effort=“high” required for stated scores.
  • Custom k2_horizon architecture (MoE + sigmoid router, K2HorizonForCausalLM) — needs repo model code (trust_remote_code); first-party vLLM/SGLang recipes exist.

See also