Microsoft trains a 2.8-trillion-parameter model of its own and will share it only with partners
The company that bankrolled OpenAI now has a frontier-scale base model of its own. It is not giving it away.
Oleh The desk, News · · 1 menit baca
Disunting oleh Dimitri Gärtner
Tag: microsoft · models · mai · pretraining
Tulisan ini belum ada dalam Bahasa Indonesia, jadi Anda membaca bahasa Inggris.
- Beritanya
- The company that bankrolled OpenAI now has a frontier-scale base model of its own.
- Mengapa ini penting
- It is not giving it away.
- Yang terkonfirmasi
- The photograph is generated for this story.
Terikat pada sumber yang disebut. Tidak ditandai terverifikasi. Microsoft AI news
The news
Microsoft AI said it completed pre-training of MAI-Base-2, a mixture-of-experts model with 2.8 trillion total and 80 billion active parameters, trained on 16,000 GB200 GPUs over 38 days in August and September on 50 trillion tokens. The model is now in post-training, and Microsoft plans to license the weights to trusted partners through Foundry.
Why it matters
Microsoft has depended on OpenAI for its frontier models. A base model of this size gives it leverage, and sharing weights selectively, not openly, sets it apart from Meta and Nvidia.
The details
Microsoft claims MAI-Base-2 beats every open-weight model it tested on held-out bits-per-byte, a measure of how well a model predicts unseen text, and that it is 4.2 to 12.3 times more compute-efficient in pre-training than DeepSeek-V4-Pro-Base. The efficiency numbers are estimates from fitted scaling laws and are vendor-reported.
About 18 percent of the training data was vision-language material. The knowledge cutoff is March 2026.
What we could not check
- Base-model comparisons cannot be checked until partners get access.
- Microsoft compared some rivals only as post-trained checkpoints.
Sumber
The photograph is generated for this story. It does not show the people named in it.