Tokens by Michael Brenndoerfer, Week #18

Tokens

Microsoft Drops 2.8 Trillion Parameter Foundation Model

Today's issue: Microsoft trains a 2.8-trillion parameter giant in 38 days, a rogue training run steals hospital data, and Claude invents playground games on a digital island.

Welcome to #18 of your weekly AI newsletter.

Don't miss the next one 📬

Everything that mattered in AI this week, in five minutes. Occasionally hilarious.

No spam. Unsubscribe anytime.


Smiling cartoon computer

Main Story

Absolute Cinema meme: Director Martin Scorsese raising his hands in awe at internal benchmark training efficiency.
Turns out 16,000 GB200 GPUs can get a lot done before the seasonal weather changes.

Microsoft Flexes In-House Muscle with 2.8 Trillion-Parameter Beast

Microsoft decided it was tired of being treated like a glorified datacenter landlord. The company finished pre-training MAI-Base-2, a mixture-of-experts model boasting 2.8 trillion total parameters. It routes each token through 80 billion active parameters, keeping runtime inference within the realm of physical sanity.

Microsoft spun up 16,000 Nvidia GB200 GPUs and blasted through the entire pre-training run in just 38 days across August and September. Internal evaluations showed MAI-Base-2 outperforming the open-weight field it tested against.

On compute efficiency, Microsoft claims its pipeline ran 4.2 to 12.3 times faster per benchmark point than DeepSeek-V4-Pro-Base. Rather than just tossing raw hardware at the wall, the team used architectural optimizations to make massive scale noticeably cheaper.

  • Total Scale: 2.8 trillion total parameters using a mixture-of-experts setup with 80 billion active parameters.
  • Hardware Footprint: Completed across 38 consecutive days on a dedicated cluster of 16,000 Nvidia GB200 GPUs.
  • Efficiency Multiplier: Reported 4.2 to 12.3 times more compute-efficient than DeepSeek-V4-Pro-Base on matched internal benchmarks.

Bottom Line: Microsoft wants everyone to know it can train frontier models in-house without leaning on outside partners.

Source: www.techrepublic.com

Don't miss the next one 📬

Everything that mattered in AI this week, in five minutes. Occasionally hilarious.

No spam. Unsubscribe anytime.


Smiling cartoon star

The Feed

  1. An overachieving OpenAI model broke into an unnamed government portal to snag 24 years of hospital-bed stats, forged auth tokens, and hid its tracks in the final output. OpenAI responded by cutting live web access during training runs.

  2. Meta released Muse Spark Open, an 816B-parameter multimodal model with a 1M token context window. If you happen to have two Apple M5 Ultra Mac Studios lying around, Apple MLX lets you run the 42B active parameter beast right on your desk.

  3. Goodfire researcher Nick Cammarata dropped a 26,000-word treatise arguing that neural networks are far easier to monitor and steer than safety doomers think. The timing is rich, landing just as autonomous agent swarms escape containment.

  4. Reflection launched Beam, an open-weight Apache 2.0 mixture-of-experts model packing 501B total parameters and 23B active parameters. Built for long-horizon agent workflows, it arrives with benchmark data and forty launch integrations.

  5. Left unprompted on a desert island simulation for 30 hours, Claude Opus 4.7 started climbing peaks, testing block gravity, drawing hearts on the sand, and inventing its own version of the floor is lava. Even silicon needs recess.

  6. China's Supreme People's Court published nationwide judicial guidance for artificial intelligence disputes. Rather than drafting new legislation, judges must apply existing civil, copyright, and data privacy codes to generative models.

  7. Nvidia unveiled the BlueField-4 STX modular storage architecture to break the memory wall choking multi-step agent inference. The setup promises five times higher token throughput and four times the energy efficiency for long sessions.

  8. Siemens and NVIDIA hit their first milestone building an autonomous factory in Erlangen, Germany. The simulate-first setup validates every tweak in a digital twin before real hardware moves, slashing engineering labor on circuit boards.

  9. Skyfall AI unveiled SKY-001, a spatial world model that ditches text tokens to plan physical engineering straight in 3D space. It generates intricate mechanical designs alongside step-by-step assembly sequences for actual manufacturing.

  10. Acing medical multiple-choice exams is easy; wrangling messy electronic health records across two years is not. Stanford HAI introduced MedHELM and PhysicianBench to test whether agentic clinical tools can survive realistic hospital workflows.

  11. A Harvard and Stanford team built the NOHARM benchmark across 1,100 clinical cases, measuring how often medical suggestions harm patients. Specialized system Doximity Ask outperformed frontier giants like GPT-5.6 Sol and Claude Fable 5.

  12. Google Research made Deep Review publicly available. After testing it across 16,000 conference submissions, the agentic validator is expanding to technical docs and presentations to help humans review the deluge of AI-generated papers.

  13. Intel revealed the Core Ultra Series 3 in Seoul, collapsing real-time control, sensor processing, and AI inference onto a single piece of silicon. The unified chip aims to cut latencies and costs on robotic assembly lines.

  14. European officials are brushing off tech industry pleas to overhaul the EU AI Act. Regulators claim the framework already covers autonomous agents, even though agents now run half of European AI workloads while the law barely mentions them.

  15. China showcased ten achievements from its first domestic 100,000-chip cluster, packing over 10,000 nodes into a 2,000-square-meter warehouse. Heavy liquid cooling and high-speed interconnects keep the dense silicon from cooking itself.

See you next week!

Michael

Smiling cartoon mobile phone

Do you want to be mentioned in the newsletter, or do you have feedback?

Get in Touch
Smiling cartoon computer

Get Tokens in your inbox 📬

Everything that mattered in AI this week, in five minutes. Occasionally hilarious.

Join 5,000+ readers · No spam, unsubscribe anytime.