Chinese tech giant Alibaba is shipping Qwen3.8-Max: It'll be the largest open-weight A.I. model ever released and (as shown in chart) it's competing at the frontier alongside closed-source models from Anthropic and OpenAI. Here's what you need to know:
THE MODEL
• 2.4 trillion parameters in a mixture-of-experts architecture; only ~95B are active per token, so the headline number reflects capacity, not per-request compute.
• Accepts text, images and video, with a one-million-token context window (~750K words).
• Selectable low, medium or extra-high reasoning effort, so no paying for lengthy thinking traces when you need a quick lookup.
• All part of Alibaba's ~$53B, three-year bet on cloud and A.I. infrastructure.
THE BENCHMARKS
• Alibaba frames it as second only to Anthropic's Claude Fable 5; independent signals so far land in a similar neighborhood.
• Immediately became the highest-ranking Chinese model for text on the Arena leaderboard and ranked second globally on vision.
• Scored 86.6 on Terminal-Bench (agentic command-line tasks), ahead of both Claude Opus 4.8 and Fable 5.
• Vendor demos showcase multi-day autonomy: 10+ days coding unattended, plus reproducing an ML research paper from scratch and then beating 87% of 526 human teams in a live contest.
THE PRICE WAR
• $2 per million input tokens, $6 output and 25¢ cached input.
• Undercuts domestic rival Kimi K3 by more than half on output.
• Combined rate is less than a third of Claude Opus and under a quarter of GPT-5.6 Sol's... and cached-input pricing lets agentic workloads collapse toward the 25¢ floor.
IS IT SAFE TO USE A CHINESE MODEL?
• The risk depends less on the model and more on how your data reach it.
• Consumer apps and the hosted API route data through infrastructure governed by Chinese law, so keep anything sensitive or proprietary out of that.
• Safer: open weights hosted by a Western A.I. cloud (like Lightning AI) in your own jurisdiction.
• Safest: run the model on your own hardware: weights are inert files that can't phone home.
• Caveats: outputs reflect training under Chinese content regulations, so evaluate before trusting; practice supply-chain hygiene (official repos, checksums) and check whether your industry restricts Chinese-origin models.
BOTTOM LINE: Whatever your view on the geopolitics, the cost of experimenting at/near the frontier keeps falling and the control builders retain over their own stacks keeps rising. In my view, that's great news :)
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
Filtering by Tag: #AI
OpenAI Agent Breaches Hugging Face: All You Must Know incl. How to Protect Yourself
Cheesy secret "agent" thumbnail? Oh yes! As we've all surely heard by now, an OpenAI agent escaped its sandbox and hacked Hugging Face's servers. With the dust settled, here's *everything* you need to know, incl. how to protect yourself:
WHAT HAPPENED
• On July 16, Hugging Face disclosed an intrusion into part of its production infrastructure, driven end to end by an autonomous AI agent (no human attacker at any point).
• Five days later, OpenAI revealed the attacker: its own models (GPT-5.6-Sol plus an unreleased, more capable model), running a cyber-capability evaluation with safety guardrails switched off.
• Nobody told the models to attack anyone. Tasked with solving a security benchmark (ExploitGym), they exploited a zero-day in their sandbox's package proxy, escaped to the open internet and went after Hugging Face to steal the benchmark's answers. (Paperclips anyone? 🖇️)
WHY IT MATTERS
• The models found and exploited novel attack paths in real-world production systems without source-code access.
• Hugging Face is a $4.5B firm with a dedicated security team; a less-resourced target would have fared far worse.
• The warning signs were documented months earlier: in ExploitGym testing, frontier agents routinely abandoned the assigned vulnerability and invented their own route to the flag.
THE TWIST
• Hugging Face detected and dissected the breach using AI... LLM-driven forensics compressed days of analysis into hours.
• But the commercial APIs from American frontier labs they tried first (e.g., OpenAI's or Anthropic's) refused to process the attack logs. Safety guardrails "cannot distinguish an incident responder from an attacker", they said.
• The forensics ran instead on a Chinese open-weight model (Z.ai's GLM 5.2) on Hugging Face's own infrastructure, which also kept attacker data in-house.
LESSONS 1 (IF YOU BUILD AGENTS)
• Treat your egress allowlist as attack surface, not a safety guarantee. Pre-install dependencies and air-gap where you can.
• If you disable safeguards for testing, scale containment and monitoring in proportion.
• Log every agent action and alert on outbound connections that shouldn't exist.
LESSONS 2 (IF YOU DEFEND A PLATFORM)
• Rotate your Hugging Face access tokens and review recent account activity today.
• Treat user-supplied data and model artifacts as executable content, not inert files. Audit every code-execution path in your pipeline.
• Stand up a capable open-weight model on your own infrastructure and validate it for forensic log analysis BEFORE you need it at 2am (this is easy to do with, say, Lightning AI).
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
The Math Still Matters: Deep Skills in the Age of AI, with Dr. Catherine Williams
Dr. Catherine Williams was solving black-hole equations with pen and paper before she ever wrote a line of code and, in today’s episode, she makes the case that going deep on AI/ML math matters more than ever...
...even now that AI can do the math for you.
More on Dr. Williams:
• PhD in math researching general relativity and black holes.
• Postdocs at Stanford University and Columbia University.
• Became one of the very first data scientists when she joined AppNexus back in 2012, around the same time "data scientist" became a job title.
• Across more than a decade of senior data leadership at AppNexus, Xander, Qualtrics and now Candid, she's watched our field get born and then reinvent itself again and again.
In today's episode, Catherine traces the data science and AI evolution — from Bayesian models to BERT to today's LLMs — and shares sharp guidance on which skills will still matter as machines take over more of the technical work.
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
Fable 5 as Advisor: Anthropic’s Two-Model Pattern for Smarter, Cheaper Agents
Want near-frontier A.I. agent quality at a fraction of the cost? Anthropic recently productized the Advisor Strategy that pairs a cheap "executor" model with a brilliant "advisor" to give you the best of both worlds:
HOW IT WORKS
• A fast, cheap model (e.g., Claude Haiku or Sonnet) runs the entire agent loop: calling tools, writing code, drafting output.
• A frontier model (e.g., Claude Opus or Fable) sits on standby as a "tool" the executor can consult (like a junior worker phoning their supervisor when unsure).
• Everything happens inside one API call: Anthropic's servers hand the advisor the full conversation transcript and return just 400-700 tokens of advice, making this fast and inexpensive (it's also usually only a one-line code change so it's easy to implement).
THE RESULTS
• Sonnet + Opus advisor beat Sonnet alone on the "SWE-bench Multilingual" benchmark by 2.7 percentage points while cutting cost per task by 11.9%. Better quality AND slightly lower cost.
• Unsurprisingly, the biggest gains come from pairing a very fast/cheap model with a much more capable advisor: For example, on BrowseComp (web research benchmark), Haiku alone scored 19.7%; Haiku + Opus advisor scored 41.2% (more than double!) at 85% less cost than Sonnet alone.
• Newest data, from last week: On "SWE-bench Pro", Sonnet 5 + a Fable 5 advisor captured ~92% of Fable's standalone performance at ~63% of its cost.
WHY IT WORKS
• The advisor's output is tiny relative to the whole task, and a good plan delivered early prevents wasted attempts and misguided tool calls.
• Unlike OpenAI's router (which dispatches queries to a model up front), the cheap model runs the show and escalates itself mid-task with full shared context.
PRACTICAL LESSONS
• Skip it for single-turn Q&A; it shines on long-horizon agentic work (like coding, research, computer use).
• Executors under-call the advisor by default so prompt them to consult it early (before committing to an approach) and late (before declaring the task done).
• Cap advisor output at ~2,000 tokens (~7x cost reduction, no quality loss) and enable prompt caching for long loops.
• The pattern is spreading: OpenRouter now offers a cross-provider version (e.g., a Google Gemini executor consulting Claude).
• Alternative design patterns such as having a powerful "orchestrator" (shown below the advisor pattern in the chart I included in this post) might work even more effectively for your use case so it could be worth comparing them.
BOTTOM LINE
Frontier A.I. progress is no longer just bigger models... it's smarter economics in composing the models we already have.
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
TrueFoundry’s Nikunj Bajaj on How to Get $100M Returns on AI Agent Deployments
Imagine being able to deploy an AI agent and getting a return of over $100m from that single deployment. My guest today, Nikunj Bajaj, has facilitated that multiple times! Lots to learn from him, enjoy!
Nikunj:
• CEO and co-founder of TrueFoundry, a Bay Area-based startup that has raised over $20m to solve the thorniest problems that enterprises face when deploying agents.
• His clients include demanding organizations like NVIDIA and Siemens.
• Was previously ML tech lead at Facebook.
• Holds a master's in computer science from University of California, Berkeley.
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.
Tokenmaxxing vs AI Hardware Bottlenecks
Humans (like Reinforcement Learning algos) can "reward hack": "Tokenmaxxing" being a perfect example, after employers started using "number of tokens" consumed as a proxy for developers' productivity.
Even if humans weren't engaging in this pointless time-, money- and energy-consuming behavior, however, demand for A.I. compute is so vast that everyone's scrambling to to make more available. Alas, four tricky hardware bottlenecks face us:
1. GPUs:
• NVIDIA data-center GPU lead times now run 36–52 weeks, with Blackwell chips sold out through mid-2026.
• The real choke point isn't fabrication: It's TSMC's "CoWoS" advanced packaging, which is sold out through 2026. Nvidia alone has locked up ~60% of CoWoS capacity through 2027.
2. High-Bandwidth Memory (HBM):
• Demand has quintupled since 2023, and only three companies (SK hynix, Samsung and Micron) make it.
• All three are sold out well into 2026 and new HBM factories take 18–24 months to come online.
3. CPUs:
• As workloads shift toward agentic AI, the CPU:GPU ratio jumps from ~1:12 (for GenAI-only chatbots) to 1:1.
• Intel's CFO says the server-CPU shortfall "starts with a B" — billions in unmet demand so server CPU prices are up 10–20% in just the past couple of months.
4. Electricity: Hyperscaler build-outs are now gated by grid interconnect (18–36 months) and transformer lead times.
THE BIG MISMATCH
• The top 5 hyperscalers alone (Alphabet, Amazon, Meta, Microsoft and Oracle) are on track for ~$725B in combined 2026 capex.
• That's roughly 6x the hyperscalers' 2022 spend, with ~75% going to A.I. infrastructure.
• Hardware suppliers, however, have grown capex by only ~50%.... a 6x increase in demand met by only a 50% increase in supply is a big mismatch!
REASONS FOR OPTIMISM
Demand will continue to be high but I'm optimistic we'll continue to squeeze more juice from every lemon because, e.g.:
• Algorithmic efficiency keeps improving — Google's TurboQuant recently briefly tanked memory stocks by promising to materially cut inference memory needs.
• LLM efficiency gains via mixture-of-experts and smarter inference scheduling continue to compound.
• The tokenmaxxing trend is a corporate farce that will fade.
The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.