← all posts
// local · gemma

Gemma passes a billion downloads: the small-model workhorse layer is mainstream

On August 21 Google DeepMind said the Gemma family has passed one billion downloads, with more than 100,000 community variants and fine-tunes, and launched a curated Awesome Gemma repository to index them. A download count is a soft metric and I will get to why. But the same week The Information reported what AT&T is doing with models like Gemma in production, and the two stories together say something a billion downloads alone does not: the small open model is no longer the hobbyist tier. It is the layer that absorbs the routine work so the expensive model only sees the hard part.

What the number tells you

  • Distribution. A billion pulls across Hugging Face, Ollama, Kaggle and vendor mirrors means the weights are cached on enough machines that availability is not a concern for anyone building on them.
  • Ecosystem depth. 100k derivative models means that for most narrow tasks someone has already fine-tuned a Gemma for something close, and Awesome Gemma is DeepMind's attempt to make that findable.
  • Tooling gravity. Runtimes prioritise what people run. Gemma 4 is one of the two architecture families supported by the new DFlash-MLX speculative decoder on Apple Silicon, alongside Qwen3.5 and 3.6, and it is the model Ollama used to showcase its Apple GPU speedups this summer.

What the number does not tell you

Downloads are not deployments. Automated pipelines re-pull weights, benchmarks pull every size and quant, and a single CI job can account for thousands. Nothing in a download count says how many tokens Gemma serves in production, or whether the fine-tunes are any good. Treat it as a proxy for ecosystem health, not for quality. The quality question you answer on your own tasks, the way I described in local models.

A billion downloads proves the small model is everywhere; only your own eval proves it is good enough for the task you want to hand it.

The routing evidence

This is where AT&T matters. According to The Information, the company routes simpler work, code summaries, document summaries, to open models including Llama and Gemma, and keeps frontier models from Anthropic and OpenAI for the hard tasks. The result: costs down as much as 56% on those workloads at roughly a 2% quality drop. AT&T processes about 45 billion tokens a day, roughly 40% already goes to open models, and the target is 60-70%. Goldman Sachs's Jim Covello has turned this into an investment thesis: the model optimisation layer, not the model, is the bottleneck in enterprise AI.

The pattern is simple and it is the reason the download number matters. You need a small model that is good enough for the bottom half of your traffic, cheap to run, and boring to operate. Gemma's ecosystem makes it a safe default for that slot, the same way Postgres is a safe default for a database you have not thought hard about yet.

When the small model suffices

  • Summarisation, classification, extraction with a fixed schema, and rewriting are where a 4B to 27B open model matches the frontier on your own eval more often than people expect.
  • Anything with a hard privacy boundary. Running locally through Ollama means the data never leaves the machine, which ends a lot of compliance conversations before they start.
  • High-volume, low-stakes traffic where a 2% quality drop is invisible to the user but a 56% cost drop is visible to finance.
  • Not: multi-step agentic work, long-horizon reasoning, or anything where the failure is expensive and rare. Route that up, and measure the routing decision rather than guessing.

The practical setup is a classifier or a cheap heuristic in front of two model tiers, an eval set per task class, and a dashboard that shows the share of tokens going to each tier. The share is the number to move.

The honest limit

The AT&T figures are reported, not published; there is no paper, no eval set, and a 2% quality drop depends entirely on how AT&T measures quality on summaries. Your tasks will land somewhere else on the curve, and the only honest answer to whether Gemma can do it is a week with a held-out set. The billion downloads guarantee that the tooling will be there when you run that test. They do not guarantee the result.

#gemma#open-models#local#edge-ai