GEO Glossary

Unified Memory Bandwidth

Unified memory bandwidth is how fast a chip can read the memory its CPU and GPU share. Why it sets local LLM token speed, with Apple's M6, M5 Pro, M5 Max and M5 Ultra figures from October 2026.

By Ramanath, CTO & Co-Founder at Presenc AI · Last updated: November 2, 2026

Definition

Unified memory is a single pool of RAM that a chip's CPU, GPU and neural engine all share, as on Apple silicon. Unified memory bandwidth is how many bytes per second the chip can read from that pool. For running language models locally, it is usually the number that matters most after capacity.

Why Bandwidth Sets Token Speed

To generate each token, a model has to read its active weights from memory. If a model's active weights take 20 GB at your chosen precision, and your chip reads 400 GB per second, the ceiling is about 20 tokens per second before any other overhead. Real speeds come in lower. That's why two machines with the same RAM can differ widely in speed, and why active parameters matter: a mixture-of-experts model reads fewer bytes per token than a dense model of the same total size.

Capacity and bandwidth do different jobs. Capacity decides whether a model fits at all. Bandwidth decides how fast it runs once it does.

Apple Silicon Figures, October 2026

ChipMax unified memoryBandwidthWhere
M632 GB170 GB/s14-inch MacBook Pro, iMac (October 27, 2026)
M5 Pro64 GB307 GB/sPROLED MacBook Pro
M5 Max, 32-core GPU36 GB460 GB/sPROLED MacBook Pro
M5 Max, 40-core GPU128 GB614 GB/sPROLED MacBook Pro
M5 Ultra512 GB1.2 TB/sMac Studio

Figures are from Apple's newsroom posts and tech specs pages. Note that the lower M5 Max configuration tops out at 36 GB, less than an M5 Pro can take, so the cheaper Max is a poor local-LLM buy.

What to Do With It

Pick capacity first: the model plus its context cache must fit with room to spare. Then compare bandwidth among the machines that pass. Measured results are better than estimates, so check tokens per second benchmarks before you buy, and see MacBook Pro M5 Max vs Mac Studio M5 Ultra for a worked comparison.

Frequently Asked Questions

Generating each token means reading the model's active weights from memory, so bandwidth sets a ceiling on tokens per second. More bandwidth means faster output once the model fits in memory.
Apple lists 614 GB/s for the M5 Max with the 40-core GPU, which supports up to 128 GB, and 460 GB/s for the 32-core GPU version, which supports 36 GB.
Apple lists 170 GB/s for the M6, with up to 32 GB of unified memory.
You need enough RAM first, because a model that does not fit will not run well at all. Among machines with enough RAM, higher bandwidth gives faster token generation.

Track Your AI Visibility

See how your brand appears across ChatGPT, Claude, Perplexity, and other AI platforms. Join the waitlist for early access.