Displaying posts in the categoryAI Hardware
AI Hardware articles
Memory
Discussion of the AI car usually stops at TOPS. NVIDIA's own figures show why that misses the tighter constraint: from DRIVE Orin to DRIVE Thor, peak AI compute rises about 3.9 times, while peak memory bandwidth rises about 1.3 times. This post builds a vehicle-level budget for 2026, 2028 and 2030. In our illustrative model, sustained DRAM demand grows about 4.8 times, from 132 GB/s to 631 GB/s, while installed peak bandwidth grows about 3…
by
The Semiconductor Hub
November 17, 2026
Special Reports
HBM4 is the memory that the next wave of AI accelerators is built around. It doubles the interface of every stack to 2,048 bits, moves the bottom die of the stack onto a logic process, and pushes stacks to 16 dies inside a package that has to stay under a fixed height. All three memory makers announced HBM4 volume production or shipments during the first half of 2026, and NVIDIA's Rubin and AMD's MI400 series are the first large GPUs de…
by
Murugavel Ganesan
November 16, 2026
Liquid Cooling
In April 2026 Google announced its eighth-generation TPU as two chips instead of one. TPU 8t, for large-scale training, has 216 GB of HBM and 128 MB of on-chip SRAM. TPU 8i, for serving and post-training, has 288 GB of HBM and 384 MB of SRAM, with a lower peak compute rating of 10.1 PFLOPs against 12.6. These are Google's figures, and they show the shift plainly: the two jobs no longer want the same balance of memory and compute. This post…
by
Murugavel Ganesan
November 13, 2026
Semiconductor Industry
It is tempting to read AI chip trends for 2027 through peak compute alone. For the engineers who design, verify, package and test these parts, the harder limits now sit elsewhere: memory that is short and expensive, packages that are larger than a reticle many times over, links between chips that copper can barely carry, and racks heading towards a megawatt each. This post sets out ten semiconductor trends for 2027, ordered by how directly the…
by
Murugavel Ganesan
November 13, 2026