# High-Bandwidth Flash offers efficient storage for model weights **URL:** \ **Category:** Hacker News\ **Created:** [July 15, 2026, 2:04am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888 "2026-07-15T02:04:12Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Gaishan](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/g/6a8cbe/32.png) [@Gaishan](https://hn-client.demo-by-discourse.com/u/Gaishan)\ **Post date:** [July 15, 2026, 2:04am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/1 "2026-07-15T02:04:12Z")
[https://spectrum.ieee.org/high-bandwidth-flash](https://spectrum.ieee.org/high-bandwidth-flash) Read the linked article. * * * [Discuss on Hacker News](https://news.ycombinator.com/item?id=48915393) ---
**Author:** ![sixdimensional](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/s/bb73d2/32.png) [@sixdimensional](https://hn-client.demo-by-discourse.com/u/sixdimensional)\ **Post date:** [July 16, 2026, 4:13am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/2 "2026-07-16T04:13:50Z")
So like.. conceptually kind of like memory mapped files on fast flash persistent storage, IIUC? Or maybe it’s more like GPU-managed demand paging, caching and DMA? That could get you the capacity and better I/O characteristics. I’m curious about how the unifying architecture is going to evolve between CPU/GPU having direct access to a singular pool of memory/storage also. I also keep wondering when memristor technology might enter the ring, because as I understand it, it would be like moving compute into the memory, which would potentially remove the need to move the data in and out of storage as much also. It feels like computing hardware infrastructure is fundamentally evolving. ---
**Author:** ![wills\_forward](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/w/90db22/32.png) [@wills\_forward](https://hn-client.demo-by-discourse.com/u/wills_forward)\ **Post date:** [July 16, 2026, 4:16am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/3 "2026-07-16T04:16:15Z")
stick enough floppy’s in parallel and you could do the same thing ---
**Author:** ![hankbond](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/h/71c47a/32.png) [@hankbond](https://hn-client.demo-by-discourse.com/u/hankbond)\ **Post date:** [July 16, 2026, 4:17am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/4 "2026-07-16T04:17:29Z")
Necessity being the mother of all invention. I also thought the compute-in-memory approach was interesting re: [https://mythic.ai](https://mythic.ai) ---
**Author:** ![trollbridge](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/t/5f9b8f/32.png) [@trollbridge](https://hn-client.demo-by-discourse.com/u/trollbridge)\ **Post date:** [July 16, 2026, 4:24am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/5 "2026-07-16T04:24:17Z")
I’ve been wondering when we’d get around to having the equivalent of “memory that runs at very GDDR6 speeds for reading, but is much slower for writing”, which is exactly what you need when working with an AI model. Versus current HBM which has the same speeds writing as reading. ---
**Author:** ![cuu508](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/c/c0e974/32.png) [@cuu508](https://hn-client.demo-by-discourse.com/u/cuu508)\ **Post date:** [July 16, 2026, 4:38am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/6 "2026-07-16T04:38:21Z")
I have fond memories of Flash 5 in early 2000s. At the time I knew BASIC and Pascal. I could figure out how to draw things, how to animate them using keyframes and motion tweening, and how to make things interactive with ActionScript, all by poking around and reading the help manual (F1) on our underpowered offline PC. ---
**Author:** ![Animats](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/a/d26b3c/32.png) [@Animats](https://hn-client.demo-by-discourse.com/u/Animats)\ **Post date:** [July 16, 2026, 5:05am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/7 "2026-07-16T05:05:32Z")
Good use case for fast read, slow write. ---
**Author:** ![jmward01](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/j/e19b73/32.png) [@jmward01](https://hn-client.demo-by-discourse.com/u/jmward01)\ **Post date:** [July 16, 2026, 6:04am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/8 "2026-07-16T06:04:12Z")
I didn’t see cost. If cost is similar to flash drives then this could be massive. Every GPU ships with a lot of ram still but for AI inference and games you have 10TB of this stuff to stuff all your textures into and all your model weights in. For fine tuning models this would also be great if using lora or similar. ---
**Author:** ![dlcarrier](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/d/b9e5f3/32.png) [@dlcarrier](https://hn-client.demo-by-discourse.com/u/dlcarrier)\ **Post date:** [July 16, 2026, 6:05am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/9 "2026-07-16T06:05:56Z")
Intel really missed out, when they discontinued the Optane line, right before the RAMpocalypse. ---
**Author:** ![UltraSane](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/u/d6d6ee/32.png) [@UltraSane](https://hn-client.demo-by-discourse.com/u/UltraSane)\ **Post date:** [July 16, 2026, 6:51am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/10 "2026-07-16T06:51:41Z")
Why doesn’t someone bring back optane? ---
**Author:** ![ramshanker](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/r/d6d6ee/32.png) [@ramshanker](https://hn-client.demo-by-discourse.com/u/ramshanker)\ **Post date:** [July 16, 2026, 7:32am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/11 "2026-07-16T07:32:04Z")
I hope it brings the RAM prices down! ---
**Author:** ![ACCount37](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/a/58956e/32.png) [@ACCount37](https://hn-client.demo-by-discourse.com/u/ACCount37)\ **Post date:** [July 16, 2026, 8:00am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/12 "2026-07-16T08:00:21Z")
That makes some sense. NAND Flash is massively parallel by its nature. That is rarely exposed outside the die though. You’ll have that 8 bit double data rate bus and you’ll learn to like it. Now that model inference at scale is a thing though? Model weights, cached prefixes? There’s a considerable demand for “slow writes, fast high bandwidth reads” memory. And every bit of storage you didn’t have to use RAM for you can use for fatter KV cache instead. ---
**Author:** ![ACCount37](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/a/58956e/32.png) [@ACCount37](https://hn-client.demo-by-discourse.com/u/ACCount37)\ **Post date:** [July 16, 2026, 8:02am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/13 "2026-07-16T08:02:42Z")
I expect it to be closer to flash than to RAM, but still expensive. It’ll require some special NAND flash dies, and “good” dies too. Although they’ll be able to do the usual thing, and “recycle” the bad dies by selling them off to be used in normal flash drives and SD cards. ---
**Author:** ![AlphaSite](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/a/c4cdca/32.png) [@AlphaSite](https://hn-client.demo-by-discourse.com/u/AlphaSite)\ **Post date:** [July 16, 2026, 8:11am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/14 "2026-07-16T08:11:06Z")
AMD had an interesting take on this around a decade ago. Never went anywhere but very cool tech. ---
**Author:** ![imtringued](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/i/ccd318/32.png) [@imtringued](https://hn-client.demo-by-discourse.com/u/imtringued)\ **Post date:** [July 16, 2026, 8:16am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/15 "2026-07-16T08:16:36Z")
This feels like an exceptionally bad tradeoff. HBM is expensive due to the packaging cost and yield problems. Now you’re trading the relatively inexpensive but high performance DRAM for Flash while splitting the addressable market into training and inference only hardware. The low capacity of HBM isn’t really a mistake. It’s a design decision to keep the bandwidth to capacity ratio high. HBM systems with 96GB of memory tend to have around 3.5 TB/s which is a ratio of 35:1, meaning your theoretical maximum is 35 tokens of inference per second assuming you use the full storage just for parameters. If you massively increase the capacity but keep the bandwidth the same, you just end up lowering this ratio. Your system is overall smaller, but it also has less performance. This makes High-Bandwidth Flash an extremely niche product or the equivalent of industrially processing lampante olive oil and mixing into high quality olive oil. E.g you’re spending an extreme amount of effort on making a worse product that is only marginally cheaper in absolute terms, but more expensive in terms of price to performance ratio. ---
**Author:** ![Weryj](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/w/e99b99/32.png) [@Weryj](https://hn-client.demo-by-discourse.com/u/Weryj)\ **Post date:** [July 16, 2026, 7:41am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/16 "2026-07-16T07:41:43Z")
Wasn’t quite right before, but Optane was sold off, so it’s sad the buyer just sat on the IP. Also the selling point was latency, but I suspect we’ll see bandwidth being the important metric with AI using deep pipelines to stream in the weights in a latency insensitive manner. ---
**Author:** ![dabinat](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/d/8dc957/32.png) [@dabinat](https://hn-client.demo-by-discourse.com/u/dabinat)\ **Post date:** [July 16, 2026, 8:24am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/17 "2026-07-16T08:24:44Z")
It certainly could in the long-term but the spec is still being finalized and realistically a few years away from being able to put a dent in the HBM memory market. ---
**Author:** ![PunchyHamster](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/p/7bcc69/32.png) [@PunchyHamster](https://hn-client.demo-by-discourse.com/u/PunchyHamster)\ **Post date:** [July 16, 2026, 11:54am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/18 "2026-07-16T11:54:59Z")
we now only need AI companies to find a way to ruin hard disk storage and officially anything PC stops being affordable ---
**Author:** ![PunchyHamster](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/p/7bcc69/32.png) [@PunchyHamster](https://hn-client.demo-by-discourse.com/u/PunchyHamster)\ **Post date:** [July 16, 2026, 11:56am UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/19 "2026-07-16T11:56:19Z")
Optane latency was low enough that it could be drop-in RAM replacement for models. Bandwidth is just “stack more of them” ---
**Author:** ![sonic45132](https://hn-client.demo-by-discourse.com/letter_avatar_proxy/v4/letter/s/a4c791/32.png) [@sonic45132](https://hn-client.demo-by-discourse.com/u/sonic45132)\ **Post date:** [July 16, 2026, 12:43pm UTC](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888/20 "2026-07-16T12:43:18Z")
They did. Hard disk drive prices are up, even the used and officially re-certified drive prices are way up. Hard drive makers are reporting they have sold out of their yearly production, just like the memory manufacturers. [Next page](https://hn-client.demo-by-discourse.com/t/high-bandwidth-flash-offers-efficient-storage-for-model-weights/4888.md?page=2)