Playing further with the Intel Optane module on my Raspberry Pi 5, I was able to squeeze out even more performance. The recipe? Changing the NVMe HAT, forcing PCIe Gen 3, overclocking the CPU, and …
Continue reading Squeezing performance out of a Raspberry Pi 5 with an Intel Optane for LLM usageTag: LLM
Playing with an Intel Optane on a Raspberry Pi 5
Checking out an Intel Optane module was always on my bucket list, but I never really had a solid use case for it. Recently, instead of buying a new Raspberry Pi with more physical RAM, I thought: why not give high-speed, ultra-low-latency swap a try?
Continue reading Playing with an Intel Optane on a Raspberry Pi 5