Skip to content
Symbolic image: a glowing red padlock hovers above a black network appliance in a dark server rack, linked by a thin red beam of light, no text, no logos

More Reading

Post navigation

Symbolic image: a silver llama figurine stands on a green circuit board on a wooden desk between two laptops, a glowing ring of light and a desk lamp behind it, no text, no logos
Next Post

llama.cpp v1.0.0: A Stable API for Local AI Inference

After three and a half years, llama.cpp v1.0.0 is out. Breaking API changes will now only come with a new major version. The release removes deprecated functions, adds FP8 KV caches and an MoE cache, and tightens the defaults of llama-server.
back to top