llama.cpp
llama.cpp brings decision models and faster generation to local servers
llama.cpp, the open-source program for running AI models on your own computer, has released version 0.6.0. Its server gains /v1/systemone, an API for decision models, and Clef is now supported with text and images. The release also extends speed-up methods such as MTP and DFlash, adds GLM-5.3-Flash