Llama.cpp
Definition
A lightweight open-source C/C++ runtime enabling high-speed LLM inference on diverse hardware (Mac, Windows, Linux).
Example Case
The core engine under Ollama and Jan.
A lightweight open-source C/C++ runtime enabling high-speed LLM inference on diverse hardware (Mac, Windows, Linux).