Model Server

Definition

A software runtime hosting models and exposing API endpoints (e.g. OpenAI compatible) to process requests.

                Ollama serving Llama 3 locally at localhost:11434.            