LocalAI 5.0 broadens easy local, GPU-free running of open models with OpenAI- and Anthropic-compatible APIs.
LocalAI is an open-source engine to run LLMs, vision, voice, image and video models on your own hardware without a GPU. Version 5.0 adds a desktop app, chats and documents, and OpenAI/Anthropic-compatible APIs.