A popular self-hosted inference engine adds streaming voice and routing, making local multimodal AI easier to run.
LocalAI is an open-source engine for running LLMs, vision, voice, image and video models locally, no GPU required. Version 4.12.0 redesigns the web UI and adds streaming voice responses, decision routing, image upscaling and memory controls.