Get Zlio on your home screen
One tap, full screen, like an app.
A widely used open-source LLM serving engine adds features many deployments rely on.
vLLM, a high-throughput, memory-efficient inference and serving engine for LLMs, released v0.33.0; nightly builds add PLE disk offload support.