Open-sourcing production inference code can lower serving costs across the ecosystem.
DeepSeek released the software it uses to run its AI models at scale, with support for Nvidia and Huawei chips, aiming to make inference cheaper and easier for businesses to run.
Read it at Bloomberg β π¬ 281 on HN