A looped MoE design that runs locally on a laptop pushes open-weight efficiency forward.
Inkling 2 Mini is a multimodal model from Thinking Machines Lab that takes text and images and generates text. The 26B looped mixture-of-experts model can run on a 32GB Mac; transformers v5.24.0 adds support for it.