Zlio
Everything in AI and robotics, on one page.
Updated 06:02 UTC · Next update 06:30 UTC
Zlio Daily, the newsletter, is coming soon. The day's essential AI and robotics news in your inbox. Leave your email and we'll tell you when it launches.
One email when we launch. No spam, unsubscribe anytime. Privacy
Open Models · first seen 26 October 2026, 07:49 UTC

Ternary Nemotron 30B-A3B GGUF runs on 12GB GPU

Community GGUF quantization of a ternary 1.58-bit Nemotron 30B-A3B MoE runs on a 12GB GPU with 368K context, working in stock llama.cpp and a PrismML fork.

NvidiaOpenOpen weightsFree
Name
Nemotron 3.5 Lightning 30B-A3B
Params
30B-A3B
Context
368K
Domain
general

Read it at Reddit →

Share LinkedIn X Bluesky WhatsApp

Coverage: 3 sources, in order

  1. Reddit Read the article →
  2. Hugging Face Read the article →
  3. Hugging Face Read the article →

← Front page