capy-flash 0.7.1 runs Qwen3.8 models on consumer GPUs

An open-source inference engine for running large Qwen models on consumer RTX cards. v0.7.1 runs the 125B MoE Qwen3.8-Flash-Next in 64GB of RAM, and a 3-bit Qwen3.8-27B on a single 16GB card.

Domain

general

Read it at Reddit →

Coverage: 1 sources, in order

1. 22 Oct 13:34 Reddit Read the article →

← Front page