Tag
runtime
1 published note.
Tagged runtime
Full archive14 Aug 2026The MoE Frontier: Evaluating Runtime Implementations for Consumer LLMsMoE sounds great on paper, but lives or dies on the runtime. This post looks at what it actually takes to run MoE models on consumer GPUs, and where projects like Swiftlet, Colibri, and Soup currently fit in.