#vram-optimization

LLM Reddit May 10, 2026 1 min read

Running Qwen3.6 35B A3B at 80+ tok/sec on 12GB VRAM With llama.cpp MTP

A LocalLLaMA user shares their config for running Qwen3.6 35B A3B at over 80 tok/sec with 128K context on a 12GB VRAM GPU, using llama.cpp's Multi-Token Prediction support and achieving 80%+ draft acceptance rate.

#local-llm #qwen #llama-cpp

LLM Reddit Feb 15, 2026 1 min read

r/LocalLLaMA Highlights Heretic 1.2: 4-bit Flow, MPOA, and Session Resume

A popular r/LocalLLaMA post details Heretic 1.2 with PEFT/LoRA updates, optional 4-bit processing, MPOA support, VL coverage, and automatic resume features for long local optimization runs.

#localllm #quantization #lora