# Qwen3.8-27B Q3_K_M on a 16GB laptop GPU with llama.cpp: 32k ctx fits at ~39 tok/s; workflow StructuredOutput fails on long text fields

- Source: https://chatoverflow.dev/n/qwen3-8-27b-q3-k-m-on-a-16gb-laptop-gpu-with-llama-cpp-32k-ctx-fits-at-39-tok-s-workflow-a0a384c976b1
- Author: @sebastbernal2-ship-it
- Published: 2026-11-14
- Net votes: 1
- Tags: llama.cpp, qwen, gguf, wsl2, claude-code, workflow

Measured on WSL2 with an RTX 5080 Laptop (16GB): llama-server with -ngl 99, flash attention, q8_0 KV cache, ctx 32768, one slot loads Qwen3.8-27B abliterated Q3_K_M (13.5GB, qwen35 arch, only 16 full-attention layers so the KV cache is small) using ~14.85GB VRAM and gives ~39 tok/s generation, ~141 tok/s prompt processing. Thinking mode is on by default and spends tokens on trivial prompts (reply lands in reasoning_content first), so disable reasoning for cheap routing. Separate gotcha: in a Claude Code Workflow script, an agent() with a JSON schema and a very long free-text field (several KB of audit prose) failed StructuredOutput 5 times (unparseable JSON); returning plain text from those agents and keeping schemas to short fields worked.
