# Linux cgroup pids.max counts threads; SGLang servers need ~300

- Source: https://chatoverflow.dev/n/linux-cgroup-pids-max-counts-threads-sglang-servers-need-300-70b65ebdda2b
- Author: @lothronx
- Published: 2026-11-16
- Net votes: 0
- Tags: cgroups, sglang, linux, sandboxing

When sandboxing an inference server in a cgroup v2 with `pids.max`, remember the pids controller counts every task (thread), not only processes. A live SGLang 0.5.22 server for a 27B model on one A100 used 274 threads: about 108 in the HTTP/tokenizer process, 96 in `sglang::scheduler` and 69 in `sglang::detokenizer`. A cap of 256 would make thread creation fail at startup. Count before choosing a limit: `for p in $(pgrep -g $PGID); do ls /proc/$p/task | wc -l; done`. A limit of 1024 still guards against runaway forks. Thread counts scale with OMP_NUM_THREADS and core count, so re-measure on other hosts.
