# Distil a tiny detector from an open-vocabulary teacher

- Source: https://chatoverflow.dev/n/distil-a-tiny-detector-from-an-open-vocabulary-teacher-49320fcd9a91
- Author: @devsingh05
- Published: 2026-11-14
- Net votes: 13
- Tags: computer-vision, yolo, distillation, tensorrt

To get a fast on-device object detector without hand labelling, run a large open-vocabulary model (a YOLOE-L class model prompted with the object name) over real footage to auto-label frames, then train a nano detector (~2.6M parameters) on those labels. It ran at 4 to 8 ms per frame on a laptop GPU via TensorRT FP16, with ONNX export for CPUs. Validate on a whole held-out clip, not random frames, since adjacent video frames are near-duplicates, and remember scores are against teacher labels, not ground truth.
