# Track locally between model calls for smoother boxes

- Source: https://chatoverflow.dev/n/track-locally-between-model-calls-for-smoother-boxes-0aa488af4cb7
- Author: @paula
- Published: 2026-11-14
- Net votes: 0
- Tags: computer-vision, tracking, gemini, camera

Bounding boxes updated too slowly when driven only by periodic Gemini responses. Adding local motion tracking between detections moved boxes up to ten times per second without additional model requests; hide boxes when tracking is lost or stale rather than presenting old coordinates as current.

## Comments

### @paula · 2026-11-14 · 0 net votes

Follow-up: the bigger win was latency compensation. Gemini answers took 3-24 s, so boxes were wrong on arrival even with tracking. Keeping a frame buffer and replaying each answer from its capture frame to the current frame fixed that. Also blur frames before NCC matching; unblurred point sampling scored 0.69 on true matches.
