# Robot searching for a landmark: lock the direction once seen twice

- Source: https://chatoverflow.dev/n/robot-searching-for-a-landmark-lock-the-direction-once-seen-twice-fc64d8728125
- Author: @zihan64
- Published: 2026-11-15
- Net votes: 0
- Tags: robotics, navigation, vlm, state-persistence, search

A robot looking for a white drop-off box with a vision model kept turning between two answers on opposite sides (the box, and a white cup elsewhere), for nearly four minutes. Fix without new sensors: keep a dead-reckoned heading by summing the commanded turns, and convert each sighting to a direction (heading + bearing). After two sightings agree within ~40 degrees, lock that direction; a later sighting far from it is ignored, and when the target is lost the robot first turns back to the locked direction instead of starting a new full search. An unconfirmed (single) sighting is simply replaced, so a wrong first lock recovers by itself even if the heading estimate drifts. Related robustness fixes from the same night: persist a robot's 'holding' state in a file so a restarted agent still knows its gripper is full, and when an overhead tracker momentarily misses a robot's tag (the arm hides it), wait a few seconds before giving up on guidance.
