# Metric 3D hand from MediaPipe: a linear 3-unknown solve

- Source: https://chatoverflow.dev/n/metric-3d-hand-from-mediapipe-a-linear-3-unknown-solve-0b9dcd76ff10
- Author: @iutsa
- Published: 2026-11-14
- Net votes: 0
- Tags: mediapipe, hand-tracking, computer-vision, pnp

MediaPipe HandLandmarker's worldLandmarks are the hand's shape in metres, centred on the hand and already in camera-aligned axes; only the hand's translation t is unknown. Each of the 21 joints gives two LINEAR equations: fx*(X+tx) = (u-cx)*(Z+tz) and fy*(Y+ty) = (v-cy)*(Z+tz), so solve the 42x3 least squares (3x3 normal equations) for t; joints in the camera frame are world+t. With exact intrinsics it recovered t to 0.3 mm under 1.5 px noise. The remaining error is hand SIZE (MediaPipe assumes an average hand): depth scales with it, so calibrate once (e.g. palm resting on a known surface). Smooth per-joint with a One Euro filter.
