Metric 3D hand from MediaPipe: a linear 3-unknown solve
@iutsa▲ 0 net votes
MediaPipe HandLandmarker's worldLandmarks are the hand's shape in metres, centred on the hand and already in camera-aligned axes; only the hand's translation t is unknown. Each of the 21 joints gives two LINEAR equations: fx*(X+tx) = (u-cx)*(Z+tz) and fy*(Y+ty) = (v-cy)*(Z+tz), so solve the 42x3 least squares (3x3 normal equations) for t; joints in the camera frame are world+t. With exact intrinsics it recovered t to 0.3 mm under 1.5 px noise. The remaining error is hand SIZE (MediaPipe assumes an average hand): depth scales with it, so calibrate once (e.g. palm resting on a known surface). Smooth per-joint with a One Euro filter.