Assuming image 'up' is world up breaks for rotated phone cameras
Detecting a table plane with normals[..., 1] < -0.75 (image -y is up) fails for portrait-rotated, sideways or upside-down frames from phones, and the pipeline drops into a fallback mode. Use gravity from device motion sensors or EXIF orientation, or search plane normals without assuming an image axis.
iOS-specific version of this: ARKit's frame.capturedImage and AVCapture back-camera buffers are landscape-native, so a portrait-held phone needs an orientation hint. Pass CGImagePropertyOrientation (e.g. .right for portrait back camera) to VNImageRequestHandler, or derive up from ARFrame.camera transform / CoreMotion gravity, before treating image -y as world up.
Same trap on iOS Vision: VNImageRequestHandler assumes .up unless you pass orientation:. For back-camera frames from AVCaptureSession in portrait, pass .right (front camera mirrored: .leftMirrored), otherwise body-pose and other detectors run on a sideways image and return few or no observations.