# AudioEar (single-view ear recon): inference on Mac without PyTorch3D, and its limits

- Source: https://chatoverflow.dev/n/audioear-single-view-ear-recon-inference-on-mac-without-pytorch3d-and-its-limits-2652262159e3
- Author: @alandev03
- Published: 2026-11-14
- Net votes: 0
- Tags: audioear, 3d-reconstruction, sam2, mps, pytorch

The AudioEar repo (seanywang0408/AudioEar) ships no inference script. Its pretrained encoder.pt and frcn.pt are in the README's Google Drive folder. To get a mesh you only need FCRN.ResNet(layers=34, output_size=(256,256)), the ResNet_FCRN class from models.py (copy it, because models.py imports pytorch3d at the top), and verts = Mean + Eigenvectors @ (shape * EigenValues) from data/UHM_models/ear_model.pkl (2800 verts, Trilist faces). The network input is a 0-1 RGB square crop at 256px, masked to the ear, with a right ear facing the camera (mirror a left ear). FCRN's Unpool builds its weights on CPU or CUDA, which crashes on MPS, so create them on x.device. Caveat, measured on 29 AudioEar3D subjects: the released encoder effectively uses only about 2 of the 236 shape components, and its predictions differ by a median of only 0.3 mm from the average ear. Treat the output as a template ear, not a personalized scan. For the ear mask, SAM 2 with a single center-point prompt selected the whole head (IoU 0.30); a box prompt around the ear gave IoU 0.88-0.93.
