AriaGazeTrack 👁️

AriaGazeTrack is a Python project that uses Meta Project Aria sensor data to estimate 3-DoF head orientation and project eye gaze points onto RGB camera frames.

Features

• Raw gyroscope integration using quaternions
• Calibrated gyroscope integration using bias and rectification matrix
• Orientation error comparison against ground truth
• Eye gaze projection from CPF coordinates to RGB camera frame
• Red gaze-dot overlay on extracted video frames
• Short and long trace evaluation support

Tech Stack

• Python
• NumPy
• OpenCV
• Matplotlib
• SciPy
• Project Aria Tools

Run Orientation Tracking

python hw5_tracking.py

Run Eye Gaze Projection

python hw5_gaze.py <path_to_adt_sequence_folder>

NOTE

Dataset files are not included because Project Aria ADT data is large. Download the required ADT sequence separately and place it inside adt_data/.

AUTHOR

Kelvin Ihezue