EN
RTI International and Smart Eye have joined forces to integrate Smart Eye’s advanced eye-tracking technology with RTI’s SimObserver platform. With the objective of streamlining data collection and enhancing the accuracy of eye-tracking data in research simulations, this collaboration brings new levels of automation and precision to simulator-based research, providing researchers with accurate insights into driver behavior in real time while significantly reducing manual data processing requirements.
Before integrating Smart Eye’s eye-tracking technology, RTI’s simulation setup required researchers to manually correlate eye-tracking data with simulator events. Though gaze overlay capabilities existed, they fell short when it came to tracking moving objects within the simulation. There was also the challenge of visualizing exactly where the driver was looking when the car or scene objects were in motion. In prior demos, such as the one conducted for General Motors, the integration showcased gaze indicators for static objects but faced limitations when it came to dynamic scenarios where the car or other entities were moving.
With the integration of Smart Eye’s eye-tracking system into SimObserver, RTI now offers an automated, real-time approach to visualizing a driver’s gaze within simulation environments. When the simulation scenario involves static objects, Smart Eye’s eye-tracking data allows for the identification and highlighting of objects being looked at, thus enabling more accurate insights into user interactions. The eye-tracking system feeds data into SimObserver, where it is processed alongside other simulation data to provide synchronized visual and numerical insights. For example, SimObserver displays a real-time gaze overlay, with Smart Eye’s system indicating the exact location of the gaze on different screens or objects.
However, as noted by RTI’s team, tracking dynamic objects remains a challenge. The current setup allows for accurate gaze identification when the vehicle and scene objects are static. While the integration demonstrated during previous demos was capable of indicating which static object the driver was looking at, the system struggles to maintain alignment with moving objects. For example, if the car or the objects move during the simulation, the gaze indicators would misalign. This limitation is recognized as an area for future development, where the goal is to dynamically track moving objects in real-time with high accuracy.
RTI has enhanced its DataDistillery software to complement this integration by providing a multi-panel visualization. This software shows different camera views and overlays data streams, such as gaze coordinates and object labels, in real time. During demonstrations, the system can be configured to highlight the object or screen a participant is looking at, even adapting for setups with various participant heights and gaze angles. Although current capabilities focus on static gaze analysis, DataDistillery provides researchers with a comprehensive view of the simulation, enabling deeper insights into driver behavior.
➤ Streamlined Workflow: The integration eliminates the need for manual data mapping, providing real-time visualization of gaze data aligned with simulator events.
➤ Enhanced Insight Accuracy: Researchers gain objective insights into gaze patterns, especially during static scenarios, without the subjectivity of manual video analysis.
➤ Potential for Dynamic Object Tracking: The current limitations are acknowledged, with the goal of expanding capabilities to include accurate tracking of moving objects in future updates.
➤ Comprehensive Data Visualization: Tools like DataDistillery enhance the research experience by synchronizing gaze data with simulation visuals and other data streams, delivering a full picture of driver attention.
“The integration of Smart Eye’s eye tracking with RTI’s SimObserver increases the capabilities of both products for a more effective tool for the researcher to perform data analysis. What used to take a researcher hours to analyze the driver’s gaze manually is now fully automated. The ability to visualize in real-time where the driver is looking either at components in the cab or at visual objects in the simulated visual scene to detect their gaze is looking at the instrument cluster, a moving car or a pedestrian is incredibly powerful. This integration streamlines a researcher’s workflow, allowing them to focus on deriving insights rather than getting bogged down in data processing.”
— Mike Foley, Senior Researcher at RTI International
The collaboration between RTI International and Smart Eye marks a significant leap forward in simulator-based research. By integrating advanced eye-tracking technology with RTI’s SimObserver platform, researchers can streamline workflows, gain unparalleled accuracy in gaze data analysis, and unlock deeper insights into driver behavior. While challenges like dynamic object tracking remain on the horizon, this partnership demonstrates the transformative potential of combining cutting-edge technologies. As these innovations evolve, they promise to redefine human factors research, empowering researchers to focus on what matters most—understanding human interactions and making impactful discoveries.
