HARMAN brings long-standing automotive expertise that, combined with Samsung's extensive sensor, camera and consumer experience, is enabling automakers to implement a new generation of ADAS solutions (Advanced Driver Assistance Systems). These range from surround view and front camera to e-mirrors, ground-breaking augmented reality and much more. In addition, the compute platform uses cloud-connected analytics to track the terabytes of information generated by vehicles equipped with machine learning, thus enabling the connected car. HARMAN's expertise in connected-car technologies such as over-the-air updates, cloud services and telematics makes it a fully comprehensive ADAS partner for global automakers.

Get in touch

ADAS solutions

Augmented Reality Platform

Augmented reality (AR) is having an impact on a broad range of industries and processes. It has justifiably been one of the most talked-about technologies in recent years. With modern smartphones, consumers experience AR in their everyday lives and are keen to use this promising technology in more environments. HARMAN is bringing AR into the car with the aim of increasing safety and making driving more intuitive and comfortable.

AR Platform features

A new environmental experience

A car’s structure always limits the driver’s view of the surroundings to a certain extent, which can lead to dangerous situations. The HARMAN Augmented Surround View system monitors the blind spots and those areas the driver might miss and provides a better understanding of what’s happening in the immediate vicinity. Especially in cities, where the volume of traffic and pedestrians can be overwhelming for any driver, the Surround View system can help avoid accidents in multiple scenarios.

Although the Augmented Surround View is an extensive and complex ADAS feature, it can be combined with any existing compute platform. This leads to significant savings in system cost and weight. In addition, the integration of four to eight cameras eliminates an extra ECU. The HARMAN 360-degree camera utilizes the compute platform to monitor, record and assess the vehicle surroundings to generate content for the driver. The system is upgradeable and recordable over-the-air and integration into the HARMAN Ignite platform makes it a building block for cloud-based analytics.

Bringing AR to the automotive industry

HARMAN’s approach is to build a scalable platform that is open to multiple applications, easy for automakers to implement and intuitive for drivers to use. The platform enables display-based AR and supports multiple features for navigation and ADAS. The HARMAN Augmented Reality platform is a cross-platform solution (Linux, Android and x86) and runs on the infotainment SOC, not an external box. It merges data from different sources (CAN, GNSS, IMU) for high-resolution dead reckoning and works with automaker camera systems as well as the HARMAN Forward-Facing Camera. Further plans include windshield projection, vision-based AR pose and an AR video-development tool.

E-mirror system components

Driver Monitoring

Vehicle participates in broader ecosystems for seamless transitions between home, vehicle, and personal devices
Involves system integration of various in-cabin sensor elements, predictive learning and interaction as well as cloud-based intelligence and analytics
A conversational voice-controlled digital assistant can provide driver support and improve alertness
Detects if driver is distracted or drowsy and suggests breaks or suspends calls and messages
Incorporates health and wellness support and enhances personalization

E-mirror

Enhanced field of vision

In traffic, good visibility is essential, especially in critical situations on narrow streets or on highways. HARMAN's new approach is to assist the driver in an intelligent and intuitive way and thereby increase safety, comfort and convenience. HARMAN E-mirrors enhance or replace traditional rear- and side-view mirrors. The mirrors are further augmented with valuable information such as distance to other vehicles or their speed. Where E-mirrors replace conventional mirrors entirely, video of all three views (left/mid/right) appears in the center display or digital rear-view mirror.

Driver Monitoring data flow

The thinking mirror

DEMO

The HARMAN E-mirror is not merely another in-car display – it is an intelligent assistant that delivers the view the driver needs. For example, the mirror activates or dims automatically based on user gaze. The system can even detect moving objects and sound an alarm if things get too close. During overtaking, the mirror enlarges the view most important to the driver. Furthermore, the system corrects distortions and provides helpful additional information such as distances while parking and maneuvering.

AR Platform features

HARMAN EXPLORE

Get Started