Why should vehicles watch the driver to achieve a feeling of consumer well-being?

Having vehicles “keep an eye” on the driver and occupants, will make the driving experience safer by reducing accidents and saving lives. This can be achieved through advanced driver and occupant monitoring systems. As part of sensor fusion in Advanced Driver Assistance Systems (ADAS), it is also an essential component needed for semi-autonomous vehicle functionality.

Advanced sensor technologies and machine learning are increasingly improving the ability to “see" and understand the world around a vehicle. But what about the situation inside the car? With driver distraction known to be a major cause of road accidents, there is substantial potential for improving safety by incorporating driver monitoring into Advanced Driver Assistance Systems (ADAS)​.

According to the World Health Organization, traffic accidents are among the top 10 causes of death in the world. In the USA alone, NHTSA reports that there were 3,166 “distraction-affected" road fatalities in 2017. In Europe, safety ratings agency Euro NCAP plans to introduce driver monitoring into its criteria for primary safety assessment starting in 2020.​

“Accident figures show that even a small lapse in attentiveness can have tragic consequences. HARMAN's Driver Monitoring system can play a key role in helping drivers stay focused at the wheel."

​“Accident figures show that even a small lapse in attentiveness can have tragic consequences," says Bernhard Pirkl, Vice President of ADAS/AD at HARMAN. “As part of our extensive ADAS capabilities, HARMAN's Driver Monitoring system can play a key role, not only in helping drivers stay focused at the wheel, but also in mitigating the consequences of distraction. The system uses sensors to capture data, enabling it to assess the state of the driver's momentary attentiveness. We can also adapt the warning and intervention levels to 'very capable and highly attentive, focused driver' – which helps with user acceptance of these advanced features."

Known as first-order biometrics, the most important of these include direction of gaze, head position and pupil diameter. Second-order biometrics, such as heart rate and breathing measured by auditory sensors, provide indicators of emotional activity and cognitive load.

But what does this mean in real terms?

“If it detects driver distraction, fatigue or emotional overload, the system can instigate any number of safety measures ranging from warning signals or prompts for the driver to take a break to automatic adjustment of cabin temperature, music and more," says Pirkl.

Advanced Driver Assistance Systems
Combined with Samsung’s extensive sensor, camera and consumer experience, HARMAN is enabling automakers to implement a new generation of Advanced Driver Assistance Systems.

​Using sensor fusion, the system cross references this data with other inputs from the ADAS spectrum, including the vehicle's motion sensors, cameras, radar and LiDAR to determine the need for physical intervention with braking or steering maneuvers. In simple terms, if the driver's gaze is diverted and heart rate elevated, and the vehicle is moving erratically, he/she could be arguing or distressed. “This is not a good state of mind for being in control of a vehicle," adds Pirkl.

Occupant monitoring offers benefits in terms of determining the other dynamics taking place in the car that could impact driver performance. For instance, the system detects when the driver is emotionally stressed or distracted because of passenger activity in the vehicle. It can then suggest a relaxing music playlist or activate soothing ambient lighting to stabilize the situation.

Looking to the future, systems such as HARMAN's Occupant Monitoring are a crucial aspect in the development of autonomous driving. Level 3 autonomous cars, also known as conditionally autonomous, are able to manage most driving tasks themselves. However, if certain conditions are not met, they require the human driver to take over. “Maintaining awareness of driver and cabin status is a critical element of the handover process and will be key to the success of semi-autonomous vehicles in future," says Pirkl.

Related Articles

How does my vehicle know before I do?
Smart cars not only know what is going on within their own systems, they also have increasing awareness of the world around them and learn the preferences of those who use them.
Read More
How will I communicate with my car in future?
Advanced driver assistance systems are changing how we interact with vehicles. And the voice is rapidly emerging as the dominant medium of communication with the vehicle.
Read More
HARMAN Ignite to Integrate Vehicle into the IoT network
Although its widespread use is relatively recent, life before the Internet seems a dim and distant memory. In the automotive context, network use is still in its infancy and set to expand drastically.
Read More
V2X (Vehicle-to-Everything) includes the peer-to-peer communications protocols that enable enhanced situational awareness between a vehicle and its surroundings to improve safety and manage congestion. As we enter the 5G era, the HARMAN Savari MobiWAVE wireless vehicular on-board unit supports both C-V2X and DSRC communication to eliminate traffic-related fatalities by deploying life-saving V2X applications.