Driver monitoring systems (DMS) are enhancing real-time feedback to a vehicle’s steering and control systems, as discussed in our recent post, “How driver monitoring systems can help with collision avoidance.” However, there are several key design considerations when designers begin incorporating this technology into vehicles.
Typically when designing a system for a controlled environment where the light source is calibrated for optimal image quality, the design challenges are simplified. The size and form factor of the DMS platform are not major constraints and there are no strict limits to power consumption or thermal dissipation. The primary design consideration in DMS is the robustness and accuracy of the algorithm used in the system.
You may think the interior of a vehicle can be called a reasonably defined environment, but in reality, it’s far from it. The interior of a vehicle is actually quite an unpredictable environment. Typical constraints include, but are not limited to, driving environmental unpredictability caused by changing light exposure, reflections from oncoming headlight beams and changes in ambient temperature.
These factors drive the need for systems to include sufficient algorithms capable of handling tough environmental conditions. Another factor that adds to the system complexity is accommodating the cosmetic design of the vehicle. Automotive designers constantly try to introduce new design concepts while also maximizing driver comfort features. These constraints require the position and location of the DMS camera to often change.
In practice, DMS designers need to consider the following:
Meeting these system challenges require the SoC to provide:
A system on chip (SoC) solution, like a TDA3x processor as shown in Figure 1, brings new innovations to DMS systems by offering an optimized solution for vision and sensor processing in a small form factor and low power design. Jacinto™ 6 automotive processors, like the TDA3x family, provide a scalable portfolio of SoCs that enable developers to meet a broad range of performance and system needs while keeping a common software base.
Using the TDA3x SoC, DMS solutions can help provide:
Figure 1: System block diagram of TDA3x and TDA2Px devices for DMS.
Development kits can also help designers get started developing their DMS solution quickly. The D3 Engineering DMS kit, as shown in Figure 2, combines the TDA3x automotive processor with camera modules and vision algorithms to help engineers evaluate the technology and develop DMS applications.
The DMS kit, available from D3 Engineering includes a DesignCore® RVP-TDA3x Rugged Vision Platform ECU features a TDA3x System-on-Module (SOM) board, associated firmware and customizable baseboard in a rugged enclosure. Two D3CM camera modules (D3CM), enable driver monitoring and iris tracking. The cameras incorporate 2MP sensors, IR illumination for reliable operation in various lighting conditions (per TI’s published specification), and an RGB LED for user feedback during system development.
Figure 2: D3 Engineering kit for DMS.
FotoNation algorithms are optimized to run on the ECU and the FotoNation application library includes eye gaze tracking, face detection, head position tracking, and 3D facial feature detection. In addition to the autonomous driving and ADAS functions, engineers can develop in-cabin security and customization features based on driver identity using the face and iris recognition functionality.
The D3 DMS kit supports Level 2 and Level 3 semi-autonomous vehicles, ensuring that the driver is capable of taking over as needed. This kit supports additional use cases like operator authentication, awareness, and drowsiness detection in both industrial and semi-autonomous automotive systems.
The DMS kit is suitable for on-vehicle or field testing. It supports development of engineering verification test (EVT) units and automotive A-Samples with the support of D3 Engineering’s product development services. It is intended to provide a path to production for both integrated-dashboard and after-market DMS solutions.
Drowsiness and driver distractions have surfaced as a major safety issue worldwide. DMS technology can help detect distracted and potentially drowsy drivers by accurately measuring head and eye positions to classify driver attention and fatigue. TDA processors enable state-of-the-art DMS solutions with artificial intelligence (AI) and computer vision processing in low power processing at the edge, allowing tomorrow's vehicles to be better equipped on the road.
All content and materials on this site are provided "as is". TI and its respective suppliers and providers of content make no representations about the suitability of these materials for any purpose and disclaim all warranties and conditions with regard to these materials, including but not limited to all implied warranties and conditions of merchantability, fitness for a particular purpose, title and non-infringement of any third party intellectual property right. No license, either express or implied, by estoppel or otherwise, is granted by TI. Use of the information on this site may require a license from a third party, or a license from TI.
TI is a global semiconductor design and manufacturing company. Innovate with 100,000+ analog ICs andembedded processors, along with software, tools and the industry’s largest sales/support staff.