3 key considerations for the next generation of HMI

Other Parts Discussed in Post: IWR6843AOP

In the past, a human machine interface (HMI) consisted of a physical control panel with push buttons, switches and indicator lights that enabled users to communicate with a machine. As the technology progressed, it became possible for users to monitor processes, see status information displays and send commands. Now, HMI applications are everywhere, including smartphone apps used to control televisions, voice commands in a vehicle, patient monitoring in hospitals or touchscreen control panels in a smart factory

We continue to see increased touchpoints with machines in our everyday life. So what does the future of HMI look like? Beyond data collection, control and display, the next generation of HMI will take applications beyond just human machine interfaces to methods of providing human machine interaction where machines can act intelligently and communicate with humans. For example, access to buildings through touchless interaction, object and gesture detection, and facial recognition, as shown in the video "Smart building access."

Demo video: Smart and touchless building access demo featuring TI Arm®-based AM62x processors and the
IWR6843AOP TI mmWave sensor

Moving into a new world of human-machine interaction will require interactive, smart applications with a new set of challenges for the processors that make HMI possible. Let’s walk through three considerations for the next generation of HMI.

No. 1: Enabling new functions with AI at the edge

The new generation of HMI designs will rely on edge artificial intelligence (AI) to enable new functions. For example, machine vision can enable controlled access to a machine through facial recognition or enable touchless operation with gesture recognition like the example in figure 1. Additionally, adding edge AI capabilities like machine vision to HMI designs can enable more accurate analytics for current system statuses and predictive maintenance. When creating new HMI applications, you will need to consider the effort around edge AI application development, as well as processor capabilities.

Figure 1: A medical professional uses gesture recognition to interact with an intelligent HMI system

No. 2: Balancing performance with power

High levels of integration on a single chip affect device power consumption, especially when edge AI functions are fully enabled. The small form factors typically required in smart designs, especially in harsh environments, add another layer of complexity to the power consumption of an end product. Designers will have to overcome the challenge creating a highly power-efficient design, mindful of thermal restrictions, without increasing the overall system cost. An optimized power design should include ultra-low-power and multiple low-power modes to enable a longer life of a product.

No. 3: Integrating smart connectivity and differentiated display support

The increasing number of field-level devices and sensors and emerging real-time industrial communication protocols also pose challenges to new HMI applications. For example, an HMI in a smart factory environment will need to communicate with other devices and machines, which means that the HMI design will require connectivity and control functions. Display is another design consideration for HMI and can provide unique features and ways of enhancing communication between humans and machines.

Using TI’s new processor family in HMI designs

As HMI continues to evolve, the processor technology behind these applications must be ready to enable that evolution. Designed for low power with many industrial peripherals, the first devices in TI’s SitaraTm AM62 processor family, the AM625 and AM623 processors, bring power-efficient edge AI processing to dual-display and small-form applications with considerations for the next generation of HMI.

AM62 processors enhance the implementation of edge AI functions with a scalable single- to quad-core Arm® Cortex®-A53 up to a 1.4-GHz platform and with mainline Linux® supporting TensorFlow. Software and out-of-box demos simplify the process of evaluating an edge AI application on AM62 processors, while edge AI development resources and academies help save design effort and time.

The processor’s optimized power design supports a core voltage 30% lower when compared to the last generation, reducing system power consumption by up to 50% while delivering higher performance. A simplified hardware design enables a cost-effective system solution within a compact size. Multiple power modes as low as 7 mW on core power enable portable and battery-powered designs.

How do AM62 processors reduce system power consumption?

 Learn more about the AM62 power management features, architecture considerations and power consumption in our white paper, "Enabling Low Power Embedded Systems With AM62x Processors."

On-chip resources, including universal asynchronous receiver transmitter, Serial Peripheral Interface and I2C, offer various connection options for popular industrial sensors or controllers. AM62 processors also provide dual Ethernet support and EtherCAT master support with a third-party ecosystem.

AM62 processors support a wide variety of display interfaces, including the cost-effective RGB888 and a low-voltage differential signaling interface supporting 2K and full high definition displays. Dual-display capabilities enable design flexibility and innovation.


The future of HMI will bring about intelligence and innovation in human and machine communication across a wide variety of environments and applications. Imagine an operating room where a medical professional can interact with a patient monitoring system with their voice instead of tapping a screen to preserve the sterile environment, or a noisy factory where a worker can use a control panel with just a gesture. Get started on your next-generation HMI design with the AM62 processor family.

Additional resources