Human to Machine Interfacing Demonstration

Embedded Solution to Improve How Users Interact with Devices

Experience the future of Human-Machine Interfaces (HMI) with the Lattice sensAI™. This powerful solution enables intuitive, touchless, and intelligent interactions across industrial, automotive, consumer, and client computing segments.

Human to machine interfacing demonstration leverages advanced computer vision models enabling functions such as user detection, head position tracking in 3D, facial landmarks tracking, hand detection and landmarks tracking and identification of the user.

The experience is fully running on FPGA, video and meta data is shipped to a host Processor (RPi) via MIPI and I2C. The video and meta data overlayed on top can be viewed in the HUB software on the processor. This demo runs on CrossLink-NX and CertusPro-NX SOM boards.

Features

  • Efficient AI/ML models deliver real-time responsiveness without compromising accuracy
  • Compatible with multiple platforms, giving developers freedom to choose optimal hardware
  • Built-in features enhance authentication and privacy protection
  • Pre-trained models and optimized tools streamline development and deployment
  • Easily integrates with existing infrastructure, supporting both new and legacy systems

To learn more about this product design and to access the complete source code and user guide, please click below

Block Diagram

Human to Machine - Block Diagram

Documentation

Information Resources
Downloads
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Enhancing Human-Machine Interfaces with Advanced User Context Awareness
WP0045 1.0 7/9/2025 PDF 4.5 MB
Human-Machine Interface Applications Enabled by Lattice sensAI Edge Vision Engine
WP-SB0004 1.0 5/20/2025 PDF 3.7 MB
Power-efficient, Always-on Vehicle Video Security—Multi-day Protection with No Compromise
WP-SB0005 1.0 9/30/2025 PDF 1.9 MB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Human to Machine Interfacing Demonstration Documentation
To learn more about this product design and to access the bitstream and user guide in GitHub, please click here
12/18/2025 WEB

*By clicking on the "Notify Me of Changes" button, you agree to receive notifications on changes to the document(s) you selected.