Human to Machine Interfacing Demonstration

Embedded Solution to Improve How Users Interact with Devices

Human to machine interfacing demo is a collection of NN models accelerated on FPGA to enable user detection, position and pose of the detected persons’ bodies, faces, distance to the camera and identification status.

The experience is fully running on FPGA, video and meta data is shipped to a host PC via USB and UART. The sensAI Edge AI Vision Engine tool can be used to visualize the Person Detection pipeline output overlayed over the camera image output from the USB. HW supported is the CrossLink-NX-33 VVML board with a USB to TTL adapter for meta data transmission.

Features

  • Based on Mobilenet v1 network
  • Accelerated, low-power object detection demo
  • Processing at up to 30 FPS and 160x160 resolution
  • Total application power consumption of CrossLink-NX FPGA is between 10mW to 250mW

Block Diagram

Documentation

快速参考
下载
标题 编号 版本 日期 格式 文件大小
选择全部
Lattice sensAI FPGA AI Firmware - User Guide
FPGA-UG-02229 1.0 12/10/2024 PDF 630.4 KB
标题 编号 版本 日期 格式 文件大小
选择全部
Lattice sensAI FPGA AI Firmware - Source Code
2/11/2025 ZIP 2.6 MB