Lattice sensAI™ Solution Stack

Accelerate Integration of Flexible, Low Power Inferencing at the Edge

Related Products

Related Applications

Lattice sensAI is an AI/ML solution stack designed for low-power, small-footprint FPGA-based artificial intelligence (AI) and machine learning (ML) applications, primarily at the far-edge near-sensor devices. It provides a combination of FPGA hardware, software tools, and IP cores to enable AI inferencing on embedded systems.
sensAI Stack

Key Features of sensAI:

  1. Optimized for Low Power & Low Latency next to the sensor
    • Designed to run AI/ML workloads efficiently on Lattice’s low-power FPGAs (like CrossLink-NX, Certus-NX, and Nexus-based devices).
    • Ideal for always-on and real-time AI processing.
  2. Production-Ready End Use-Case and Applications
    • Accelerate time-to-market with a growing library of validated use-cases and applications, reducing development risk and enabling quick deployment in real-world scenarios.
  3. Pre-Optimized IP Cores & Reference Designs
    • Comes with pre-optimized neural network IP cores for functions like face detection, object recognition, anomaly detection, and gesture control.
    • Helps accelerate development time for AI applications.
  4. Toolchain: Lattice sensAI Studio
    • Provides an end-to-end AI development environment, integrating model training, optimization, compilation, and FPGA deployment.
    • Supports hardware/software co-design, allowing users to fine-tune models for specific use cases.
  5. SDK: Lattice sensAI Edge Vision Engine
    • The SDK and experience visualization tool enable next-generation Human-Machine Interface (HMI) applications with advanced computer vision capabilities in FPGA, ARM, or x86 platforms.

To learn more about this product design and to access the complete documentation in GitHub, please click below.

Jump To

System Architecture

The diagram below shows how an FPGA is typically utilized to power AI and machine learning solutions near sensors. Lattice FPGAs offer robust and scalable AI/ML solutions that are simple, low-power, and compact. Scroll down to explore hardware demonstrations that you can download and evaluate today.

Expand Image

Pre-processor: Lattice FPGA AI Accelerator

  • Reduce System Power and Latency
    • Offload AI inferencing from the host SoC to the FPGA to enable real-time decision-making with minimal energy consumption.
  • Enable Always-On Intelligence at the Edge
    • Keep AI processing close to the sensor, enabling continuous, context-aware operation without relying on high-power computing.
  • Optimize Bandwidth and System Efficiency
    • Pre-process and filter sensor data locally, sending only meaningful results to the host—reducing data transfer and overall system load.

Software Tools

  • Lattice sensAI Studio – an intuitive development environment that streamlines the creation, optimization, compilation, and deployment of AI models onto low-power edge FPGA devices.
  • Lattice sensAI Edge Vision Engine – production-ready AI/ML for FPGAs, PCs, and ARM, enabling advanced computer vision end-use-cases and applications.
  • FPGA design tools:
    • Lattice Radiant Software – Design tool for developing, debugging, and programming Lattice FPGAs efficiently.
    • Lattice Propel Software – Design Environment for Lattice FPGA-based Processor System Design 
    • Model Zoo – Purpose built pretrained models for various use cases available here
      • To request access to the models’ source, please email us here.

Videos

Lattice_Industrial HMI_Thumbnail
Expand Video

LDC24 Demo - Industrial HMI

This demo showcases industrial human-machine interface (HMI) with advanced operated attention sensing and identification. Seamlessly connect with your machinery, gaining real-time insights and control.

LDC24 Demo - Driver Monitoring System_Thumbnail
Expand Video

LDC24 Demo - Driver Monitoring System on Lattice Avant™ FPGA

The driver monitoring system on the Lattice Avant FPGA, which uses advanced AI to analyze driver states like drowsiness and distraction through 3D facial landmarks and head pose analysis. This system runs complex pipelines efficiently, maintaining a 40 FPS rate.

LatticeLattice Drive 20 Driver MonitorThumbnail
Expand Video

LDC24 Guest Keynote – Dell “Future of AI based Context Sensing in Edge Devices”

Dell’s guest keynote session at the Lattice Developers Conference focusing on the integration of low power FPGAs in edge computing solutions. In this talk, Dell discussed how these technologies are driving advancements in data processing and AI at the edge, enabling more efficient and powerful computing capabilities.

Gesture & Gaze
Expand Video

Gesture & Gaze

This demo showcases the AI capabilities that Lattice sensAI™ will enable on future Lattice FPGAs, focusing on gesture and gaze tracking.
sensAI Studio
Expand Video

Lattice sensAI™ Studio

In this demo, users can explore the latest tools from Lattice. They will have the opportunity to run examples for FPGA simulation, neural network training, and compilation for specific devices.

Reference Designs

Barcode Detection Reference Design

Reference Design

Barcode Detection Reference Design

Exhibits the barcode detection using CertusPro-NX Voice & Vision Machine Learning Board & its camera barcode detection potential based on Yolov5 NN models.
CertusPro-NX 
Machine Learning/AI, Lattice sensAI, Barcode Detection 
Barcode Detection Reference Design
Defect Detection Reference Design

Reference Design

Defect Detection Reference Design

Enables real-time identification and classification of defects in manufacturing, assembly, and inspection processes at the edge.
CertusPro-NX 
D-PHY, OSPI, PCIe, USB, SPI, I2C, AXI, APB, Lattice sensAI 
Defect Detection Reference Design
Multi Object Detection Reference Design

Reference Design

Multi Object Detection Reference Design

Enables real-time detection, classification, and tracking of multiple objects in images and video streams at the edge.
CertusPro-NX 
D-PHY, OSPI, PCIe, USB, SPI, I2C, AXI, APB, Lattice sensAI 
Multi Object Detection Reference Design

Demos

Multi Object Detection Demonstration

Demo

Multi Object Detection Demonstration

Enabling real-time detection, classification, and tracking of multiple objects in diverse environments.
CertusPro-NX 
D-PHY, OSPI, PCIe, USB, SPI, I2C, AXI, APB, Lattice sensAI 
Multi Object Detection Demonstration
Barcode Detection Demonstration

Demo

Barcode Detection Demonstration

This demo implements an algorithm for barcode detection using the CertusPro-NX Voice and Vision Machine Learning Board.
CertusPro-NX 
Machine Learning/AI, Lattice sensAI, Barcode Detection 
Barcode Detection Demonstration
Defect Detection Demonstration

Demo

Defect Detection Demonstration

Enabling real-time detection and classification of defects in manufacturing, assembly, and inspection processes.
CertusPro-NX 
PCIe, USB, SPI, I2C, AXI, APB, D-PHY, OSPI, Lattice sensAI 
Defect Detection Demonstration
Human to Machine Interfacing Demonstration

Demo

Human to Machine Interfacing Demonstration

Human-to-machine interface demo uses FPGA-accelerated NN models for detecting, positioning, and identifying persons.
CrossLink-NX 
NN Models, Person Detection, UART, Lattice sensAI, sensAIEdgeVisionSDK 
Human to Machine Interfacing Demonstration

Development Kits & Boards

CertusPro-NX System on Module (SoM) Board

Board

CertusPro-NX System on Module (SoM) Board

CertusPro-NX SOM Board is a comprehensive platform for rapid prototyping, proof-of-concept development, and demonstration of high-performance embedded and AI-driven applications.
CertusPro-NX 
SOM, RPi, HyperRAM, MIPI, PCIe, Lattice sensAI 
CertusPro-NX System on Module (SoM) Board
CrossLinkU-NX System on Module (SoM) Board

Board

CrossLinkU-NX System on Module (SoM) Board

This SOM provides direct access to CSI-2 input, USB 3.1 Device interface, digital I/O, and an Always-On (AON) feature, enabling advanced functionality with lowest power footprint in compact designs.
CertusPro-NX 
SOM, RPi, HyperRAM, MIPI, PCIe, Lattice sensAI 

IP Cores

Advanced CNN Accelerator IP

IP Core

Advanced CNN Accelerator IP

Calculates full layers of Neural Network including convolution layer, pooling layer, batch normalization layer, and fully connected layer.
CertusPro-NX, Avant-E, Avant-X 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Home Control Appliances & Security, IoT & Wearables, CNN Bundle, Avionics 
Advanced CNN Accelerator IP
CNN Plus Accelerator IP Core

IP Core

CNN Plus Accelerator IP Core

CNN Plus IP is a flexible accelerator IP that simplifies implementation of Ultra-Low power AI by leveraging capabilities of Lattice FPGAs.
CrossLink-NX, Certus-NX, CertusPro-NX 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs, Automotive, CNN Bundle 
CNN Plus Accelerator IP Core

Custom Design Services

The Lattice sensAI stack includes an ecosystem of select, worldwide design service partners that can deliver custom solutions for a range of end-applications, including mobile, smart home, smart city, smart factory, and smart cars. Click here for more information on Lattice sensAI certified partners.

Documentation

Information Resources
Downloads
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Lattice sensAI Stack Product Brochure
I0265 8.0 4/4/2025 PDF 914.3 KB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Enhancing Human-Machine Interfaces with Advanced User Context Awareness
WP0045 1.0 7/9/2025 PDF 4.5 MB
Human-Machine Interface Applications Enabled by Lattice sensAI Edge Vision Engine
WP-SB0004 1.0 5/20/2025 PDF 3.7 MB
Power-efficient, Always-on Vehicle Video Security—Multi-day Protection with No Compromise
WP-SB0005 1.0 9/30/2025 PDF 1.9 MB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Lattice sensAI™ Solution Stack Documentation
To learn more about this product design and to access the complete documentation in GitHub, please click here. 		12/18/2025 WEB

*By clicking on the "Notify Me of Changes" button, you agree to receive notifications on changes to the document(s) you selected.

Awards

AI-ExcellenceAward-2025Expand Image

2025 AI Excellence Award

Edge AI category
Edge Awards - HonoreeExpand Image

2024 EDGE Awards Honoree

Machine Vision & Inspection category
2023 AI Excellence Award Avant sensAI - GraphicsExpand Image

2023 AI Excellence Award

Computer Vision category

ABOUT LATTICE

SALES

SUPPORT

FOLLOW