Lattice sensAI™ 解决方案堆栈

加速网络边缘灵活、低功耗推理的集成

Lattice sensAI is an AI/ML solution stack designed for low-power, small-footprint FPGA-based artificial intelligence (AI) and machine learning (ML) applications, primarily at the far-edge near-sensor devices. It provides a combination of FPGA hardware, software tools, and IP cores to enable AI inferencing on embedded systems.
sensAI Stack

Key Features of sensAI:

  1. Optimized for Low Power & Low Latency next to the sensor
    • Designed to run AI/ML workloads efficiently on Lattice’s low-power FPGAs (like CrossLink-NX, Certus-NX, and Nexus-based devices).
    • Ideal for always-on and real-time AI processing.
  2. Production-Ready End Use-Case and Applications
    • Accelerate time-to-market with a growing library of validated use-cases and applications, reducing development risk and enabling quick deployment in real-world scenarios.
  3. Pre-Optimized IP Cores & Reference Designs
    • Comes with pre-optimized neural network IP cores for functions like face detection, object recognition, anomaly detection, and gesture control.
    • Helps accelerate development time for AI applications.
  4. Toolchain: Lattice sensAI Studio
    • Provides an end-to-end AI development environment, integrating model training, optimization, compilation, and FPGA deployment.
    • Supports hardware/software co-design, allowing users to fine-tune models for specific use cases.
  5. SDK: Lattice sensAI Edge Vision Engine
    • The SDK and experience visualization tool enable next-generation Human-Machine Interface (HMI) applications with advanced computer vision capabilities in FPGA, ARM, or x86 platforms.

To learn more about this product design and to access the complete documentation in GitHub, please click below.

跳转到

系统架构示例

下图展示了如何利用 FPGA 为传感器附近的 AI 和机器学习解决方案提供支持。Lattice FPGA 提供强大且可扩展的 AI/ML 解决方案,这些解决方案简单易用、功耗低且体积小巧。向下滚动即可查看您可以立即下载和评估的硬件演示。

预处理器:Lattice FPGA人工智能加速器

  • Reduce System Power and Latency
    • Offload AI inferencing from the host SoC to the FPGA to enable real-time decision-making with minimal energy consumption.
  • Enable Always-On Intelligence at the Edge
    • Keep AI processing close to the sensor, enabling continuous, context-aware operation without relying on high-power computing.
  • Optimize Bandwidth and System Efficiency
    • Pre-process and filter sensor data locally, sending only meaningful results to the host—reducing data transfer and overall system load.

软件工具

  • Lattice sensAI Studio – an intuitive development environment that streamlines the creation, optimization, compilation, and deployment of AI models onto low-power edge FPGA devices.
  • Lattice sensAI Edge Vision Engine – production-ready AI/ML for FPGAs, PCs, and ARM, enabling advanced computer vision end-use-cases and applications.
  • FPGA design tools:
    • Lattice Radiant Software – Design tool for developing, debugging, and programming Lattice FPGAs efficiently.
    • Lattice Propel Software – Design Environment for Lattice FPGA-based Processor System Design 
    • Model Zoo – Purpose built pretrained models for various use cases available here
      • To request access to the models’ source, please email us here.

视频

Lattice_Industrial HMI_Thumbnail

LDC24 Demo - Industrial HMI

This demo showcases industrial human-machine interface (HMI) with advanced operated attention sensing and identification. Seamlessly connect with your machinery, gaining real-time insights and control.

LDC24 Demo - Driver Monitoring System_Thumbnail

LDC24 Demo - Driver Monitoring System on Lattice Avant™ FPGA

The driver monitoring system on the Lattice Avant FPGA, which uses advanced AI to analyze driver states like drowsiness and distraction through 3D facial landmarks and head pose analysis. This system runs complex pipelines efficiently, maintaining a 40 FPS rate.

LatticeLattice Drive 20 Driver MonitorThumbnail

LDC24 Guest Keynote – Dell “Future of AI based Context Sensing in Edge Devices”

Dell’s guest keynote session at the Lattice Developers Conference focusing on the integration of low power FPGAs in edge computing solutions. In this talk, Dell discussed how these technologies are driving advancements in data processing and AI at the edge, enabling more efficient and powerful computing capabilities.

Gesture & Gaze

Gesture & Gaze

This demo showcases the AI capabilities that Lattice sensAI™ will enable on future Lattice FPGAs, focusing on gesture and gaze tracking.
sensAI Studio

Lattice sensAI™ Studio

In this demo, users can explore the latest tools from Lattice. They will have the opportunity to run examples for FPGA simulation, neural network training, and compilation for specific devices.

参考设计

POS PHY Level 3链路

Reference Design

POS PHY Level 3链路

Enables real-time detection, classification, and tracking of multiple objects in images and video streams at the edge.
POS PHY Level 3链路
POS PHY Level 3链路

Reference Design

POS PHY Level 3链路

Enables real-time identification and classification of defects in manufacturing, assembly, and inspection processes at the edge.
POS PHY Level 3链路
条码检测参考设计

Reference Design

条码检测参考设计

该演示使用了CertusPro-NX语音和视觉机器学习板及其基于Yolov5 NN模型的摄像头条形码检测功能。
条码检测参考设计

演示示例

 Multi Object Detection Demonstration

演示

Multi Object Detection Demonstration

Enabling real-time detection, classification, and tracking of multiple objects in diverse environments.
 Multi Object Detection Demonstration
Defect Detection Demonstration

演示

Defect Detection Demonstration

Enabling real-time detection and classification of defects in manufacturing, assembly, and inspection processes.
Defect Detection Demonstration
Human to Machine Interfacing Demonstration

演示

Human to Machine Interfacing Demonstration

Human-to-machine interface demo uses FPGA-accelerated NN models for detecting, positioning, and identifying persons.
Human to Machine Interfacing Demonstration
条码检测演示

演示

条码检测演示

该演示使用CertusPro-NX语音和视觉机器学习板实现条码检测算法。
条码检测演示

开发套件和开发板

CrossLink-NX声音和视觉机器学习板

Board

CrossLink-NX声音和视觉机器学习板

专为采用莱迪思sensAI和CrossLink-NX器件的低功耗机器学习应用而设计。包括图像传感器、麦克风、HyperRAM和扩展端口。
CrossLink-NX声音和视觉机器学习板
CertusPro-NX System on Module (SoM) Board

Board

CertusPro-NX System on Module (SoM) Board

CertusPro-NX SOM Board is a comprehensive platform for rapid prototyping, proof-of-concept development, and demonstration of high-performance embedded and AI-driven applications.
CertusPro-NX System on Module (SoM) Board
CertusPro-NX声音和视觉机器学习板

Board

CertusPro-NX声音和视觉机器学习板

快速为网络边缘设计AI用例!该开发板与莱迪思sensAI解决方案集合提供了用于开发基于视觉和音频的AI应用的工具。
CertusPro-NX声音和视觉机器学习板
CrossLinkU-NX System on Module (SoM) Board

Board

CrossLinkU-NX System on Module (SoM) Board

This SOM provides direct access to CSI-2 input, USB 3.1 Device interface, digital I/O, and an Always-On (AON) feature, enabling advanced functionality with lowest power footprint in compact designs.

IP核

高级CNN加速器IP

IP Core

高级CNN加速器IP

计算神经网络的各个网络层,包括卷积层、池化层、批量归一化层和全连接层。
高级CNN加速器IP
CNN Plus加速器IP

IP Core

定制设计服务

The Lattice sensAI stack includes an ecosystem of select, worldwide design service partners that can deliver custom solutions for a range of end-applications, including mobile, smart home, smart city, smart factory, and smart cars. Click here for more information on Lattice sensAI certified partners.

文档

资讯资源
下载
标题 编号 版本 日期 格式 文件大小
选择全部
莱迪思sensAI产品手册
I0265 8.0 4/4/2025 PDF 605.4 KB
标题 编号 版本 日期 格式 文件大小
选择全部
Human-Machine Interface Applications Enabled by Lattice sensAI Edge Vision Engine
WP-SB0004 1.0 5/20/2025 PDF 3.7 MB
Power-efficient, Always-on Vehicle Video Security—Multi-day Protection with No Compromise
WP-SB0005 1.0 9/30/2025 PDF 1.9 MB
Enhancing Human-Machine Interfaces with Advanced User Context Awareness
WP0045 1.0 7/9/2025 PDF 4.5 MB
标题 编号 版本 日期 格式 文件大小
选择全部
Lattice sensAI™ Solution Stack Documentation
To learn more about this product design and to access the complete documentation in GitHub, please click here.
12/18/2025 WEB

获奖情况

2025年人工智能卓越奖

边缘人工智能类别

2024年EDGE奖获奖者

机器视觉与检测类别

2023年人工智能卓越奖

计算机视觉类别