Factory Automation - Robotics

Real-Time, Low Power Sense and Control


Newsletter Subscription

Robotics enable improved quality, increased productivity and efficiency in traditional manufacturing, and are rapidly expanding into Warehouse and Supply Automation, Mining, Farming, and Smart City applications. Lattice FPGAs are optimized for the unique requirements that Robotics applications demand:

  • Low power, deterministic sense and control
  • Real time Industrial Networking
  • Machine vision, depth sensing
  • Sensor fusion
  • Motor & Motion Control
  • Artificial Intelligence
  • HW-based Secure Root of Trust

Lattice FPGAs are optimized for Robotics, offering the following benefits:

  • Up to 75% lower power than similar FPGAs
  • Small form factors – from 4mm x 4mm
  • 100x better SER vs other SRAM based FPGAs
  • Optimized Sensor Interfacing
  • Scalable Performance
  • Lattice Stacks: Lattice mVision, Lattice sensAI and Lattice Automate

Lattice solutions stacks provide ready-to-go flexible IP building blocks, reference designs and platforms to further speed development of products.

Robotics

Jump to

Block Diagram

Robotics Block Diagram

Example Use Cases

Machine Vision Camera ProcessingExpand Image

Machine Vision Camera Processing

  • Sensor Interface, Hardened MIPI, SLVS EC, LVDS
  • Customizable ISP for image processing
  • Lattice sensAI Artificial Intelligence for object/defect detection
  • Interface - GigE Vision, USB3 Vision, CoaxPress
Edge AI ProcessingExpand Image

Edge AI Processing

  • Bridge one or multiple CSI-2 image sensors to processor interface
  • Up to 3 Mb of internal RAM for processing
  • Offloads inferencing from CPU for object detection / counting
  • Combine video bridging and edge AI into a single device
Depth SensingExpand Image

Depth Sensing

  • Stereo Vision Reference Design
  • Depth Sensing
  • Collision Avoidance
Multi Axis Motor ControlExpand Image

Multi Axis Motor Control

  • High Performance
  • Multi-Axis
  • Real time sense & control
  • Internal Soft CPU or External CPU
Robot Vision and Control Block DiagramExpand Image

Robot Vision and Control

  • Multi-channel Camera / sensor bridging and aggregation
  • Multi-channel Camera / sensor pre-processing and synchronization
  • Real time sync, sense & control, multi-axis
  • Internal Soft CPU and/or External CPU

Reference Designs

Object Classification Reference Design

Reference Design

Object Classification Reference Design

The Object Classification reference design shows examples on implementing machine-learning based object classification to edge devices applications.
CertusPro-NX, Avant-E, CrossLink-NX 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Space 
Object Classification Reference Design
Hand Gesture Detection

Reference Design

Hand Gesture Detection

Implements a low power AI based system to detect hand gestures using an IR image sensor
iCE40 UltraPlus 
Machine Learning/AI, Gesture Detection, Lattice sensAI 
Hand Gesture Detection
Barcode Detection Reference Design

Reference Design

Barcode Detection Reference Design

Exhibits the barcode detection using CertusPro-NX Voice & Vision Machine Learning Board & its camera barcode detection potential based on Yolov5 NN models.
CertusPro-NX 
Machine Learning/AI, Lattice sensAI, Barcode Detection 
Barcode Detection Reference Design
MIPI CSI-2 to HDMI Reference Design

Reference Design

MIPI CSI-2 to HDMI Reference Design

MIPI CSI-2 to HDMI Reference Design includes the synthesizable MIPI-HDMI core design & stimulus generators, checkers, & a testbench necessary to simulate the design
Avant-E, Avant-G, Avant-X 
Lattice mVision, MIPI, HDMI, CSI-2, I2C 
MIPI CSI-2 to HDMI Reference Design
Scene Segmentation Reference Design

Reference Design

Scene Segmentation Reference Design

Efficient and low power approach for implementing scene segmentation using Lattice CrossLink-NX FPGA
CrossLink-NX 
Lattice sensAI, Machine Learning/AI, SPI, Object Counting, Object Segmentation, Image Processing, Camera, Defense 
Scene Segmentation Reference Design
Show More

Demos

Object Classification Demonstration

Demo

Object Classification Demonstration

This object classification demo provides a sample application for detecting, classifying, and tracking multiple objects running on CertusPro-NX FPGA.
CertusPro-NX, Avant-E 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Space 
Object Classification Demonstration
User Tracking and Onlooker Detection Demonstration

Demo

User Tracking and Onlooker Detection Demonstration

Sample demonstration for detection and tracking of multiple human faces running on a low power general purpose FPGA using CNN Model
CrossLink-NX 
Machine Learning/AI, Lattice sensAI, Image Processing, Camera, FaceI dentification 
User Tracking and Onlooker Detection Demonstration
Lattice Image Signal Processing Demo

Demo

Lattice Image Signal Processing Demo

Provides a complete ISP example design on the Lattice ECP5 FPGA for the Embedded Vision Development Kit, ideal for Industrial, Medical, and Automotive applications.
ECP5 / ECP5-5G, CertusPro-NX 
Image Signal Processing, Lattice mVision, Space, Defense 
Lattice Image Signal Processing Demo
Barcode Detection Demonstration

Demo

Barcode Detection Demonstration

This demo implements an algorithm for barcode detection using the CertusPro-NX Voice and Vision Machine Learning Board.
CertusPro-NX 
Machine Learning/AI, Lattice sensAI, Barcode Detection 
Barcode Detection Demonstration
Human to Machine Interfacing Demonstration

Demo

Human to Machine Interfacing Demonstration

Human-to-machine interface demo uses FPGA-accelerated NN models for detecting, positioning, and identifying persons.
CrossLink-NX 
NN Models, Person Detection, UART, Lattice sensAI 
Human to Machine Interfacing Demonstration
Show More

IP Cores

Image Signal Processing IP Cores Suite

IP Core

Image Signal Processing IP Cores Suite

The Lattice mVision ISP IP Core implements ISP pipelines for image quality enhancements in embedded designs based on Lattice FPGA devices.
CrossLink-NX, Certus-NX, CertusPro-NX, Avant-E 
AXI, AXI-Stream, AXI-Lite Interface, AWB, Camera, CCM, CFA Interpolation, Debayer, Image Processing, Image Signal Processing, Lattice mVision, RGB, Defense 
Image Signal Processing IP Cores Suite
Advanced CNN Accelerator IP

IP Core

Advanced CNN Accelerator IP

Calculates full layers of Neural Network including convolution layer, pooling layer, batch normalization layer, and fully connected layer.
CertusPro-NX, Avant-E 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Home Control Appliances & Security, IoT & Wearables, CNN Bundle 
Advanced CNN Accelerator IP
CNN Plus Accelerator IP Core

IP Core

CNN Plus Accelerator IP Core

CNN Plus IP is a flexible accelerator IP that simplifies implementation of Ultra-Low power AI by leveraging capabilities of Lattice FPGAs.
CrossLink-NX, Certus-NX, CertusPro-NX 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs, Automotive, CNN Bundle 
CNN Plus Accelerator IP Core
Convolutional Neural Network (CNN) Accelerator IP

IP Core

Convolutional Neural Network (CNN) Accelerator IP

Implement AI solutions with CNNs from common or custom networks. Configure up to 16-bit widths. Works with Lattice Neural Network Compiler software tool.
ECP5 / ECP5-5G 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense 
Convolutional Neural Network (CNN) Accelerator IP
Convolutional Neural Network (CNN) Compact Accelerator

IP Core

Convolutional Neural Network (CNN) Compact Accelerator

Implement AI solutions with CNNs or BNNs that have power consumption in the mW range. Works with Lattice Neural Network Compiler software tool.
iCE40 UltraPlus 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs 
Convolutional Neural Network (CNN) Compact Accelerator
Show More

Development Kits & Boards

CertusPro-NX Versa Board

Board

CertusPro-NX Versa Board

CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX 
Lattice mVision, MIPI, LPDDR4, PCIe, Video Tx/Rx, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, SFP, Lattice ORAN, Lattice Automate, GPIO Control, I2C, PMOD, SERDES, SMA, SPI, UART, Automotive, Industrial Networking 
CertusPro-NX Versa Board
Embedded Vision Development Kit

Board

Embedded Vision Development Kit

Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
CrossLink, ECP5 / ECP5-5G 
3D Video, Camera, DDR SDRAM, HDMI, Image Processing, Machine Learning/AI, Lattice sensAI, Signal Aggregation, Video Tx/Rx, VIP, Lattice mVision, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, UAVs 
Embedded Vision Development Kit
CertusPro-NX PCIe Bridge Board

Board

CertusPro-NX PCIe Bridge Board

The CertusPro-NX PCIe Bridge Board enables video bridge capabilities to PCIe and embedded vision type applications.
CertusPro-NX 
Lattice mVision, Lattice ORAN, PCIe, JTAG, SPI Flash, LPDDR4, PMOD, SERDES, X/S/RGMII, Industrial Networking, FMC 
CertusPro-NX PCIe Bridge Board
CrossLink-NX Voice and Vision Machine Learning Board

Board

CrossLink-NX Voice and Vision Machine Learning Board

Designed for low-power machine learning applications with Lattice sensAI and CrossLink-NX. Includes image sensors, microphones, HyperRAM, and expansion ports.
CrossLink-NX 
CSI-2, CSI Camera, Camera, Microphone, PMOD, HyperRAM, Machine Learning/AI, Lattice sensAI, Automotive 
CrossLink-NX Voice and Vision Machine Learning Board
CrossLink-NX-33 Voice and Vision Machine Learning Board

Board

CrossLink-NX-33 Voice and Vision Machine Learning Board

CrossLink-NX-33 Voice and Vision Machine Learning Board is designed using Crosslink-NX 33K, ideal for machine learning applications.
CrossLink-NX 
CSI-2, SPI, CSI Camera, Camera, Microphone, PMOD, Machine Learning/AI, Lattice sensAI, Automotive 
CrossLink-NX-33 Voice and Vision Machine Learning Board
Show More

Support

Technical Support

Need Help? We're Here to Assist You

Licensing

Find The Software & IP Licenses You Need

Quality & Reliability

Reference Material to Help Answer Your Questions

Services

Outside Services to Help Get The Job Done

ABOUT LATTICE

SALES

SUPPORT

FOLLOW