Machine Vision | FPGA Factory Automation

Related Applications

A new world of intelligent, connected machines enable Industry 4.0 Smart Factory advancements that revolutionize the way goods are manufactured, tested and delivered. Smart Factories improve automation by incorporating Machine Vision algorithms and intelligence for improved quality and thruput.

Quality Assurance – package / part inspection / defect detection
Measurement / Gauging
Guidance, part tracking, and identification
Optical character recognition and verification (OCR/OCV)
Barcode / 2D readers and Pattern recognition
Vision guided Robotics

Lattice FPGAs are optimized for Machine Vision, offering the following benefits:

Up to 75% lower power than similar FPGAs
Small form factors – from 4mm x 4mm
Optimized Sensor I/F - 2.5Gbps Hardened MIPI D-Phy / lane, 1.5 Gbps I/O for SLVS EC, and LVDS
5Gbps PCI-e for Frame Grabber and Video processing systems
High performance / Deterministic Low Latency
Lattice mVision and Lattice sensAI solutions stacks

Lattice mVision and Lattice sensAI solutions stacks provide ready-to-go flexible IP building blocks, reference designs and platforms to further speed development of products.

Block Diagram

Example Use Cases

Expand Image

IP Network Camera

Sensor Interface - MIPI, LVDS
Customizable ISP for image processing
Lattice sensAI Artificial Intelligence for object/defect detection
JPEG-XS compression enables lossless low latency streaming over Gigabit IP Networks

Expand Image

Machine Vision Camera Processing

Sensor Interface, Hardened MIPI, SLVS EC, LVDS
Customizable ISP for image processing
Lattice sensAI Artificial Intelligence for object/defect detection
Interface - GigE Vision, USB3 Vision, CoaxPress

Expand Image

Machine Vision Frame Grabber Video pre/co processing

GigE Vision, USB 3 Vision or CoaxPress I/F to PC
FPGA pre / co-processing of Video
Lattice sensAI Artificial Intelligence for object/defect detection
Hardened 5 Gbps PCI-e Gen 2 to host

Expand Image

Multi Sensor Machine Vision Cameras

Multi / Hyper Spectral Cameras with dual sensors
Environmental Sensors
Image fusion / processing
3D / ToF processing
Audio processing
Interface - GigE Vision, USB3 Vision, CoaxPress

Expand Image

Edge AI Processing

Bridge one or multiple CSI-2 image sensors to processor interface
Up to 3 Mb of internal RAM for processing
Offloads inferencing from CPU for object detection / counting
Combine video bridging and edge AI into a single device

Reference Designs

Demos

Demo
 Lattice Image Signal Processing Demo Provides a complete ISP example design on the Lattice ECP5 FPGA for the Embedded Vision Development Kit, ideal for Industrial, Medical, and Automotive applications.
ECP5, CertusPro-NX 
Image Signal Processing, Lattice mVision, Space, Defense, Satellite Communications, Launchers 
Demo
 Barcode Detection Demonstration This demo implements an algorithm for barcode detection using the CertusPro-NX Voice and Vision Machine Learning Board.
CertusPro-NX 
Machine Learning/AI, Lattice sensAI, Barcode Detection 
Demo
 Defect Detection Demonstration Enabling real-time detection and classification of defects in manufacturing, assembly, and inspection processes.
CertusPro-NX 
PCIe, USB, SPI, I2C, AXI, APB, D-PHY, OSPI, Lattice sensAI 
Demo
 Human to Machine Interfacing Demonstration Human-to-machine interface demo uses FPGA-accelerated NN models for detecting, positioning, and identifying persons.
CrossLink-NX 
NN Models, Person Detection, UART, Lattice sensAI, sensAIEdgeVisionSDK 
Demo
 Multi Object Detection Demonstration Enabling real-time detection, classification, and tracking of multiple objects in diverse environments.
CertusPro-NX 
D-PHY, OSPI, PCIe, USB, SPI, I2C, AXI, APB, Lattice sensAI 

IP Cores

IP Core
 MIPI CSI/DSI IP Core The MIPI® CSI/DSI IP is the unified and re-architected MIPI IP that provides a flexible solution for transmission and reception of high-speed video data over a Mobile Industry Processor Interface (MIPI)-compatible D-PHY interface in FPGA designs.
CrossLink-NX, Certus-NX, CertusPro-NX, MachXO5-NX 
CSI-2, DSI, MIPI, Modular MIPI/D-PHY, Video Tx/Rx, Lattice mVision, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Smart Toys & Robots, Tablets, Automotive, MIPI Bundle, Lattice Drive 
IP Core
 Image Signal Processing IP Cores Suite The Lattice mVision ISP IP Core implements ISP pipelines for image quality enhancements in embedded designs based on Lattice FPGA devices.
CrossLink-NX, Certus-NX, CertusPro-NX, Avant-E, Avant-G, Avant-X, Certus-N2 
AXI, AXI-Stream, AXI-Lite Interface, AWB, Camera, CCM, CFA Interpolation, Debayer, Image Processing, Image Signal Processing, Lattice mVision, RGB, Defense, Avionics 
IP Core
 Advanced CNN Accelerator IP Calculates full layers of Neural Network including convolution layer, pooling layer, batch normalization layer, and fully connected layer.
CertusPro-NX, Avant-E, Avant-X 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Home Control Appliances & Security, IoT & Wearables, CNN Bundle, Avionics 
IP Core
 CNN Plus Accelerator IP Core CNN Plus IP is a flexible accelerator IP that simplifies implementation of Ultra-Low power AI by leveraging capabilities of Lattice FPGAs.
CrossLink-NX, Certus-NX, CertusPro-NX 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs, Automotive, CNN Bundle 
IP Core
 Helion IONOS Image Signal Processing IP Portfolio Comprehensive, high-quality, highly-configurable ISP solution from Helion Vision, from basic to advanced High Dynamic Range Imaging (HDRI) color pipelines.
MachXO, LatticeXP2, LatticeECP3, CrossLink, ECP5, CrossLink-NX 
HDR, Image Processing, Video Tx/Rx, Lattice mVision, Automotive, Avionics 

Development Kits & Boards

Board
 CertusPro-NX Versa Board CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX 
Lattice mVision, MIPI, LPDDR4, PCIe, Video Tx/Rx, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, SFP, Lattice ORAN, Lattice Automate, GPIO Control, I2C, PMOD, SERDES, SMA, SPI, UART, Automotive, Industrial Networking, Embedded, HSB 
Board
 Embedded Vision Development Kit Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
CrossLink, ECP5 
3D Video, Camera, DDR SDRAM, HDMI, Image Processing, Machine Learning/AI, Signal Aggregation, Video Tx/Rx, VIP, Lattice mVision, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, UAVs 
Board
 CertusPro-NX PCIe Bridge Board The CertusPro-NX PCIe Bridge Board enables video bridge capabilities to PCIe and embedded vision type applications.
CertusPro-NX 
Lattice mVision, Lattice ORAN, PCIe, JTAG, SPI Flash, LPDDR4, PMOD, SERDES, X/S/RGMII, Industrial Networking, FMC 
Board
 CertusPro-NX System on Module (SoM) Board CertusPro-NX SOM Board is a comprehensive platform for rapid prototyping, proof-of-concept development, and demonstration of high-performance embedded and AI-driven applications.
CertusPro-NX 
SOM, RPi, HyperRAM, MIPI, PCIe, Lattice sensAI 
Board
 CrossLinkU-NX System on Module (SoM) Board This SOM provides direct access to CSI-2 input, USB 3.1 Device interface, digital I/O, and an Always-On (AON) feature, enabling advanced functionality with lowest power footprint in compact designs.
CrossLink-NX 
SOM, RPi, HyperRAM, MIPI, PCIe, Lattice sensAI 