Factory Automation - Machine Vision

From Sensor to Intelligence for Image & Video Processing, OCR, Part Tracking, and more

A new world of intelligent, connected machines enable Industry 4.0 Smart Factory advancements that revolutionize the way goods are manufactured, tested and delivered. Smart Factories improve automation by incorporating Machine Vision algorithms and intelligence for improved quality and thruput.

  • Quality Assurance – package / part inspection / defect detection
  • Measurement / Gauging
  • Guidance, part tracking, and identification
  • Optical character recognition and verification (OCR/OCV)
  • Barcode / 2D readers and Pattern recognition
  • Vision guided Robotics
Machine Vision

Lattice FPGAs are optimized for Machine Vision, offering the following benefits:

  • Up to 75% lower power than similar FPGAs
  • Small form factors – from 4mm x 4mm
  • Optimized Sensor I/F - 2.5Gbps Hardened MIPI D-Phy / lane, 1.5 Gbps I/O for SLVS EC, and LVDS
  • 5Gbps PCI-e for Frame Grabber and Video processing systems
  • High performance / Deterministic Low Latency
  • Lattice mVision and Lattice sensAI solutions stacks

Lattice mVision and Lattice sensAI solutions stacks provide ready-to-go flexible IP building blocks, reference designs and platforms to further speed development of products.

Jump to

Block Diagram

Embedded Vision Camera

Example Use Cases

Machine Vision Camera Processing

  • Sensor Interface, Hardened MIPI, SLVS EC, LVDS
  • Customizable ISP for image processing
  • Lattice sensAI Artificial Intelligence for object/defect detection
  • Interface - GigE Vision, USB3 Vision, CoaxPress

Machine Vision Frame Grabber Video pre/co processing

  • GigE Vision, USB 3 Vision or CoaxPress I/F to PC
  • FPGA pre / co-processing of Video
  • Lattice sensAI Artificial Intelligence for object/defect detection
  • Hardened 5 Gbps PCI-e Gen 2 to host

Multi Sensor Machine Vision Cameras

  • Multi / Hyper Spectral Cameras with dual sensors
  • Environmental Sensors
  • Image fusion / processing
  • 3D / ToF processing
  • Audio processing
  • Interface - GigE Vision, USB3 Vision, CoaxPress

Edge AI Processing

  • Bridge one or multiple CSI-2 image sensors to processor interface
  • Up to 3 Mb of internal RAM for processing
  • Offloads inferencing from CPU for object detection / counting
  • Combine video bridging and edge AI into a single device

Reference Designs

Object Classification Reference Design

Reference Design

Object Classification Reference Design

A reference design for implementing object classification based on Mobilenet NN model running on Lattice CertusPro-NX low power FPGA
Object Classification Reference Design
Hand Gesture Detection

Reference Design

Hand Gesture Detection

Implements a low power AI based system to detect hand gestures using an IR image sensor
Hand Gesture Detection
Key Phrase Detection

Reference Design

Key Phrase Detection

Continuous searches for a key phrase utterance via a digital MEMS microphone. Can be re-configured to work with any trained word or phrase.
Key Phrase Detection
Human Face Identification Reference Design

Reference Design

Human Face Identification Reference Design

Uses a Convolutional Neural Network in the ECP5 FPGA to detect a human face, and match to known registered faces. Can be adapted to work with any other object.
Human Face Identification Reference Design
Human Presence Detection

Reference Design

Human Presence Detection

Uses Lattice sensAI IP to continuously search for the presence of a human and reports results. Can be adapted to detect any other object.
Human Presence Detection

Demos

Object Classification Demonstration

Demo

Object Classification Demonstration

Sample demonstration for object detection, classification, and tracking multiple objects running on a low power general purpose FPGA using CNN Model
Object Classification Demonstration
User Tracking and Onlooker Detection Demostration

Demo

User Tracking and Onlooker Detection Demostration

Sample demonstration for detection and tracking of multiple human faces running on a low power general purpose FPGA using CNN Model
User Tracking and Onlooker Detection Demostration
Key Phrase Detection

Demo

Key Phrase Detection

Uses artificial intelligence (AI) to detect a specific key-phrase using a tiny, low-power iCE40 UltraPlus FPGA
Key Phrase Detection
CSI-2 PCIe Bridge Demonstration

Demo

CSI-2 PCIe Bridge Demonstration

This design demonstrates the functionality of transferring MIPI CSI-2 camera video data to computer via PCIe with a Direct Memory Access (DMA) engine.
CSI-2 PCIe Bridge Demonstration
Lattice Image Signal Processing Demo

Demo

Lattice Image Signal Processing Demo

Provides a complete ISP example design on the Lattice ECP5 FPGA for the Embedded Vision Development Kit, ideal for Industrial, Medical, and Automotive applications.
Lattice Image Signal Processing Demo

IP Cores

CNN Plus Accelerator IP

IP Core

CNN Plus Accelerator IP

Implement Ultra-Low Power AI solutions with CNNs. Configure up to 16-bit widths. Works with Lattice Neural Network Compiler software tool.
CNN Plus Accelerator IP
Convolutional Neural Network (CNN) Accelerator IP

IP Core

Convolutional Neural Network (CNN) Accelerator IP

Implement AI solutions with CNNs from common or custom networks. Configure up to 16-bit widths. Works with Lattice Neural Network Compiler software tool.
Convolutional Neural Network (CNN) Accelerator IP
Convolutional Neural Network (CNN) Compact Accelerator

IP Core

Convolutional Neural Network (CNN) Compact Accelerator

Implement AI solutions with CNNs or BNNs that have power consumption in the mW range. Works with Lattice Neural Network Compiler software tool.
Convolutional Neural Network (CNN) Compact Accelerator
Helion IONOS Image Signal Processing IP Portfolio

IP Core

Helion IONOS Image Signal Processing IP Portfolio

Comprehensive, high-quality, highly-configurable ISP solution from Helion Vision, from basic to advanced High Dynamic Range Imaging (HDRI) color pipelines.
Helion IONOS Image Signal Processing IP Portfolio

Development Kits & Boards

CertusPro-NX Versa Board

Board

CertusPro-NX Versa Board

CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX Versa Board
Embedded Vision Development Kit

Board

Embedded Vision Development Kit

Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
Embedded Vision Development Kit
CrossLink-NX Voice and Vision Machine Learning Board

Board

CrossLink-NX Voice and Vision Machine Learning Board

Designed for low-power machine learning applications with Lattice sensAI and CrossLink-NX. Includes image sensors, microphones, HyperRAM, and expansion ports.
CrossLink-NX Voice and Vision Machine Learning Board
CertusPro-NX Voice and Vision Machine Learning Board

Board

CertusPro-NX Voice and Vision Machine Learning Board

Design AI use cases for the Edge quickly! This board along with the Lattice sensAI solution stack provide the tools for developing vision and audio-based AI applications.
CertusPro-NX Voice and Vision Machine Learning Board

Support

Technical Support

Need Help? We're Here to Assist You

Quality & Reliability

Reference Material to Help Answer Your Questions

Like most websites, we use cookies and similar technologies to enhance your user experience. We also allow third parties to place cookies on our website. By continuing to use this website you consent to the use of cookies as described in our Cookie Policy.