Factory Automation - Machine Vision

From Sensor to Intelligence for Image & Video Processing, OCR, Part Tracking, and more

Related Applications


Newsletter Subscription

A new world of intelligent, connected machines enable Industry 4.0 Smart Factory advancements that revolutionize the way goods are manufactured, tested and delivered. Smart Factories improve automation by incorporating Machine Vision algorithms and intelligence for improved quality and thruput.

  • Quality Assurance – package / part inspection / defect detection
  • Measurement / Gauging
  • Guidance, part tracking, and identification
  • Optical character recognition and verification (OCR/OCV)
  • Barcode / 2D readers and Pattern recognition
  • Vision guided Robotics
Machine Vision

Lattice FPGAs are optimized for Machine Vision, offering the following benefits:

  • Up to 75% lower power than similar FPGAs
  • Small form factors – from 4mm x 4mm
  • Optimized Sensor I/F - 2.5Gbps Hardened MIPI D-Phy / lane, 1.5 Gbps I/O for SLVS EC, and LVDS
  • 5Gbps PCI-e for Frame Grabber and Video processing systems
  • High performance / Deterministic Low Latency
  • Lattice mVision and Lattice sensAI solutions stacks

Lattice mVision and Lattice sensAI solutions stacks provide ready-to-go flexible IP building blocks, reference designs and platforms to further speed development of products.

Jump to

Block Diagram

Embedded Vision Camera

Example Use Cases

Machine Vision Block DiagramExpand Image

IP Network Camera

  • Sensor Interface - MIPI, LVDS
  • Customizable ISP for image processing
  • Lattice sensAI Artificial Intelligence for object/defect detection
  • JPEG-XS compression enables lossless low latency streaming over Gigabit IP Networks
Machine Vision Camera ProcessingExpand Image

Machine Vision Camera Processing

  • Sensor Interface, Hardened MIPI, SLVS EC, LVDS
  • Customizable ISP for image processing
  • Lattice sensAI Artificial Intelligence for object/defect detection
  • Interface - GigE Vision, USB3 Vision, CoaxPress
Machine Vision Frame Grabber Video pre/co processingExpand Image

Machine Vision Frame Grabber Video pre/co processing

  • GigE Vision, USB 3 Vision or CoaxPress I/F to PC
  • FPGA pre / co-processing of Video
  • Lattice sensAI Artificial Intelligence for object/defect detection
  • Hardened 5 Gbps PCI-e Gen 2 to host
Multi Sensor Machine Vision CamerasExpand Image

Multi Sensor Machine Vision Cameras

  • Multi / Hyper Spectral Cameras with dual sensors
  • Environmental Sensors
  • Image fusion / processing
  • 3D / ToF processing
  • Audio processing
  • Interface - GigE Vision, USB3 Vision, CoaxPress
Edge AI ProcessingExpand Image

Edge AI Processing

  • Bridge one or multiple CSI-2 image sensors to processor interface
  • Up to 3 Mb of internal RAM for processing
  • Offloads inferencing from CPU for object detection / counting
  • Combine video bridging and edge AI into a single device

Reference Designs

Object Classification Reference Design

Reference Design

Object Classification Reference Design

The Object Classification reference design shows examples on implementing machine-learning based object classification to edge devices applications.
CertusPro-NX, Avant-E, CrossLink-NX 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Space 
Object Classification Reference Design
Hand Gesture Detection

Reference Design

Hand Gesture Detection

Implements a low power AI based system to detect hand gestures using an IR image sensor
iCE40 UltraPlus 
Machine Learning/AI, Gesture Detection, Lattice sensAI 
Hand Gesture Detection
Barcode Detection Reference Design

Reference Design

Barcode Detection Reference Design

Exhibits the barcode detection using CertusPro-NX Voice & Vision Machine Learning Board & its camera barcode detection potential based on Yolov5 NN models.
CertusPro-NX 
Machine Learning/AI, Lattice sensAI, Barcode Detection 
Barcode Detection Reference Design
キーフレーズ検出

Reference Design

キーフレーズ検出

ラティス sensAI リファレンスデザイン
iCE40 UltraPlus 
Audio AI, Machine Learning/AI, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets 
キーフレーズ検出
Human Face Identification Reference Design

Reference Design

Human Face Identification Reference Design

Uses a Convolutional Neural Network in the ECP5 FPGA to detect a human face, and match to known registered faces. Can be adapted to work with any other object.
ECP5 / ECP5-5G, CertusPro-NX, CrossLink-NX 
Object Detection, Object Identification, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs 
Human Face Identification Reference Design
Show More

Demos

Object Classification Demonstration

Demo

Object Classification Demonstration

This object classification demo provides a sample application for detecting, classifying, and tracking multiple objects running on CertusPro-NX FPGA.
CertusPro-NX, Avant-E 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Space 
Object Classification Demonstration
User Tracking and Onlooker Detection Demonstration

Demo

User Tracking and Onlooker Detection Demonstration

Sample demonstration for detection and tracking of multiple human faces running on a low power general purpose FPGA using CNN Model
CrossLink-NX 
Machine Learning/AI, Lattice sensAI, Image Processing, Camera, FaceI dentification 
User Tracking and Onlooker Detection Demonstration
User Background Blurring Demonstration

Demo

User Background Blurring Demonstration

Efficient and low power approach for implementing user background blurring using Lattice CrossLink-NX FPGA
CrossLink-NX 
Lattice sensAI, Machine Learning/AI, SPI, Object Counting, Object Segmentation, Image Processing, Camera 
User Background Blurring Demonstration
キーフレーズ検出

Demo

キーフレーズ検出

ラティスsensAIソリューションを使用したキーフレーズ検出
iCE40 UltraPlus 
Audio AI, Machine Learning/AI, Microphone, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets 
キーフレーズ検出
Lattice mVision MIPI Video Sensor to PCIe Bridge Demonstration

Demo

Lattice mVision MIPI Video Sensor to PCIe Bridge Demonstration

This design demonstrates the functionality of transferring MIPI CSI-2 sensor video data to a computer through PCIe with a Direct Memory Access (DMA) engine.
CertusPro-NX 
Lattice mVision, MIPI, CSI-2, DMA, PCIe, Nexus PCIe 
Lattice mVision MIPI Video Sensor to PCIe Bridge Demonstration
Show More

IP Cores

Advanced CNN Accelerator IP

IP Core

Advanced CNN Accelerator IP

Calculates full layers of Neural Network including convolution layer, pooling layer, batch normalization layer, and fully connected layer.
CrossLink-NX, CertusPro-NX, Avant-E 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Home Control Appliances & Security, IoT & Wearables 
Advanced CNN Accelerator IP
Image Signal Processing IP Cores Suite

IP Core

Image Signal Processing IP Cores Suite

The Lattice mVision ISP IP Core implements ISP pipelines for image quality enhancements in embedded designs based on Lattice FPGA devices.
CrossLink-NX, Certus-NX, CertusPro-NX, Avant-E 
AXI, AXI-Stream, AXI-Lite Interface, AWB, Camera, CCM, CFA Interpolation, Debayer, Image Processing, Image Signal Processing, Lattice mVision, RGB 
Image Signal Processing IP Cores Suite
2値化ニューラルネットワーク（BNN）アクセラレータIP

IP Core

2値化ニューラルネットワーク（BNN）アクセラレータIP

わずかミリワットの消費電力で機械学習インターフェースを実装
iCE40 UltraPlus 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs 
2値化ニューラルネットワーク（BNN）アクセラレータIP
CNN Plus Accelerator IP Core

IP Core

CNN Plus Accelerator IP Core

CNN Plus IP is a flexible accelerator IP that simplifies implementation of Ultra-Low power AI by leveraging capabilities of Lattice FPGAs.
CrossLink-NX, Certus-NX, CertusPro-NX, Avant-E 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs, Automotive 
CNN Plus Accelerator IP Core
Helion IONOS画像シグナル処理IPポートフォリオ

IP Core

Helion IONOS画像シグナル処理IPポートフォリオ

Comprehensive, high-quality, highly-configurable ISP solution from Helion Vision, from basic to advanced High Dynamic Range Imaging (HDRI) color pipelines.
MachXO, LatticeXP2, LatticeECP3, CrossLink, ECP5 / ECP5-5G, CrossLink-NX 
HDR, Image Processing, Video Tx/Rx, Lattice mVision, Automotive 
Helion IONOS画像シグナル処理IPポートフォリオ
Show More

Development Kits & Boards

CertusPro-NX Versa Board

Board

CertusPro-NX Versa Board

CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX 
Lattice mVision, MIPI, LPDDR4, PCIe, Video Tx/Rx, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, SFP, Lattice ORAN, Lattice Automate, GPIO Control, I2C, PMOD, SERDES, SMA, SPI, UART, Automotive, Industrial Networking 
CertusPro-NX Versa Board
エンベデッドビジョン開発キット

Board

エンベデッドビジョン開発キット

組込みビジョン処理向けモジュールプラットフォーム
CrossLink, ECP5 / ECP5-5G 
3D Video, Camera, DDR SDRAM, HDMI, Image Processing, Machine Learning/AI, Lattice sensAI, Signal Aggregation, Video Tx/Rx, VIP, Lattice mVision, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, UAVs 
エンベデッドビジョン開発キット
CertusPro-NX PCIe Bridge Board

Board

CertusPro-NX PCIe Bridge Board

The CertusPro-NX PCIe Bridge Board enables video bridge capabilities to PCIe and embedded vision type applications.
CertusPro-NX 
Lattice mVision, PCIe, JTAG, SPI Flash, LPDDR4, PMOD, SERDES, X/S/RGMII, Industrial Networking, FMC 
CertusPro-NX PCIe Bridge Board
CrossLink-NX Voice and Vision Machine Learning Board

Board

CrossLink-NX Voice and Vision Machine Learning Board

Designed for low-power machine learning applications with Lattice sensAI and CrossLink-NX. Includes image sensors, microphones, HyperRAM, and expansion ports.
CrossLink-NX 
CSI-2, CSI Camera, Camera, Microphone, PMOD, HyperRAM, Machine Learning/AI, Lattice sensAI, Automotive 
CrossLink-NX Voice and Vision Machine Learning Board
CrossLink-NX-33 Voice and Vision Machine Learning Board

Board

CrossLink-NX-33 Voice and Vision Machine Learning Board

CrossLink-NX-33 Voice and Vision Machine Learning Board is designed using Crosslink-NX 33K, ideal for machine learning applications.
CrossLink-NX 
CSI-2, SPI, CSI Camera, Camera, Microphone, PMOD, Machine Learning/AI, Lattice sensAI, Automotive 
CrossLink-NX-33 Voice and Vision Machine Learning Board
Show More

Support

技術サポート

技術サポートが必要な方はこちら

ライセンス

開発ソフトウェア、IP のライセンスが必要な方はこちら

品質と信頼性

品質と信頼性に関する資料はこちら

サービス

その他、デザインサービス、プログラミング、などはこちら

会社情報

購入する

サポート

FOLLOW