Lattice mVision Solution Stack

Accelerate Implementation of Low Power Embedded Vision Applications

The Lattice mVision solutions stack includes everything embedded vision system designers need to evaluate, develop, and deploy FPGA-based embedded vision applications, such as machine vision, robotics, ADAS, video surveillance, and drones.

The Lattice mVision solutions stack uses modular hardware platforms, IP building blocks, easy to use FPGA design tools, reference designs and demonstrations, as well as a network of custom design services and solves design challenges as sensor connectivity, bridging, aggregation, and image signal processing.

The Lattice mVision solutions stack is optimized for low power consumption ranging from under 150 mW to 1 W and small package size (2.5 x 2.5 mm to 10 x 10 mm). The solutions stack provides customizable performance and flexible interface connectivity (MIPI CSI-2, LVDS, PCIe, GigE, etc.).

mVision Stack

Jump To

System Architecture Examples

The following diagrams are examples of how FPGAs are commonly used in embedded vision applications.

Sensor Bridging

  • Connect any MIPI, Sub-LVDS sensor to an image processor
  • Maintain existing infrastructure
  • Low latency and small form factor
  • FPGA resources can be used for image processing

Sensor Aggregation

  • Aggregate multiple image sensors for an image processor
  • Maintain existing infrastructure
  • Low latency and small form factor
  • FPGA resources can be used for image processing

Image Processing

  • Image processing, offload compute intensive algorithm from processor
  • Maintain existing infrastructure
  • Low latency and small form factor
  • Commercial grade Image Signal Processing

Connectivity

  • Interface Connectivity, USB, Gig-E, GigE-Vision, Display port
  • Maintain existing infrastructure
  • Low latency and small form factor

Smart IP Network Camera

  • IP Network, GigE Vision output
  • MIPI, LVDS sensor interface and control
  • Image Signal Processing
  • Computer Vision / AI / ML processing
  • Optional Lossless Compression – reduce BW 10X
  • Streaming over IP networks

Hardware Platform

The Lattice mVision solutions stack uses the award-winning Video Interface Platform (VIP) which is the ideal hardware for embedded vision designs and provides a highly flexible, smart modular solution for embedded vision designers who need to build a prototyping system quickly.

Reference Designs

MIPI CSI-2 to HDMI Reference Design

Reference Design

MIPI CSI-2 to HDMI Reference Design

MIPI CSI-2 to HDMI Reference Design includes the synthesizable MIPI-HDMI core design & stimulus generators, checkers, & a testbench necessary to simulate the design
MIPI CSI-2 to HDMI Reference Design
Lattice mVision MIPI Video Sensor to PCIe Bridge Reference Design

Reference Design

Lattice mVision MIPI Video Sensor to PCIe Bridge Reference Design

Reference Design that shows transfer of sensor data to the computer memory and rendering of the data as video on the computer screen using the software driver.
Lattice mVision MIPI Video Sensor to PCIe Bridge Reference Design
SLVS-EC Sensor to PCIe Bridge Reference Design

Reference Design

SLVS-EC Sensor to PCIe Bridge Reference Design

SLVS-EC to PCIe reference design allows the quick interface to receive serial data from CMOS Image Sensors & convert to DMA/PCIe Subsystem data format.
SLVS-EC Sensor to PCIe Bridge Reference Design
CertusPro-NX N Input to 1 Output MIPI CSI-2 Side-by-Side Aggregation

Reference Design

CertusPro-NX N Input to 1 Output MIPI CSI-2 Side-by-Side Aggregation

Modular MIPI/D-PHY Reference Design - Multiple channel image data concatenated horizontally line by line and offers up to eight-channel aggregation.
CertusPro-NX N Input to 1 Output MIPI CSI-2 Side-by-Side Aggregation
MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge for CertusPro-NX

Reference Design

MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge for CertusPro-NX

Modular MIPI/D-PHY Reference Design - MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge reference design takes DSI or CSI-2 MIPI data and converts them to OpenLDI format on LVDS.
MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge for CertusPro-NX

IP Cores

Image Signal Processing IP Cores Suite

IP Core

Image Signal Processing IP Cores Suite

The Lattice mVision ISP IP Core implements ISP pipelines for image quality enhancements in embedded designs based on Lattice FPGA devices.
Image Signal Processing IP Cores Suite
Helion IONOS Image Signal Processing IP Portfolio

IP Core

Helion IONOS Image Signal Processing IP Portfolio

Comprehensive, high-quality, highly-configurable ISP solution from Helion Vision, from basic to advanced High Dynamic Range Imaging (HDRI) color pipelines.
Helion IONOS Image Signal Processing IP Portfolio
CSI-2/DSI D-PHY Transmitter IP Core

IP Core

CSI-2/DSI D-PHY Transmitter IP Core

The CSI-2/DSI D-PHY Transmitter Submodule IP is for applications requiring D-PHY transmitter in the FPGA logic & supports both high-speed & low power modes
CSI-2/DSI D-PHY Transmitter IP Core

Development Kits & Boards

CertusPro-NX Versa Board

Board

CertusPro-NX Versa Board

CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX Versa Board
Embedded Vision Development Kit

Board

Embedded Vision Development Kit

Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
Embedded Vision Development Kit
CertusPro-NX PCIe Bridge Board

Board

CertusPro-NX PCIe Bridge Board

The CertusPro-NX PCIe Bridge Board enables video bridge capabilities to PCIe and embedded vision type applications.
CertusPro-NX PCIe Bridge Board
USB3-GbE VIP IO Board

Board

USB3-GbE VIP IO Board

Output board for Video Interface Platform (VIP) and Embedded Vision Development Kit - adds video over USB 3.0 and Gigabit Ethernet.
USB3-GbE VIP IO Board

Demos

Lattice Image Signal Processing Demo

Demo

Lattice Image Signal Processing Demo

Provides a complete ISP example design on the Lattice ECP5 FPGA for the Embedded Vision Development Kit, ideal for Industrial, Medical, and Automotive applications.
Lattice Image Signal Processing Demo
MIPI CSI-2 to HDMI Demonstration

Demo

MIPI CSI-2 to HDMI Demonstration

Lattice MIPI-HDMI Demonstration is built using multiple Lattice IPs and some additional glue logic necessary to connect the IPs in a processing pipeline.
MIPI CSI-2 to HDMI Demonstration
Lattice mVision MIPI Video Sensor to PCIe Bridge Demonstration

Demo

Lattice mVision MIPI Video Sensor to PCIe Bridge Demonstration

This design demonstrates the functionality of transferring MIPI CSI-2 sensor video data to a computer through PCIe with a Direct Memory Access (DMA) engine.
Lattice mVision MIPI Video Sensor to PCIe Bridge Demonstration
SLVS-EC Sensor to PCIe Bridge Demonstration

Demo

SLVS-EC Sensor to PCIe Bridge Demonstration

The SLVS-EC RX IP provides the FPGA an interface to receive serial data from CMOS Image Sensors and offers a solution to convert the incoming serial data to a parallel pixel data format.
SLVS-EC Sensor to PCIe Bridge Demonstration
CSI-2 PCIe Bridge Demonstration

Demo

CSI-2 PCIe Bridge Demonstration

This design demonstrates the functionality of transferring MIPI CSI-2 camera video data to computer via PCIe with a Direct Memory Access (DMA) engine.
CSI-2 PCIe Bridge Demonstration

Software Tools

Lattice Diamond Design SoftwareLattice Radiant Software

For the latest Radiant design software that works with the Lattice mVision Solutions stack, please contact Lattice by clicking the button below.

Custom Design Services

The Lattice mVision solutions stack includes an ecosystem of selected, worldwide design service partners that can deliver custom solutions for a range of end-applications, including smart factory, smart home, smart city, mobile, and smart cars.

Documentation

Quick Reference
Technical Resources
Information Resources
Downloads
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Lattice CrossLink-NX ISP Demo Quick Start Guide
FPGA-AN-02040 1.0 9/18/2021 PDF 505.8 KB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Lattice mVision CSI-2 PCIe Bridge Demo User Guide
FPGA-UG-02125 1.1 3/15/2022 PDF 1.7 MB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
CertusPro-NX 1 to N MIPI CSI-2/DSI Duplicator Reference Design - Source Code
9/17/2021 ZIP 18.6 MB
CertusPro-NX Parallel to MIPI CSI-2/DSI Display Interface Bridge Reference Design - Source Code
7/4/2023 ZIP 35.2 MB
CertusPro-NX MIPI DSI/CSI-2 to Parallel Bridge Reference Design - Source Code
7/4/2023 ZIP 151 MB
MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge Reference Design for CertusPro-NX - Source
FPGA-RD-02241 1.0 11/30/2021 ZIP 32.2 MB
subLVDS to MIPI CSI-2 Image Sensor Bridge with CrossLink-NX - Documentation
FPGA-RD-02217 1.0 5/1/2021 PDF 2.5 MB
subLVDS to MIPI CSI-2 Image Sensor Bridge with CrossLink-NX - Source Code
FPGA-RD-02217 1.0 5/1/2021 ZIP 6.2 MB
CertusPro-NX 1 to N MIPI CSI-2/DSI Duplicator Reference Design - User Guide
FPGA-RD-02240 1.1 10/27/2022 PDF 1.5 MB
CertusPro-NX Parallel to MIPI CSI-2/DSI Display Interface Bridge Reference Design - User Guide
FPGA-RD-02239 1.2 12/19/2023 PDF 1.5 MB
CertusPro-NX MIPI DSI/CSI-2 to Parallel Bridge Reference Design - User Guide
FPGA-RD-02238 1.2 7/4/2023 PDF 1.1 MB
MIPI DSI/CSI-2 to OpenLDI LVDS Interface Bridge Reference Design for CertusPro-NX - Documentation
FPGA-RD-02241 1.0 11/30/2021 PDF 2.3 MB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
Lattice mVision Solutions Stack
I0270 2.0 3/1/2021 PDF 895.4 KB
TITLE NUMBER VERSION DATE FORMAT SIZE
Select All
CrossLink-NX ISP Demo
1.0 9/17/2021 ZIP 36.6 MB
Lattice mVision CSI-2 to PCIe Bridge Demo Bitstream and Software Driver
1.0 3/15/2022 RAR 7.1 MB

*By clicking on the "Notify Me of Changes" button, you agree to receive notifications on changes to the document(s) you selected.

Awards

Embedded Computing Design’s Best in Show Award

Development Tools & Operating Systems