Surveillance Video Camera

From sensor bridging to camera ISP and DVR Solutions

Surveillance systems have evolved from SD analog video with tape recording to HD and 4K digital video with DVR, adding management and offline search functions along the way.

Emerging Smart Surveillance Systems offer advanced analytics – in the cloud, at the edge, or in the latest Smart Cameras. Adding intelligence in the camera reduces latency, enables enhanced privacy, and can reduce transmission / storage costs by only transmitting alerts and metadata.

Lattice’s small form-factor low power FPGAs are optimal for Smart Surveillance Cameras. They enable flexible Sensor Interfacing, Image Signal processing (ISP), Sensor Fusion, aggregation, and AI/ML. Lattice’s Embedded Vision and Lattice sensAI solutions stacks simplify the integration of these enhanced functions.

Video Surveillance

Jump to

Block Diagram

Surveillance Camera Block Diagram

Example Use Cases

Multi Sensor Aggregation / Fusion Cameras

  • Multi Sensor Interfacing and Processing
  • Environmental Sensors
  • Image fusion / proces
  • Audio processing

Edge AI Processing

  • Bridge one or multiple CSI-2 image sensors to processor interface
  • Up to 3 Mb of internal RAM for processing
  • Offloads inferencing from CPU for Video Analytics
  • Combine video bridging and edge AI into a single device
  • Optionally eliminate CPU/AP for analytics only

Legacy Camera Aggregation / Video Analytics

  • Video Aggregation
  • Image Processing
  • PCI-e I/F to Host
  • Lattice sensAI Video Analytics

Reference Designs

Object Classification Reference Design

Reference Design

Object Classification Reference Design

The Object Classification reference design shows examples on implementing machine-learning based object classification to edge devices applications.
Object Classification Reference Design
Hand Gesture Detection

Reference Design

Hand Gesture Detection

Implements a low power AI based system to detect hand gestures using an IR image sensor
Hand Gesture Detection
Barcode Detection Reference Design

Reference Design

Barcode Detection Reference Design

Exhibits the barcode detection using CertusPro-NX Voice & Vision Machine Learning Board & its camera barcode detection potential based on Yolov5 NN models.
Barcode Detection Reference Design
MIPI CSI-2 to HDMI Reference Design

Reference Design

MIPI CSI-2 to HDMI Reference Design

MIPI CSI-2 to HDMI Reference Design includes the synthesizable MIPI-HDMI core design & stimulus generators, checkers, & a testbench necessary to simulate the design
MIPI CSI-2 to HDMI Reference Design
Key Phrase Detection

Reference Design

Key Phrase Detection

Continuous searches for a key phrase utterance via a digital MEMS microphone. Can be re-configured to work with any trained word or phrase.
Key Phrase Detection

Demos

Object Classification Demonstration

Demo

Object Classification Demonstration

This object classification demo provides a sample application for detecting, classifying, and tracking multiple objects running on CertusPro-NX FPGA.
Object Classification Demonstration
User Tracking and Onlooker Detection Demonstration

Demo

User Tracking and Onlooker Detection Demonstration

Sample demonstration for detection and tracking of multiple human faces running on a low power general purpose FPGA using CNN Model
User Tracking and Onlooker Detection Demonstration
Barcode Detection Demonstration

Demo

Barcode Detection Demonstration

This demo implements an algorithm for barcode detection using the CertusPro-NX Voice and Vision Machine Learning Board.
Barcode Detection Demonstration
Key Phrase Detection

Demo

Key Phrase Detection

Uses artificial intelligence (AI) to detect a specific key-phrase using a tiny, low-power iCE40 UltraPlus FPGA
Key Phrase Detection
MIPI CSI-2 to HDMI Demonstration

Demo

MIPI CSI-2 to HDMI Demonstration

Lattice MIPI-HDMI Demonstration is built using multiple Lattice IPs and some additional glue logic necessary to connect the IPs in a processing pipeline.
MIPI CSI-2 to HDMI Demonstration

IP Cores

Advanced CNN Accelerator IP

IP Core

Advanced CNN Accelerator IP

Calculates full layers of Neural Network including convolution layer, pooling layer, batch normalization layer, and fully connected layer.
Advanced CNN Accelerator IP
Image Signal Processing IP Cores Suite

IP Core

Image Signal Processing IP Cores Suite

The Lattice mVision ISP IP Core implements ISP pipelines for image quality enhancements in embedded designs based on Lattice FPGA devices.
Image Signal Processing IP Cores Suite
CNN Plus Accelerator IP Core

IP Core

CNN Plus Accelerator IP Core

CNN Plus IP is a flexible accelerator IP that simplifies implementation of Ultra-Low power AI by leveraging capabilities of Lattice FPGAs.
CNN Plus Accelerator IP Core
Convolutional Neural Network (CNN) Accelerator IP

IP Core

Convolutional Neural Network (CNN) Accelerator IP

Implement AI solutions with CNNs from common or custom networks. Configure up to 16-bit widths. Works with Lattice Neural Network Compiler software tool.
Convolutional Neural Network (CNN) Accelerator IP
Convolutional Neural Network (CNN) Compact Accelerator

IP Core

Convolutional Neural Network (CNN) Compact Accelerator

Implement AI solutions with CNNs or BNNs that have power consumption in the mW range. Works with Lattice Neural Network Compiler software tool.
Convolutional Neural Network (CNN) Compact Accelerator

Development Kits & Boards

CertusPro-NX Versa Board

Board

CertusPro-NX Versa Board

CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX Versa Board
Embedded Vision Development Kit

Board

Embedded Vision Development Kit

Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
Embedded Vision Development Kit
CertusPro-NX PCIe Bridge Board

Board

CertusPro-NX PCIe Bridge Board

The CertusPro-NX PCIe Bridge Board enables video bridge capabilities to PCIe and embedded vision type applications.
CertusPro-NX PCIe Bridge Board
CrossLink-NX Voice and Vision Machine Learning Board

Board

CrossLink-NX Voice and Vision Machine Learning Board

Designed for low-power machine learning applications with Lattice sensAI and CrossLink-NX. Includes image sensors, microphones, HyperRAM, and expansion ports.
CrossLink-NX Voice and Vision Machine Learning Board
CrossLink-NX-33 Voice and Vision Machine Learning Board

Board

CrossLink-NX-33 Voice and Vision Machine Learning Board

CrossLink-NX-33 Voice and Vision Machine Learning Board is designed using Crosslink-NX 33K, ideal for machine learning applications.
CrossLink-NX-33 Voice and Vision Machine Learning Board

Support

Technical Support

Need Help? We're Here to Assist You

Quality & Reliability

Reference Material to Help Answer Your Questions