IoTs and Wearables

Low Power, Small Size FPGAs Enable High Performance Devices with Distributed Processing And Flexible I/O Support

Related Products

With deployment of smarter Internet of Things (IoT) devices and wearables, the number of sensors used is exploding. Lattice is helping IoT designers capture data from multiple sensors, analyze and deliver a powerful user experience with low power distributed processing engines and flexible I/Os supporting a wide range of sensors.

Lattice’s optimized low power FPGAs provide:

  • Low power on-device AI for object detection, identification, counting and human-machine interfacing
  • Flexible and low latency sensor data aggregation, bridging, data buffering, and processing from a wide variety of sensors
  • Programmable I/O expansion and aggregation to solves form factors and architectures challenges

Jump to

Block Diagram

IoT and Wearables

Example Use Cases

Low Power AIExpand Image

Low Power AI Processing

  • Low Power on-device NN based processing
  • Reduced data traffic to the cloud, improving security and privacy and reducing bandwidth usage
  • Object detection, classification, counting and HMI including gestures and voice based commands
Disdplay BridgingExpand Image

Display Bridging

  • Bridge between displays and processor when display interface is not supported native by the processor
  • Use the FPGA internal memory resources for compression and buffering
  • Expand the number of processor display interfaces
Audio BridgingExpand Image

Audio Bridging

  • Connect up to 8 microphones to a processor
  • Audio data buffering to offload the processor
  • Support I2S, PDM microphone interfacing
  • Up to 1 Mb of on device RAM for buffering
Image Sensor BridgingExpand Image

Image Sensor Bridging

  • Connect a wide variety of image sensors to processors
  • MIPI PHYs supports up to 2.5 Gbps/lane, up to four lanes
  • Flexible host interfacing including CSI, SPI, PCIe
  • Flexible processing for video data muxing and stitching
Sensor Fusion IO ExpansionExpand Image

Sensor Fusion and I/O Expansion

  • Interface to a wide variety of sensors to create rich user experience
  • Flexible preprocessing including arbitration, time stamping, and filtering
  • Create programmable sensor fusion algorithms
Low Latency Sensor BridgingExpand Image

Low Latency Sensor Bridging

  • Take advantage of parallel FPGA architecture to simultaneously collect data from multiple sensors
  • Interface to a wide variety of sensors to create rich user experience
  • Flexible preprocessing including arbitration, time stamping, and filtering

Reference Designs

​​Avant MIPI-to-Parallel and Parallel-to-MIPI Bridges Reference Design​

Reference Design

​​Avant MIPI-to-Parallel and Parallel-to-MIPI Bridges Reference Design​

​​The design allows quick interface for a processor with a MIPI DSI with an RGB interface, or camera with MIPI CSI-2 to a processor with parallel interface​
Avant-E 
MIPI, DSI, CSI-2, IoT & Wearables, Home Control Appliances & Security 
​​Avant MIPI-to-Parallel and Parallel-to-MIPI Bridges Reference Design​
Key Phrase Detection

Reference Design

Key Phrase Detection

Continuous searches for a key phrase utterance via a digital MEMS microphone. Can be re-configured to work with any trained word or phrase.
iCE40 UltraPlus 
Audio AI, Machine Learning/AI, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets 
Key Phrase Detection
Human Face Identification Reference Design

Reference Design

Human Face Identification Reference Design

Uses a Convolutional Neural Network in the ECP5 FPGA to detect a human face, and match to known registered faces. Can be adapted to work with any other object.
ECP5 / ECP5-5G, CertusPro-NX, CrossLink-NX 
Object Detection, Object Identification, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs 
Human Face Identification Reference Design
Human Presence Detection

Reference Design

Human Presence Detection

Uses Lattice sensAI IP to continuously search for the presence of a human and reports results. Can be adapted to detect any other object.
iCE40 UltraPlus 
Machine Learning/AI, Object Detection, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense 
Human Presence Detection
Object Counting AI

Reference Design

Object Counting AI

An example object counting application based on the Lattice sensAI stack. Includes SPI, DDR IP blocks, ISP engine, 8 CNN engines and a counting / overlay engine
ECP5 / ECP5-5G, CrossLink-NX 
Machine Learning/AI, Lattice sensAI, Object Counting, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense, Automotive 
Object Counting AI
Show More

Demos

Key Phrase Detection

Demo

Key Phrase Detection

Uses artificial intelligence (AI) to detect a specific key-phrase using a tiny, low-power iCE40 UltraPlus FPGA
iCE40 UltraPlus 
Audio AI, Machine Learning/AI, Microphone, Lattice sensAI, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets 
Key Phrase Detection
CSI-2 PCIe Bridge Demonstration

Demo

CSI-2 PCIe Bridge Demonstration

This design demonstrates the functionality of transferring MIPI CSI-2 camera video data to computer via PCIe with a Direct Memory Access (DMA) engine.
CrossLink-NX, CertusPro-NX 
CSI, FPGA, MIPI, OS, PCIe, Video Tx/Rx, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Automotive, Lattice mVision, Lattice Automate, Nexus PCIe 
CSI-2 PCIe Bridge Demonstration
4 Input to 1 Output MIPI CSI-2 Image Aggregation Demo

Demo

4 Input to 1 Output MIPI CSI-2 Image Aggregation Demo

Modular MIPI/D-PHY Demonstration - Aggregates four MIPI CSI-2 inputs to a single parallel output stream, which is then displayed on HDMI.
CrossLink-NX 
MIPI, CSI-2, HDMI, Modular MIPI/D-PHY, Lattice mVision, Parallel Video, Video Aggregation, Video Tx/Rx, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Automotive 
4 Input to 1 Output MIPI CSI-2 Image Aggregation Demo
Human Counting AI Demo

Demo

Human Counting AI Demo

Human upper-body detection and counting demonstration utilizes Lattice’s ECP5 FPGA and a Convolutional Neural Network (CNN) acceleration engine
ECP5 / ECP5-5G, CrossLink-NX 
Machine Learning/AI, Object Counting, Object Detection, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense, Automotive 
Human Counting AI Demo
Human Face Detection AI Demo

Demo

Human Face Detection AI Demo

Uses Lattice sensAI IP to detect human faces on a tiny, low-power iCE40 UltraPlus FPGA implementing AI at the edge. Adaptable to detect other objects.
iCE40 UltraPlus 
Machine Learning/AI, Object Detection, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense 
Human Face Detection AI Demo
Show More

IP Cores

Advanced CNN Accelerator IP

IP Core

Advanced CNN Accelerator IP

Calculates full layers of Neural Network including convolution layer, pooling layer, batch normalization layer, and fully connected layer.
CertusPro-NX, Avant-E 
Machine Learning/AI, Lattice sensAI, Object Detection, Object Identification, Home Control Appliances & Security, IoT & Wearables, CNN Bundle 
Advanced CNN Accelerator IP
CNN Plus Accelerator IP Core

IP Core

CNN Plus Accelerator IP Core

CNN Plus IP is a flexible accelerator IP that simplifies implementation of Ultra-Low power AI by leveraging capabilities of Lattice FPGAs.
CrossLink-NX, Certus-NX, CertusPro-NX 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs, Automotive, CNN Bundle 
CNN Plus Accelerator IP Core
Convolutional Neural Network (CNN) Accelerator IP

IP Core

Convolutional Neural Network (CNN) Accelerator IP

Implement AI solutions with CNNs from common or custom networks. Configure up to 16-bit widths. Works with Lattice Neural Network Compiler software tool.
ECP5 / ECP5-5G 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense 
Convolutional Neural Network (CNN) Accelerator IP
Convolutional Neural Network (CNN) Compact Accelerator

IP Core

Convolutional Neural Network (CNN) Compact Accelerator

Implement AI solutions with CNNs or BNNs that have power consumption in the mW range. Works with Lattice Neural Network Compiler software tool.
iCE40 UltraPlus 
Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs 
Convolutional Neural Network (CNN) Compact Accelerator
Byte to Pixel Converter IP Core

IP Core

Byte to Pixel Converter IP Core

Byte-to-Pixel Converter IP converts CSI-2/DSI standard based video payload packets from D-PHY Receiver Module output to pixel format.
CrossLink, CrossLinkPlus, CrossLink-NX, Certus-NX, CertusPro-NX, Avant-E, MachXO5-NX, Avant-G, Avant-X 
MIPI, Modular MIPI/D-PHY, Parallel Video, Video Tx/Rx, Lattice mVision, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Guidance Systems, Automotive, Space, MIPI Bundle, Lattice Drive 
Byte to Pixel Converter IP Core
Show More

Development Kits & Boards

CertusPro-NX Versa Board

Board

CertusPro-NX Versa Board

CertusPro-NX Versa Board supports a wide range industry standards such as MIPI, SFP+, 10 GbE, LPDDR4 and PCIe (Gen3) for rapid prototyping and testing.
CertusPro-NX 
Lattice mVision, MIPI, LPDDR4, PCIe, Video Tx/Rx, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, SFP, Lattice ORAN, Lattice Automate, GPIO Control, I2C, PMOD, SERDES, SMA, SPI, UART, Automotive, Industrial Networking 
CertusPro-NX Versa Board
Embedded Vision Development Kit

Board

Embedded Vision Development Kit

Three-board Video Interface Platform (VIP) modular kit. Includes 2 MIPI/D-PHY camera input, FPGA processing, HDMI output. More Input/Output boards available.
CrossLink, ECP5 / ECP5-5G 
3D Video, Camera, DDR SDRAM, HDMI, Image Processing, Machine Learning/AI, Lattice sensAI, Signal Aggregation, Video Tx/Rx, VIP, Lattice mVision, IoT & Wearables, Smart Toys & Robots, Home Control Appliances & Security, Notebooks & PCs, Tablets, Printers, AR / VR & Drones, UAVs 
Embedded Vision Development Kit
CrossLink-NX Evaluation Board

Board

CrossLink-NX Evaluation Board

For general evaluation and development with CrossLink-NX, includes many flexible interfaces such as FMC and PMOD with generous device IO access
CrossLink-NX 
Arduino, Breakout, FMC, PMOD, Raspberry Pi, SMA, SPI Flash, CSI-2, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense, Automotive 
CrossLink-NX Evaluation Board
CrossLink-NX VIP Sensor Input Board

Board

CrossLink-NX VIP Sensor Input Board

Intended for use with the Lattice Embedded Vision Development Kit. Includes 4 camera inputs and HyperRam for embedded video applications with CrossLink-NX
CrossLink-NX 
VIP, Camera, CSI Camera, CSI-2, HyperRAM, Image Processing, Machine Learning/AI, Lattice sensAI, Parallel Video, PMOD, SPI Flash, Video Aggregation, Video Bridge, Video Tx/Rx, Lattice mVision, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, Defense, Automotive 
CrossLink-NX VIP Sensor Input Board
HM01B0 UPduino Shield

Board

HM01B0 UPduino Shield

A complete development kit for implementing Artificial Intelligence (AI) using vision and sound as sensory inputs to a low-cost, low-power iCE40 UltraPlus FPGA.
iCE40 UltraPlus 
Arduino, Camera, Machine Learning/AI, Lattice sensAI, AR / VR & Drones, Home Control Appliances & Security, IoT & Wearables, Notebooks & PCs, Printers, Smart Toys & Robots, Tablets, UAVs 
HM01B0 UPduino Shield
Show More

Support

Technical Support

Need Help? We're Here to Assist You

Licensing

Find The Software & IP Licenses You Need

Quality & Reliability

Reference Material to Help Answer Your Questions

Services

Outside Services to Help Get The Job Done

ABOUT LATTICE

SALES

SUPPORT

FOLLOW