The Lattice sensAI™ Edge Vision SDK is a software library that performs edge AI and computer vision on an image to extract data about the user present. It uses a combination of CPU, GPU and NPU to maximize efficiency. Some of the focus use cases are Attention Sensing algorithms, computing distance of a user from the camera, catching signs of fatigue, assessing where the user’s gaze is and many more. The meta data computed is made available to other applications via this SDK.
This tool has a C interface for control and can be configured to compute various data on every frame. It can run stand alone on CPU (Intel, AMD, ARM) or can interface to Lattice FPGA and tunnel the meta data provide from the HW.