The Lattice sensAI stack is designed to help developers rapidly create high-performance AI/ML solutions running on flexible, low-power Lattice FPGAs for use in edge devices. The latest enhancements include optimizations to the stack’s programmable CNN Plus engine and NN compiler software and leverage other innovations in AI/ML technology that capitalize on the capabilities of the Lattice Nexus FPGA platform.
The updated stack (v3.1) also features reference designs that use these enhancements to boost application performance while keeping power consumption low, including a new object detection application running on the Lattice CrossLink-NX FPGA, the company's flagship device for vision processing. The latest enhancements include the following:
- Optimized CNN engine IP – optimizations to the way DSPs are used in the IP block and other architectural features of CrossLink-NX FPGAs deliver heightened CNN performance to the sensAI stack. For example, when running the stack on a CrossLink-NX FPGA, the Mobilenet CNN model (version 1) can process video data at 60 frames-per-second at a resolution of 224x224, a 6x increase in performance from the prior release. Lattice offers an object detection reference design that can enable similar performance in applications like automated defect detection on an industrial assembly line or presence detection in security cameras.
- Updated CNN compiler – the software compiler used in the sensAI stack is specifically optimized for DSPs implemented on a Lattice FPGA fabric to reduce operations-per-cycle by 50 percent. Additional NN model compression innovations include removal of duplicate weights to reduce memory usage while preserving accuracy.
- More development board options - a new sensAI development board featuring the CrossLink-NX 40K FPGA, an image sensor, microphones, and expansion connectors for interfacing with additional sensors. This board supports the reference designs referred to above and is intended to speed time-to-market for AI/ML applications.
- New end-to-end reference designs and hardware - a low power gesture detection reference design to accelerate customer implementation of contactless human/machine interface (HMI) systems that are gaining