In order to develop and test the Tulipp platform, the consortium worked on three concrete application cases: The research team at Fraunhofer IOSB was dedicated to the methods for detecting obstacles in a drone with stereo cameras, while other project partners dealt with pedestrian detection in the vicinity of a car and with the live image enhancement of X-rays from a mobile C-arm during an operation. As part of Tulipp, they have ported corresponding image processing methods from C++ to FPGA.
The procedures, which originally took several seconds on a high-end PC to analyze a single image, now run on the drone in real time, i.e. approximately 30 images per second are analyzed. The speed of pedestrian detection has also been increased by a factor of 100: Instead of one image per seven seconds, the system now creates 14 images per second. And the radiation during X-ray examinations could be reduced to a quarter due to upstream filters and better image evaluation. At the same time, the energy consumption of all three applications could be reduced many times over.
More information: https://www.iosb.fraunhofer.de/servlet/is/12481/