Project

Differentiable programming for efficiently mapping image processing and computer vision algorithms on heterogeneous hardware and edge devices.

Code
bof/baf/4y/2024/01/718
Duration
01 January 2024 → 31 December 2025
Funding
Regional and community funding: Special Research Fund
Research disciplines
  • Engineering and technology
    • Computer vision
    • Image and language processing
    • Pattern recognition and neural networks
    • Scientific computing not elsewhere classified
Keywords
Hardware Acceleration Edge Devices Heterogeneous Hardware Differentiable Programming FPGA-GPU Hybrid Systems Low-Latency Computing Real-Time Video Processing Variational Inference AI-gebaseerde Compilers
 
Project description

This project focuses on advancing differentiable programming (DP) for efficient mapping of image processing and computer vision algorithms onto heterogeneous hardware (consisting of CPU, GPU en FPGA) and edge devices. The research aims to extend DP with techniques like expectation propagation and variational approximations, enabling distributed computing and gradient computations across cloud and edge platforms. The potential of FPGA-GPU hybrid systems for real-time video processing and the application of approximative computing techniques on edge devices is also explored, with an emphasis on reducing power consumption and improving latency (reduction and stabilization). The main goal is to support distributed inference and training for both neural networks and hybrid AI-image processing algorithms on diverse hardware architectures.