Project

Representation, compression and rendering of immersive visual content

Code
bof/baf/4y/2024/01/1028
Duration
01 January 2024 → 31 December 2025
Funding
Regional and community funding: Special Research Fund
Research disciplines
  • Natural sciences
    • Computer graphics
    • Virtual reality and related simulation
  • Engineering and technology
    • Video communications
    • Multimedia processing not elsewhere classified
    • Analogue and digital signal processing
Keywords
Computer Graphics compression Extended Reality Visual communication immersive free viewpoint rendering
 
Project description
 

This research aims to develop semantic-based compression techniques specifically designed for immersive 3D radiance field representations, focusing on improving efficiency while preserving the quality of experience (QoE). The objective is to integrate semantic analysis into the compression pipeline, leveraging scene semantics to identify and prioritize critical features in 3D data. This includes optimizing the representation and distribution of radiance field elements, such as splats or kernels, by adjusting their number, placement, and attributes based on the semantic importance of different regions in the scene. Additionally, the project will explore novel ways to couple semantic understanding and view synthesis, to improve rendering quality in dynamic and complex scenarios.This work will contribute to the development of scalable, generalizable compression solutions, advancing the capabilities of immersive technologies in applications like virtual reality, gaming, and telepresence.