Hyperspectral data are widely used for various tasks, but often suffer from quality issues. Meanwhile, fusion of information gathered from multiple sources is also important for scene understanding. The goal of the research is joint image quality improvement and scene understanding using a combination of deep learning methods and classical video processing solutions. The result will be a flexible and extensible HSI restoration and sensor fusion framework.