In this project we aim at fusing both one-dimensional signal information as two-dimensional image information based on framework that integrates feature classification, image segmentation and image registration. As input signals we use different medical modalities: electro-encophalograms, magnetic resonance volumes and ultrasound images of preterm infants. The final goal of the project is to develop a theoretical framework where relevant signal and image information is combined on a high level in function of their diagnostic value.