By merging the different kinds of data provided by visual, thermal and/or depth cameras, automatic video surveillance can achieve more accurate object detection. Since, besides the visual information, also thermal and depth information can be extracted, object identification can probably also be improved. New multimodal object detection and recognition techniques will be investigated to achieve these goals.