Smart Multi-Sensor Platform

Self-deployable optical sensing technologies are becoming more important, especially in unstable times and crisis situations (e.g. war, climate change). AIT provides a Smart Multi-Sensor Platform which can be deployed quickly by end-users in areas with dynamically increased risks and limited existing IT infrastructure. As the environments and weather conditions can change significantly, e.g. from snowy forested situations at closer distances during night to foggy situations at bigger distances on the sea, we innovate on optimal combinations of different optical sensors (with multiple spectres and resolutions) to allow a stable monitoring by automated AI based algorithms. 

The Smart Multi Sensor Platform targets improving situational awareness in challenging environmental outdoor conditions 24/7 by combining a high resolution RGB camera, a thermal camera, or other optical spectrums. The combination of different lenses provides an all-in-one solution for day/night operation, which can capture high quality images even in challenging conditions and dark environment. Currently, the platform targets distances up to 200m for visual surveillance of remote outdoor areas. It has integrated GPS and IMU sensors that enable self-localization and recognition of camera orientation. The output consists of 3 video streams, each including camera position and orientation. The platform has built-in analytics functionalities targeting detection and classification of different type of targets such as persons, vehicle etc. Independent detectors based on deep neural networks perform video analytics for object and event detection on each video stream. The platform integrates an NVIDIA Jetson AGX Xavier board including a CPU as well as integrated GPU units, for onboard data processing. This enables sending over the wireless network only the detection results rather than the raw data, both to avoid overloading of the network as well as to fulfill basic privacy by design requirements. Streaming is performed only upon explicit request by the operator. The platform can be optionally operated by battery, which enables autonomy for deployment in remote environments.