PROJECTS

AI4CH was funded to realize a joint Italian-Israeli laboratory operating in the field of Artificial Intelligence applied to the Cultural Heritage. The project wants to deal with research activities related to intelligent extraction of information content from 2D/3D data collections and intelligent support to knowledge exploration.

AMICOS - Autonomous MonitorIng and COntrol System for mining plants - is a European project funded by the EIT Raw Materials. AMICOS supports the digital transformation of the RM industry by proposing an innovative end-to-end asset management solution, based on a Decision Support System and remotely sensed data, to increase the market penetration/adoption of digital technology in the mining sector. AMICOS provides a great opportunity to gain market share by exploiting emerging technologies (IoT, drones/UAVs, Artificial Intelligence, BIM, etc.) to reduce the costs for key operations and allow a safer working environment.

We explore supervised CNN architectures for monocular depth estimation and evaluated their potential in 3D reconstruction i photogrammetric scenarios and applications. Since most available datasets for training are not designed toward this goal and are limited to specific indoor scenarios, we also offer a new metric, large-scale synthetic benchmark (ArchDepth) renders near real-world scenarios of outdoor scenes (ca 24.000 images).

Automation in image orientation and dense point cloud reconstruction is reaching very high standards, but image quality is a fundamental pre-requisite to produce successful and photo-realistic 3D products. We investigate a productive pre-processing strategy, the various detector/descriptor operators for tie point extraction and dense matching algorithms to find out all open issues in the actual photogrammetric pipeline for 3D reconstruction purposes.

Classification and segmentation of 3D data has become a very active research field. Researchers are developing solutions to deliver enriched 3D information useful in many fields and applications. We are developing methodologies based on modern machine learning methods useful for urban modeling, heritage documentation, etc.

FEROX - Fostering and Enabling AI, Data and Robotics Technologies for Supporting Human Workers in Harvesting Wild Food - will employ autonomous drones equipped with various sensors to acquire data, build 3D models of the forests and, therefore, accurately estimate berries’ locations, amount and types. The collected data will be used to build AI models to help pickers locate the berries and optimize their operations in the field. In addition, FEROX will provide wild berry pickers with navigation and locating services and physical support to improve their working conditions and boost their trust and confidence. FEROX's solution will contribute to the overall safety of the workers by automatically monitoring the pickers and providing aid where it is needed. FEROX is in collaboration with the TeV research group of FBK. funded under the EU call HORIZON-CL4-2021-DIGITAL-EMERGING-01.

Various countries are digitizing their archives of aerial images as they are a unique and relatively unexplored means to analyze the territorial changes over the past 100 years with very high spatial resolution. This research activity wants to investigate the geo-processing of historical aerial images, including automatic geo-referencing, DSM generation, automatic detection of bomb craters, LULC maps generation, etc. The TIME benchmark was also realized in collaboration with EuroSDR.

InCUBE - an INClUsive toolBox for accElerating and smartening deep renovation - envisions to unlock the EU renovation wave through cutting-edge standardized and integrated processes based on (i) industrialization, (ii) new technologies for renewable energy production and storage, (iii) digitization (including Digital Twins, BIM, etc.) and (iv) new market entrants, organized under novel business. The Santa Chiara Open Lab and Santa Chiara Cultural Services Center in Trento’s historic district will represent one of 3 demonstration sites. The project is in collaboration with the DSIP research group and Sustainable Energy centre of FBK. InCUBE is funded under the EU call HORIZON-CL5-2021-D4-01-02, Grant Agreement no. 101069610 and is coordinated by CERTH.

The research activity investigate innovate optical metrology methods for manufacturing inspection, quality control and production monitoring. We focus on texture-less and non-collaborative surfaces, normally problematic for inspections based on optical methods.

JUDIT – Judicaria digitale e Interattiva - is an interdisciplinary project that wants to realize 3D contents and digital solutions to valorize and give remote access to heritage contents located in the Giudicarie and northern side of the Garda lake. The project wants to expand knowledge and accessibility of the heritage sites, stimulating curiosity and involving visitors with technological tools that combine fun, entertainment, philological reconstruction, education and learning. JUDIT is supported by Fondazione CARITRO.

MIAMI is an industrial project which aims to develop a system able to integrate advanced metrology and artificial intelligence (AI) for: (i) helping an operator in setting up a laser micro-machining process and in checking the quality of the obtained result using 3D analytics; (ii) improving the production process by learning defects and their relation with machining parameters; (iii) developing new business opportunities related to design and sale of intelligent laser machines and related services. Two types of micro-machining are considered: LIPPS and micro-channels on steel. 3D data are collected with SEM and interferometers. MIAMI is in collaboration with Kirana and supported by the Autonomous Province of Trento.

PERISCOPE - Portal for hERItage buildingS integration into the COntemPorary built Environment - is funded by the Cyprus Research & Innovation Foundation and aims to realize an innovative BIM/HBIM platform for the identification, classification, documentation and renovation of heritage buildings. The project, lead by the Cyprus Institute, addresses specific needs and challenges identified by the stakeholders that have cultural and economic impact on Cyprus’ society, including public authorities and policy makers.

SEC4TD - Securing tailings dam infrastructure with an innovative monitoring system - proposes an integrated end-to-end solution composed of hardware (IoT, drones, etc.) and software innovative products for mining operators and service providers that will enable multi-scale multi-platform data collection and visualization, events prediction, effective information management and data traceability. The SEC4TD will provide benefits to mining sector by improving the safety, efficacy and environment impact of the current mining processes and will also protect the reputation of this sector as well as will facilitate the compliance with new stricter regulations. SEC4TD will leverage on advanced and emerging technologies such as IoT low-power devices, mathematical soil model mechanisms, drones, advanced visualization tools, data analytics techniques, among others. The project is funded by the EIT Raw Materials and in collaboration with the DSIP research group of FBK.

Multiple view stereo algorithms still have difficulties to reconstruct the depth in textureless areas. Semantic information is used to support the standard MVS reconstruction and generate more complete and accurate depth maps and 3D point clouds. The semantic labels are inherited from the labelled images to the 3D output.

If the field of photogrammetry has witnessed incremental technological developments in the last years, the field of airborne laser scanning is now seeing a potentially revolutionary change through the introduction of Single Photon LiDAR (SPL) and Geiger-Mode LiDAR technologies. SPL / Geiger-Mode arguably provide a more efficient approach to perform high-resolution 3D mapping. They offer higher efficiency with respect to traditional linear LiDAR and additional 3D mapping capability in terms of swath width, spatial resolution, acquisition time and density of range returns. The project is in collaboration with EuroSDR, Newcastle University and TU Vienna.

TARGET-CE is an Interreg-CE capitalization project which aims to collect, adjust and deploy ICT tools, financial models, thematic strategies, action plans and training material in the field of Energy Efficiency (EE) in order to offer innovative solution to local and regional administrations. This will be achieved capitalizing past technical & non-technical solutions combining downstreaming and upstreaming activities for increasing EE and renewable energy usage in public buildings. See project videos, read project newsletters and enjoy the OnePlace platform rich of EE tools.

TOTEM (4D Trento Time Machine) aims to research, development, test and disseminate of new visualization and analysis solutions, based on heterogeneous information (3D / 4D models, texts, photos, maps, etc.) in order to (i) improve historical knowledge about architectural and urban planning of Trento, (ii) carry out geospatial urban analyzes and (iii) exploit data collected in archives in the area. TOTEM is funded by Fondazione CARITRO.

UPDATE – fast aUtomatic insPection with 3D imAging and arTificial intElligence - is a metrology project, run in collaboration with EOPTIS and funded by Fondazione CARITRO. UPDATE aims to research, develop and demonstrate innovative solutions for quality control of industrial components. The inspection will be performed merging 3D imaging and Artificial Intelligence solutions and following international standards (VDI/VDE, ASTM, etc.).

USAGE - Urban Data Space for Green Deal - aims to provide solutions and mechanisms for making city-level environmental and climate data available ad usable by everyone. USAGE will support the implementation of various European Green Deal priority actions at the level where climate change is mostly felt: cities and towns. USAGE will provide AI-based tools, geo-data analytics and innovative governance mechanisms to share, access and use city-level data from Earth Observation (EO), Internet of Things (IoT), authoritative and crowd sources, leveraging on standards for data and service interoperability. USAGE will validate its solutions in four diverse pilot areas located in four different countries, focusing also on the reusability of the solutions in other urban areas. USAGE is funded under the EU call HORIZON-CL6-2021-GOVERNANCE-01-17, Grant Agreement no. 101059950 and is coordinated by Universidad Politécnica de Madrid (UPM).

The availability and reliability of VR/AR/MR solutions, including head-mounted displays and glasses, is allowing interesting immersive virtual experiences in many fields, from industry to heritage.

VOLTA – innoVation in geOspatiaL and 3D daTA - is an EU Marie Skłodowska-Curie RISE which will develop, through secondments of staff members, training and networking activities, innovative solutions in the field of photogrammetry, data / sensor fusion, semantic segmentation and cloud computing for geospatial data. VOLTA is an EU Marie Skłodowska-Curie actions (REA GA no. 734687), it has 13 partners and will run for 4 years.

V0T3D - Ventilation Optimizing Technology based on 3D-scanning - wants to robotize the Raw Material sector by introducing modern methods for the optimization of underground ventilation with the main aim of reducing electricity consumption by 1,5%. The VOT3D project, funded by the EIT Raw Materials, will deliver an innovative solution based on 3D digitization of underground tunnels and the creation of their real digital twins. These detailed and precise 3D data will allow to improve airflow simulations in order to adjust the most favorable ventilation scenario for the digitized underground tunnels.