PROJECTS
EU projects
FORTIS - Multi-Modal and Multi-Aspect Holistic Human-Robot Interaction - is an EU-funded project that aims to provide a solution for enabling robots to interact with humans in a human-like way for long periods. FORTIS will (i) develop, integrate and provide an human-centric solution for modeling and analyzing humans, (ii) develop and provide a flexible and agile multi-robotic-centric solution interacting with humans, (iii) provide optimized operations for both humans and robots and (iv) demonstrate the solution for industrial pilots in construction, maintenance and logistics. FORTIS wants to create a comprehensive interaction between humans and robots, encompassing both physical and non-physical communication. FORTIS is funded under the call HORIZON-CL4-2023-DIGITAL-EMERGING-01-02.
TRACENET - Training Centre Network on 3D and VR - aims to develop geospatial technologies, VR solutions and innovations for prevention, preparedness and response of Civil Protections and emergency responders to support policy and decision-making, encourage scientific excellence and exchange state-of-the-art knowledge and expertise. Within TRACENET, planners, decision makers, experts, teams and civil protection modules will jointly operate, test and learn from each other interacting within an online and real-time 3D environment. Such an innovative framework will offer simulation scenarios and countless opportunities to build expertise, share knowledge and establish remote but real contacts among participants, reducing costs and the environmental impact of training activities. TRACENET is funded under the EU Programme Union Civil Protection Mechanism (UCPM) and coordinated by the Autonomous Province of Trento (Italy).
5Dculture - Deploying and Demonstrating a 3D cultural heritage space - enriches the offer of European 3D digital cultural heritage assets in the data space and fosters their reuse in important domains such as education, tourism and the wider cultural and creative sectors towards socially and economically sustainable outcomes. 5Dculture facilitates the management, enrichment and reuse of 3D heritage content by collecting, adjusting and deploying a series of digital technologies and tools (such as AI and semantic technologies) and by creating and promoting capacity building materials and activities to equipe cultural heritage institutions with the necessary knowledge and skills for a wider reuse of their 3D cultural assets. 3D content collections related to fashion, archaeology and architecture will be tackled. 5Dculture is co-funded under the EU call DIGITAL-2022-CULTURAL-02-HERITAGE.
InCUBE - an INClUsive toolBox for accElerating and smartening deep renovation - envisions to unlock the EU renovation wave through cutting-edge standardized and integrated processes based on (i) industrialization, (ii) new technologies for renewable energy production and storage, (iii) digitization (including Digital Twins, BIM, etc.) and (iv) new market entrants, organized under novel business. The Santa Chiara Open Lab and Santa Chiara Cultural Services Center in Trento’s historic district will represent one of 3 demonstration sites. The project is in collaboration with the DSIP research group and Sustainable Energy centre of FBK. InCUBE is funded under the EU call HORIZON-CL5-2021-D4-01-02, Grant Agreement no. 101069610 and is coordinated by CERTH.
SEC4TD - Securing tailings dam infrastructure with an innovative monitoring system - proposes an integrated end-to-end solution composed of hardware (IoT, drones, etc.) and software innovative products for mining operators and service providers that will enable multi-scale multi-platform data collection and visualization, events prediction, effective information management and data traceability. The SEC4TD will provide benefits to mining sector by improving the safety, efficacy and environment impact of the current mining processes and will also protect the reputation of this sector as well as will facilitate the compliance with new stricter regulations. SEC4TD will leverage on advanced and emerging technologies such as IoT low-power devices, mathematical soil model mechanisms, drones, advanced visualization tools, data analytics techniques, among others. The project is funded by the EIT Raw Materials and in collaboration with the DSIP research group of FBK.
FEROX - Fostering and Enabling AI, Data and Robotics Technologies for Supporting Human Workers in Harvesting Wild Food - will employ autonomous drones equipped with various sensors to acquire data, build 3D models of the forests and, therefore, accurately estimate berries’ locations, amount and types. The collected data will be used to build AI models to help pickers locate the berries and optimize their operations in the field. In addition, FEROX will provide wild berry pickers with navigation and locating services and physical support to improve their working conditions and boost their trust and confidence. FEROX's solution will contribute to the overall safety of the workers by automatically monitoring the pickers and providing aid where it is needed. FEROX is in collaboration with the TeV research group of FBK and it is funded under the EU call HORIZON-CL4-2021-DIGITAL-EMERGING-01.
USAGE - Urban Data Space for Green Deal - aims to provide solutions and mechanisms for making city-level environmental and climate data available ad usable by everyone. USAGE will support the implementation of various European Green Deal priority actions at the level where climate change is mostly felt: cities and towns. USAGE will provide AI-based tools, geo-data analytics and innovative governance mechanisms to share, access and use city-level data from Earth Observation (EO), Internet of Things (IoT), authoritative and crowd sources, leveraging on standards for data and service interoperability. USAGE will validate its solutions in four diverse pilot areas located in four different countries, focusing also on the reusability of the solutions in other urban areas. USAGE is funded under the EU call HORIZON-CL6-2021-GOVERNANCE-01-17, Grant Agreement no. 101059950 and is coordinated by Universidad Politécnica de Madrid (UPM).
VAIPOSA - Verifiable AI/ML Techniques for PNT Applications - aims to develop innovative methodologies for designing and implementing Positioning, Navigation, and Timing (PNT) components using AI and machine learning (ML), while ensuring safety, robustness and resilience. It employs a realistic road environment simulator (CARLA) where an autonomous agent with an AI-based PNT system must adapt to changing conditions. The project is funded by the European Space Agency NAVISP program
WildDrone – Autonomous Drones for Nature Conservation Missions - is an international training network funded by the EU Marie Skłodowska Curie Actions. WildDrone aims to revolutionize wildlife conservation practices by using autonomous drone technology as a unifying platform to monitor wildlife populations, track their movements, and manage human-wildlife conflicts. We believe that the rapid decline of wildlife populations has prompted an urgent need for more effective and feasible nature conservation practices. The project will operate from 1 January 2023 – 31 December 2026.
V0T3D - Ventilation Optimizing Technology based on 3D-scanning - wants to robotize the Raw Material sector by introducing modern methods for the optimization of underground ventilation with the main aim of reducing electricity consumption by 1,5%. The VOT3D project, funded by the EIT Raw Materials, will deliver an innovative solution based on 3D digitization of underground tunnels and the creation of their real digital twins. These detailed and precise 3D data will allow to improve airflow simulations in order to adjust the most favorable ventilation scenario for the digitized underground tunnels.
TEF & EDIH projects
Large industrial projects
MIAMI is an industrial project which aims to develop a system able to integrate advanced metrology and artificial intelligence (AI) for: (i) helping an operator in setting up a laser micro-machining process and in checking the quality of the obtained result using 3D analytics; (ii) improving the production process by learning defects and their relation with machining parameters; (iii) developing new business opportunities related to design and sale of intelligent laser machines and related services. Two types of micro-machining are considered: LIPPS and micro-channels on steel. 3D data are collected with SEM and interferometers. MIAMI is in collaboration with Kirana and supported by the Autonomous Province of Trento.
GlassFORM Evolution is a commercial project leaded by GlassFORM.ai, a joint venture among BOTTERO S.p.A. and TIAMA SAS, worldwide leader of glass production machinery (forming machines and inspection and quality control systems).
The project aims to develop an automatic control system for glass container forming, using technologies and Artificial Intelligence and Machine Learning algorithms, based on data and measurements collected by the machines present on the production line and on formed containers, aimed at building predictive models of the production line and the implementation of appropriate commands and adjustments for the control automatic and optimization of the forming process.
3DOM contributes to the sensor characterisation for gob analyses, with special emphasys on accuracy and quality control. The project is funded by the Autonomous Province of Trento (Legge 6) and runs from 10/2022 to 04/2025.
The research activity, in collaboration with various private compaies, investigates innovate optical metrology methods for manufacturing inspection, quality control and production monitoring. We focus on texture-less and non-collaborative surfaces, normally problematic for inspections based on 3D optical methods.
National projects
FAIR carries out research activities financed under the National Recovery and Resilience Plan (PNRR) - and by any subsequent funding - in the Artificial Intelligence sector. FAIR tackles the implementation, coordination and management of the "Extended Partnership" linked to thematic area 1 - Artificial Intelligence: Foundational Aspects. FAIR aims to investigate research questions, methodologies, models, technologies and also the ethical and legal rules to build AI systems capable of interacting and collaborating with humans, perceiving and acting within ever-changing contexts. FAIR is split in multiple Spokes which are tacking care of the implementation activities. We are involved in Spoke 2 "Integrative AI" and we will deal with integrative methods that go beyond current approaches based on vertical and separate areas of AI.
The ICSC "National Research Centre" for High Performance Computing, Big Data and Quantum Computing carries out R&D activities for innovation in the field of simulations, computing and analysis of high-performance data. The National Research Centre is one of the five National Centres established under the National Recovery and Resilience Plan (PNRR). We are involved in Spoke 4 "Earth and Climate" which aims to create of an interdisciplinary framework that integrates components of the most advanced modeling of the Earth system, to provide the scientific community and users with a flexible, reliable and powerful tool.
iNEST is the ecosystem for innovation of the Italian northeastern region, namely a web of interconnections between research bodies, both public and private, whose aim is to develop a “nest of synergies” for the implementation of digital and ecological transition technologies. iNEST’s fields of inquiry and intervention include manufacturing, agriculture, maritime, mountain, construction, tourism, culture, health and nutrition industries. The iNEST ecosystem is one of the 11 ecosystems established under the National Recovery and Resilience Plan (PNRR). We are involved in Spoke 3 "Green and digital transition for advanced manufacturing technology".
NAUTILUS - uNder And throUgh waTer datasets for geospatIaL stUdieS
TIME - hisTorical aerIal iMagEs
UseGEO - UAV-based multi-sensor datasets for geospatial research
LightCAM: Enlightening the camera obscura – where photogrammetry, computer vision and robotics meet
GRAPHOS - All-Purpose Open-Source Photogrammetric Tool
Benchmark for Multi-Platform Photogrammetry
Internal projects
Simultaneous Localization and Mapping (SLAM) methods employes advanced, real-time and optmized photogrammetric methods to derive, simultaeously, the camera poses (Localization) and sparse 3D point cloud (Mapping) of the surveyed scene. We are working to add more surveying concepts to SLAM solutions from an hardware and software point of view.
In order to preserve the memory of the Sycamore Gap tree, a symbol of the UNESCO Hadrian's Wall site that was felled in an act of vandalism in September 2023, deep-learning-based features trained specifically on challenging image datasets are employed. The research demonstrates how unordered crowdsourced images and UAV videos can be oriented and used for 3D reconstruction purposes. This allows the memory of the Sycamore Gap tree to live on and exhibits the potential of photogrammetric AI for reverse engineering lost heritage.
Classification and segmentation of 3D data has become a very active research field. Researchers are developing solutions to deliver enriched 3D information useful in many fields and applications. We are developing methodologies based on modern machine/deep learning methods useful for urban modeling, heritage documentation, etc.
DIGITAL FORESTRY
Terrestrial photogrammetry as well as monochromatic and multispectral LiDAR are used to study forestry areas for single tree identification, tree species classification, etc. We are developing novel geometric & deep learning methods to couple 3D data with added-value information useful for sustainable forest management. In parallel, VR solutions are proposed to annotate and explore 3D forestry environments. The activities are in collaboration with EuroSDR, TU Vienna, FGI, ETH and and private companies.
The availability and reliability of VR/AR/MR solutions, including head-mounted displays and glasses, is allowing interesting immersive virtual experiences in many fields, from industry to heritage.
OUR INDUSTRIAL PARTNERS
