arch50

VIDEO AVAILABLE: CONTACT INFO@COVERMG.COM The Italian Institute of Technology in Genova, Italy???s humanoid robot, the iCub3, allows users to touch and feel items from hundreds of miles away - and could be set to make the Metaverse a hands on experience. The remarkable robot allows users to move and feel in a place without being there, with its advanced telexistence system, also called iCub3 avatar system. Developed by researchers at IIT-Istituto Italiano di Tecnologia, the new system was first tested in an online demonstration involving a human operator based in IIT, Genova, and the robot at La Biennale di Venezia late last year (2021). The two sites are 300km far away and the communication relied on basic optical fiber connection. Researchers demonstrated that the system transports the operator locomotion, manipulation, voice, and face expressions to the robotic avatar, while receiving visual, auditory, haptic and touch feedbacks. It was the first time that a system with all these features was tested using a legged humanoid robot for remote tourism so that the human operator may feel and experience where the avatar is. They plan to further develop the system to be applied in scenarios from disaster response to healthcare, as well as the newly created metaverse too. The research team, coordinated by Daniele Pucci, Principal Investigator of the Artificial and Mechanical Intelligence (AMI) Lab at IIT in Genova. One of their research goals is to obtain humanoid robots that play the role of avatars, namely a robotic body that acts in place of humans without substituting them but allowing them to be where they cannot. ??sWe believe that this research direction has a tremendous potential in many fields???, explains Daniele Pucci. ??sOn the one hand, the recent pandemic taught us that advanced telepresence systems might become necessary very quickly across different fields, like healthcare and logistics. On the other hand, avatars may allow people with severe physical disabilities to work and accomplish tasks in the real world via the robotic body. This may be an evolution of rehabilitation and prosthetics technologies.??? Advanced software architecture, designed by the IIT researchers, controls and manages the interconnection between the iCub3 robot and the iFeel system. Also, this software infrastructure allows the integration of commercial wearable technologies, which complete the iCub3 avatar system. For instance, the remote user walks in-place inside a virtual-reality platform that allows him to move the upper-body freely. The iCub3 robot is 25 cm taller than the previous iCub versions, thus measuring 1.25 m and representing a more adequate platform to interact within a human environment. Its balance and locomotion are more robust and able to emulate human movements and physical interaction better. The robot is, therefore, bigger - weighing 52 Kg vs 33 Kg - and has more powerful motors in its legs, thus acquiring a faster locomotion. Moreover, the iCub3 robot differs from the previous platform also for a different actuation mechanics, no longer based on cable-driven joints. On the sensors side, it has an additional depth camera and force sensing of the latest generation withstanding higher robot weight. Lastly, iCub3 has a higher capacity battery, which is located within the torso assembly instead of being included in a rigidly attached backpack. The user is also provided with a headset that tracks the user expressions, eyelids, and eye motions. These head features are projected onto the avatar, which reproduces them with a high level of fidelity: avatar and human share very similar facial expressions. The user wears sensorized gloves that track his hand motions and, at the same time, provide haptic feedback. Thanks to the avatar system, the remote user can smile, talk, and shake hands Analogously, when the guide hugged the avatar in Venice, the operator in Genova feels the hug thanks to the IIT???s iFeel suit that also provides upper body haptics. Moreover, conversation is possible thanks to systems that record and transmit the operator voice so that the avatar can reproduce it in Venice. The transmission in Venice was streamed on a standard optical fiber internet connection, resulting in only a few milliseconds of delay. ??sOur iCub 3 avatar system is validated on a legged humanoid robot allowing remote verbal, non-verbal and physical interaction, which represents a perfect starting point when looking for platforms to emulate humans for all interaction aspects.??? ??" comments Daniele Pucci. ??sWhat I also see in our near future is the application of this system to the so-called metaverse, which is actually based on immersive and remote human avatars???. The Director-General of Contemporary Creativity of the Ministry of Culture and Commissioner of the Italian Pavilion, Onofrio Cutaia, said: "With great pleasure, we received the proposal to collaborate with the Italian Institute of Technology in Genova on this project. We really would like to thank Arch. Alessandro Melis, curator of the Italian Pavilion at the 17th International Architecture Exhibition - La Biennale di Venezia, for sharing our enthusiasm and interacting with iCub 3 in a surprising dialogue between man and robot. A unique opportunity to promote contemporary cultural heritage through new forms of communication. We firmly believe that interdisciplinarity and interaction between languages is the real challenge to be faced, and this is what the Directorate-General will focus on in the coming years." Where: Genova, Italy When: 03 Mar 2022 Credit: IIT-Istituto Italiano di Tecnologia/Cover Images **EDITORIAL USE ONLY. MATERIALS ONLY TO BE USED IN CONJUNCTION WITH EDITORIAL STORY. THE USE OF THESE MATERIALS FOR ADVERTISING, MARKETING OR ANY OTHER COMMERCIAL PURPOSE IS STRICTLY PROHIBITED. MATERIAL COPYRIGHT REMAINS WITH STATED SUPPLIER.**