讲座论坛
From Human Modeling to neurally-driven Symbiotic Embodiment
发布时间:2024-04-07 10:40:57 905

演讲人Speaker:Sami Haddadin教授

题  目Title  :From Human Modeling to neurally-driven Symbiotic Embodiment

时间Date:2024年4月9日       Time:上午 10:00 ~ 11:00

地点Venue: T3栋 502 室

内容摘要Abstract:

In developing transformative neuroengineering technologies for restoring autonomy and mobility to those with physical disabilities, a shift towards a more compatible, safe, and anticipatory human-centered approach is essential. This necessitates the integration of advanced AI and machine learning algorithms capable of leveraging high throughput sensory data (including kinematics, eye-tracking, invasive and non-invasive brain data) and human neuromechanics models (human digital twins). Rather than expecting humans to conform to and learn how to operate robotic systems, including prosthetics, robot neuroassistants, or brain-controlled humanoids, the focus is on designing systems that recognize human intent and emulate natural limb and whole-body behavior. This entails embedding models of human movement and interaction into robot learning and control algorithms, maximizing therapeutic effects and patient benefit as well as achievable autonomy. The core of this approach is the development of human digital twins driven by multi-modal sensory data, encompassing neuromechanics modeling, muscle dynamics, and control mechanisms. By learning from human physiology, robot systems can exhibit anthropomorphic traits and reflexes, achieving advanced capabilities while retaining humanlike responses. The use of intelligent control and learning algorithms enables the realization of AI-driven systems, such as prostheses, which facilitate real-time, user-in-loop interaction and functionality, such as grasping and motion compensation.

Under this new perspective, transformative technologies also advance beyond basic BrainMachine Interfaces (BMI), with the focus shifting from mere brain signal processing to neurally-driven symbiotic embodiments, aiming to decode neural signals for more natural human-like behavior in robotic systems. This includes decoding full state joint, impedance, and force policies and integrating human digital twins to enhance user embodiment.In summary, this new generation of transformative technologies paves the way for a new era of human-model-informed, symbiotic embodiments, enhancing the integration and effectiveness of AI-empowered robotic systems in various domains, particularly in healthcare and rehabilitation.

 个人简介(About the speaker):

Sami Haddadin is Professor at TUM and Director of Europe's largest Robotics and AI institute MIRMI. His research spans robotics, AI, and human neuroscience with focus on human-centered robotics, embodied AI, robot learning and control, collective intelligence, and human-robot symbiosis. His robot developments range from manipulators and hands, Unmanned Aerial Vehicles (UAVs), or mobile systems to humanoids, intelligent prosthetics and medical robots, and exoskeletons. His pioneering research has influenced numerous products, including those from Franka Emika, KUKA, Skydio, and Reactive Robotics. Many of his revolutionary robots were commercialized in the industrial, medical or private sector and are used worldwide. His works were featured on the covers of TIME magazine, National Geographic, and the New York Times. Sami received numerous awards, including the George Giralt Ph.D. Award, the RSS Early Career Spotlight, the IEEE/RAS Early Career Award, the Alfried Krupp Award, the German President’s Award for Innovation in Science and Technology, and the Leibniz Prize. He is an IEEE Fellow. He is a member of both the German National Academy of Sciences Leopoldina and the national academy of science and engineering acatech. Sami’s work is regularly exhibited in renowned science and art museums, including Deutsches Museum and Pinakothek der Moderne. He was a member of the High-Level Expert Group on AI of the European Commission and is the chairman of the Bavarian AI Council. Sami contributed to the strategic developments of the European, German, and Bavarian AI strategies.