增强现实辅助的互认知人机安全交互系统

In modern manufacturing, the interaction and symbiosis between humans and the industrial robot are one of the foci of smart manufacturing. During human-robot interaction(HRI), the potential risk of any injury to workers caused by industrial robots is very critical and should be well-addressed to ensure manufacturing safety. However, in the dynamic and uncertain manufacturing environment, the current HRI safety is still based on the robot's perception of the environment to achieve collision avoidance, lacking adaptable decision-makings under mutual cognition. Therefore, to enhance the cognition of human operators in the working environment and improve the robot's collision avoidance and adaptive motion planning capabilities, this work designs and further implements a mutual cognitive HRI safety system based on augmented reality (AR) in a wearable manner. In the proposed system, the wearable AR device serves as the bridging interface to realize the virtual-real registration of the robot, the virtual-physical mapping of the working environment of the HRI process, and to collect the information of human, robot, and working space. In addition to these, a hierarchical HRI safety strategy is introduced for real-time mutual cognitive assistance to both humans and robots, namely: 1) robot motion speed control and safety area visualization based on human-robot distance, 2) virtual-physical mapping for robot motion preview and collision detection, and 3) deep reinforcement learning-driven motion planning for collision avoidance strategies generation. Lastly, a prototype system is further developed to validate the feasibility and effectiveness of the proposed strategies. By leveraging advanced artificial intelligence and human-robot interaction technologies, it is envisioned this work can bring insightful safety protection mechanisms to better achieve symbiotic human-robot collaboration.