A deep reinforcement learning approach to enhance autonomous robotic grasping and assembly

A deep reinforcement learning approach to enhance autonomous robotic grasping and assembly

A deep reinforcement learning approach to enhance autonomous robotic grasping and assembly
The diagram of the deep reinforcement learning method for robot grasping and assembly operation skills. Credit: The International Journal of Advanced Manufacturing Technology (2024). DOI: 10.1007/s00170-024-13004-0

Semi-autonomous and autonomous robots are being introduced in a growing number of real-world environments, including industrial settings. Industrial robots can speed up the manufacturing of various products by assisting human workers with basic tasks and lightening their workload.

Two of the most crucial tasks in manufacturing are object grasping and product assembly, yet reliably tackling these tasks using robotic systems can be challenging. One of the primary limitations of industrial robots for automated assembly chains is that they need to be extensively programmed to tackle specific tasks (e.g., grasping and assembling specific items), and their product-specific programming can take time.

Researchers at Qingdao University of Technology recently set out to tackle this crucial limitation of industrial robots using deep reinforcement learning. Their paper, published in The International Journal of Advanced Manufacturing Technology, introduces new deep learning algorithms that can speed up the time required to train industrial robots on new grasping and assembly tasks.

“This paper proposes a deep reinforcement learning-based framework for robot autonomous grasping and assembly skill learning,” Chengjun Chen, Hao Zhang and their colleagues wrote in their paper.

“Meanwhile, a deep Q-learning-based robot grasping skill learning algorithm and a PPO-based robot assembly skill learning algorithm are presented, where a priori knowledge information is introduced to optimize the grasping action and reduce the training time and interaction data needed by the assembly strategy learning algorithm.”

The new techniques for robot training introduced in this recent paper build on computer vision and machine learning tools introduced in recent years. First, the researchers developed a deep learning algorithm designed to rapidly teach robots new object grasping skills, as well as a separate algorithm to train robots to assemble specific objects.

Concurrently, they also designed reward functions that can be used to effectively assess the grasping and assembly skills of industrial robotic systems. These include both grasping and assembly constraint reward functions.

To assess the potential of their proposed robot training toolbox, Chen, Zhang and their colleagues tested it in both simulations and on physical industrial robots. In their real-world experiments, the team specifically used UR5, a lightweight robotic arm often applied to industrial tasks, along with a RealSense D435i camera to collect RGB images of objects, which their algorithms can then analyze.

“The effectiveness of the proposed framework and algorithms was verified in both simulated and real environments, and the average success rate of grasping in both environments was up to 90%. Under a peg-in-hole assembly tolerance of 3 mm, the assembly success rate was 86.7% and 73.3% in the simulated environment and the physical environment, respectively,” the researchers wrote in their paper.

The initial results collected by Chen, Zhang and their collaborators are very promising, suggesting that their training algorithm toolkit can speed up the programming of industrial robots, rapidly teaching them to reliably grasp and assemble objects. In their next studies, the researchers plan to further improve their approach and continue testing it on common grasping and assembly tasks.

“In future work, we will improve the hole detection accuracy and domain randomization of the shape and image of the holes in the virtual environment, optimize the strategy from the simulation environment to the physical environment, and reduce errors in both stages to improve the assembly success rate of in the physical environment,” the researchers concluded.

More information:
Chengjun Chen et al, Robot autonomous grasping and assembly skill learning based on deep reinforcement learning, The International Journal of Advanced Manufacturing Technology (2024). DOI: 10.1007/s00170-024-13004-0

© 2024 Science X Network

A deep reinforcement learning approach to enhance autonomous robotic grasping and assembly (2024, February 6)
retrieved 7 February 2024
from https://techxplore.com/news/2024-02-deep-approach-autonomous-robotic-grasping.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Disasters Expo USA, is proud to be supported by Inergency for their next upcoming edition on March 6th & 7th 2024!

The leading event mitigating the world’s most costly disasters is returning to the Miami Beach

Convention Center and we want you to join us at the industry’s central platform for emergency management professionals.
Disasters Expo USA is proud to provide a central platform for the industry to connect and
engage with the industry’s leading professionals to better prepare, protect, prevent, respond
and recover from the disasters of today.
Hosting a dedicated platform for the convergence of disaster risk reduction, the keynote line up for Disasters Expo USA 2024 will provide an insight into successful case studies and
programs to accurately prepare for disasters. Featuring sessions from the likes of The Federal Emergency Management Agency,
NASA, The National Aeronautics and Space Administration, NOAA, The National Oceanic and Atmospheric Administration, TSA and several more this event is certainly providing you with the knowledge
required to prepare, respond and recover to disasters.
With over 50 hours worth of unmissable content, exciting new features such as their Disaster
Resilience Roundtable, Emergency Response Live, an Immersive Hurricane Simulation and
much more over just two days, you are guaranteed to gain an all-encompassing insight into
the industry to tackle the challenges of disasters.
By uniting global disaster risk management experts, well experienced emergency
responders and the leading innovators from the world, the event is the hub of the solutions
that provide attendees with tools that they can use to protect the communities and mitigate
the damage from disasters.
Tickets for the event are $119, but we have been given the promo code: HUGI100 that will
enable you to attend the event for FREE!

So don’t miss out and register today: https://shorturl.at/aikrW

And in case you missed it, here is our ultimate road trip playlist is the perfect mix of podcasts, and hidden gems that will keep you energized for the entire journey


This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish. Accept Read More