A five year European Union (EU) project to develop a collaborative humanoid that helps workers in industrial environments has come to an end, with the participants touting breakthroughs in “AI learning, natural language processing, and robotic manipulation.”
The SecondHands project, born from the EU’s €80 billion ($87 billion) Horizon 2020 research program, set out back in 2015 to develop what it called a “second pair of hands” for workers in factories, warehouses, and other industrial locations. The aim was to create a robotic assistant that is “proactive” in helping technicians lift or carry objects, acting as an apprentice-like helper that carries out the less skilled facets of a job. The project was developed under the auspices of a consortium of researchers and computer scientists from a number of organizations, including Ecole Polytechnique Fédérale de Lausanne (EPFL); Karlsruhe Institute of Technology (KIT); Sapienza, University of Rome; University College London (UCL); and Ocado Technology, the technology division of the U.K.’s online-only grocery giant Ocado.
The culmination of the program was a robot called ARMAR-6, developed at KIT in Germany, which was created to advance research into human-robot interaction in a structured, supervised environment.
Over the past couple of years, ARMAR-6 has been tested at Ocado’s automated customer fulfillment centers in the U.K. to perform maintenance on its myriad other automated systems — so in effect, Ocado has been trialing the use of robots to fix other robots. The idea is that a maintenance technician would perhaps be at the top of some ladders with a tool in their hand, and as they stretch their arm out to place the tool down, the robot would observe this action and take it from them.
Moreover, ARMAR-6 was designed to learn and adapt to real-world situations, such as moving or grasping an object in concert with a human, such as when a person wants to move an object from one location to another.
ARMAR-6 sports a range of sensors, cameras, a telescopic torso, and rotatable arms, hands, and fingers that can grasp. And crucially, it can interact with its environment using just visual data, detecting where humans are and estimating their pose purely from real-time images.
A major part of the project was also designed to showcase how ARMAR-6 could avoid collisions in a fast-moving industrial environment, where static and dynamic obstacles — including humans — are commonplace.
Other notable developments from the project include the creation of a speech interface based entirely on neural models, including all-neural speech synthesis and all-neural speech recognition. Such breakthroughs, according to KIT’s Dr. Sebastian Stüker, will lead to “better acceptance of ‘cobots’ by humans” and facilitate a more natural interaction between humans and robots.
It’s worth noting here that the broader goal of the SecondHands project was to help transition humanoid assistants from research labs to industry, with Ocado serving as the first stepping stone on that journey. With the project now officially concluded, plans are now in place to apply its findings to other sectors and use-cases, including autonomous vehicles, the oil and gas industry, among others.
It’s also worth noting that Ocado won’t be deploying ARMAR-6 at is fulfillment centers, which suggests that this is not quite ready for prime-time in a commercial environment. But given that there are various other undisclosed ARMAR-6 projects under way in other industries, this could go some way toward accelerating the use of humanoid assistants in the real world.
“The results of this project have shown categorically how robots can amplify the benefits of human expertise,” said Graham Deacon, robotics research fellow at Ocado Technology. “We’ll continue to build on these learnings, looking forward to a future when we can use these breakthroughs to apply them in a real world setting.”
What this projects ultimately highlights, though, is the need for academia and industry to work in tandem. There is no point developing AI-infused robotics in an isolated laboratory setting if it fails at the first hurdle in the real world.
The timing of SecondHands’ conclusion is also notable, as it comes when the world is having to embrace more automation due to social-distancing measures enforced by the COVID-19 crisis. In the future, the technologies that underpin ARMAR-6 could be redeployed in other environments such as “helping to reduce contamination, or in assisted living,” according to Deacon.