The developers of the University of Cassino and South Lazio presented a system that allows you to use the "power of thought" to control the robot. Stefano Chiaverini and his colleagues believe that the new brain-computer interface (IMC) will help control machines operating in conditions that are too dangerous for humans, and will make life easier for paralyzed people.
Their article has been published in the open-source online library of preprints ArXiv.org.
The prototype of the system uses a robotic manipulator, the commands for which are formed using the IMC-P300 method. P300 is a special component of brain potentials that is associated with complex cognitive activity. On the electroencephalograph data, it manifests itself when presenting an important stimulus in the series of unimportant ones.
In the simplest case, the IMC-R300 allows a person to mentally concentrate on the desired command or button from the proposed set, and the corresponding signal will be transmitted to the computer system. Italian developers managed to complement this scheme with an RGB-D camera, as well as advanced algorithms for executing “high-level” commands.
The camera, borrowed from the popular Microsoft Kinect game pad, allows the system to receive three-dimensional maps of surrounding objects and recognize them. And under the control of special algorithms of a pair of robotic manipulators, the Kinova Jaco is able to independently carry out the “general” instructions of a person, allowing one to forget about control over each of their movements.