SoftBank Robotics, which created the humanoid robot Pepper, integrates into the system for interaction with the person Emotion AI from Affectiva. It will teach robot to distinguish joy, disgust, surprise, fear and other emotions.
The algorithm uses Pepper cameras and microphones to recognize anger, contempt, disgust, fear, joy, sadness and surprise. The robot will distinguish between a smile and a grin, and also understand when a person is distracted or wants to sleep.
SoftBank Robotics introduced Pepper in 2015. It can understand speech, respond to the interlocutor and maintain conversation through the tablet in the case. It was created as a companion for single people and an assistant for business. For example, in 2015 it worked for a week at the Margiotta Food & Wine store in Edinburgh, but the management dismissed him because the robot could not cope with the tasks. Pepper's answers were too general and did not help customers find the right products, and it also joked inappropriately.
In March 2018, researchers found vulnerabilities in robots from SoftBank Robotics. Thanks to these findings, intruders can force androids to extort money, show pornography in public places and swear with clients. Although malware was developed for NAO, the same code can be used for Pepper.