20:57 GMT +328 October 2016
    SARA, the World Economic Forum

    Meet SARA, Very Social Robot That Intends to Make Society Stronger

    © Photo: Youtube/Yoichi Matsuyama
    Get short URL

    SARA is a Socially-Aware Robot Assistant that interacts with people in a whole new way, focusing on social bonds. This supercool virtual helper can understand not only what you say, but the exact way you say it, analyzing nonverbal signals and emotions.

    Justine Cassell, Carnegie Mellon University professor and director of the SARA project, told Radio Sputnik about interesting features that make this artificial intelligence so special.

    "SARA is not a physical robot made out of metal, but a kind of a virtual human projected on a screen. She relies on some very sophisticated AI's algorithms to recognize the kinds of talk you use to increase the relationship or to demonstrate that you are not very close to someone else," Prof. Cassell revealed.

    This robot can literally understand your mood:

    "She recognizes nonverbal cues: eye gaze, head nods and smiles. She even recognizes your vocal cues, the intonation and the way you talk."

    Smart SARA then puts all of those together to understand not only the meaning of your words but also the way you submit the information, the professor said. The AI understands the closeness you feel towards her, which helps her to obtain information from you, to think about what to say next and to do a better job at looking things up for you on the Internet, for example.

    SARA's creators put together quite a number of different AI branches in this particular project:

    "We are working at the same time on natural language, on computer graphics and on automatic planning," the director explained. "All these branches of AI come together with the goal quite opposite to the killer-robots we hear so much about. These are robots that intend to make society stronger by focusing on the social bond that we care so much about," she continued.

    Davos 2016 - Issue Briefing
    Davos 2016 - Issue Briefing

    Justine Cassell has worked on building virtual humans, graphical characters on the screen with an underline AI for quite a long time.

    "I always built them in the same way which was to watch people collaborating with each other and then analyze those human-human collaborations as the basis for the human-virtual human collaborations," the expert said.

    Then she started to realize that not all of the talk between people was about the task they were doing:

    "Even if they were supposedly collaborating on something quite serious, they've spent a fair amount of time engaging in small talk, praising each other, teasing each other and releasing personal details. And I wondered if that was just for fun or if it played a role."

    After a long analysis of this type of human conversation, Justine came to realize that it could be used to  determine how people use their voices, their nonverbal cues, the way they talk to someone else by the nature of the task they were working on and where they were in that task.

    "That's when I realized we needed to build that same social awareness into robots so that they could better collaborate with us," she added.

    For the moment, it is a face-to-face project: you have to come into a room and see a life-size virtual human projected on the wall. As soon as Cassell's team refines the project, they might put it on classroom computers or build it into a browser so that it could be used over the Internet.

    A system like this could find a number of different uses in human's life:

    "The first and foremost one that we thought of was education. Our project called RAPT, which stands for Rapport-Aligning Peer Tutor — we like acronyms in my lab — is the way of improving educational delivery. It can be implemented in under resourced schools, where students don't get the kind of teaching that meets their emotional or their social needs."

    According to Prof. Cassell, none of all the tutoring systems that are being put in classrooms today have that social awareness that might improve the students' ability to learn.

    "We've also been demonstrating our virtual personal assistant. So, you can imagine Siri, Cortana or any other personal assistant on the phone, enhanced with the social awareness that changes the way it talks to you overtime."

    At first, such a virtual helper communicates to you like to a stranger, but in six month of working together, this AI can become your new best friend.


    Russia Develops ‘Humanoid’ Robot Tank Complete With Head, Arms and Fingers
    Japan’s New Ping-Pong Master is a Robot
    Demanding Robot That Takes Selfies
    interaction, human, AI, robot, technology, Carnegie Mellon University, United States
    Community standardsDiscussion
    Comment via FacebookComment via Sputnik
    • Сomment

    All comments

    • Korz53
      Meet SARA, Very Social Robot That Intends to Make Society stranger then fiction in its humanity.
    • michael
      and this sara can distinguish when the nvl is an act, or a sign of depression or other mental health issue or even can distinguish differences in cultural specific behaviour? What also of hormonal secretions such as pheromes etc which provide humans with cues to another's behaviour? Maybe the designers are living in cloud cuckoo land. Then, on her own admission, she is basing this on her subjective observations of people who are collaborating with each other. This implies a task or goal or even a specific environment where such cues can be temporarily used - but it does not mean that the cues are anything but a 'language' used at the specific time for the the task in hand.
    Show new comments (0)

    Top stories