Computer that Reads Body Language

Researchers at Carnegie Mellon University's Robotics Institute have enabled a computer to understand the body poses and movements of multiple people from video in real time -- including, for the first time, the pose of each individual's fingers.

Computer that reads body language. Image credit: tasnimnews.com (CC BY 4.0)

This new method was developed with the help of the Panoptic Studio, a two-story dome embedded with 500 video cameras. The insights gained from experiments in that facility now make it possible to detect the pose of a group of people using a single camera and a laptop computer.

Yaser Sheikh, associate professor of robotics, said these methods for tracking 2-D human form and motion open up new ways for people and machines to interact with each other, and for people to use machines to better understand the world around them.

The ability to recognize hand poses, for instance, will make it possible for people to interact with computers in new and more natural ways, such as communicating with computers simply by pointing at things.

Detecting the nuances of nonverbal communication between individuals will allow robots to serve in social spaces, allowing robots to perceive what people around them are doing, what moods they are in and whether they can be interrupted.

A self-driving car could get an early warning that a pedestrian is about to step into the street by monitoring body language.

Enabling machines to understand human behavior also could enable new approaches to behavioral diagnosis and rehabilitation for conditions such as autism, dyslexia and depression. (Tasnim News Agency)

YOU MAY ALSO LIKE

Harnessing Heat to Power Computers

Heat is commonly regarded as computing's mortal enemy. Two researchers, however, developed a method to use heat as an alternative energy source.

Samsung Ends Production of Problem-Plagued Galaxy Note 7

South Korean electronics giant Samsung says it will no longer manufacture its troubled Galaxy Note 7 smartphone after numerous reports around the globe of overheating.

Tesla to Test Self-driving Electric Trucks

U.S. electric car manufacturer Tesla is close to testing a long-haul self-driving electric truck that could drive in convoys following a lead vehicle.

Biosensor promises early malaria diagnosis

A strip of chromatography paper similar to that used in rapid pregnancy tests is the basis of a bio-sensor for detecting malaria that has been developed by Brazilian researchers.

Facial recognition software has a gender problem

With a brief glance, facial recognition software can categorize gender with remarkable accuracy. But if that face belongs to a transgender person, such systems get it wrong more than one third of the time, according to new CU Boulder research.

Better biosensor technology created for stem cells

Researchers have created better biosensor technology using a newly developed instrument that may lead to safe stem cell therapies for treating Alzheimer's and Parkinson's diseases and other neurological disorders.