Disney Machine-Learns for Laughs

Quartz: Disney “is using machine learning to assess the audience’s reactions to films based on their facial expressions, it wrote in a new research paper. It uses something called factorized variational auto-encoders, or FVAEs, to predict how a viewer will react to the rest of a film after tracking their facial expressions for a few minutes.”

“The FVAEs learn a set of facial expressions, such as smiles and laughter, from the audience, and then make correlations between audience members to see if a movie is getting laughs or other reactions when it should be—a much more sophisticated version of how Amazon and Netflix make suggestions for new things to buy or watch based on your shopping or viewing history.”

“By placing four infrared cameras and infrared illuminators above a theater screen, the researchers were able to identify 16 million facial landmarks, or expressions, from more than 3,100 theatergoers during 150 screenings of nine Disney movies … the data was then analyzed with a computer. (Before this gets too creepy, Disney isn’t tracking your every move at your local theater. The experiment took place during screenings at one particular 400-seat theater. And audiences likely had to choose to participate.)”


Your Thoughts?