Sensory storytelling: what are artists’ responsibilities when creating immersive digital…

The following two tabs change content below.
Linda Raftree
I’m currently working part-time with Plan International USA and serving as a special advisor to the Rockefeller Foundation’s Evaluation Office. I convene Technology Salons in New York City and am a co-founder of Kurante, a start-up consulting firm. Linda's posts are from her blog called "Wait...What?"

Karen Palmer is a digital filmmaker and storyteller from London who’s doing a dual residence at ThoughtWorks in Manhattan and TED New York to further develop a project called RIOT, described as an ‘emotionally responsive, live-action film with 3D sound.’ The film uses artificial intelligence, machine learning, various biometric readings, and facial recognition to take a person through a personalized journey during dangerous riot. Karen Palmer, the future of immersive filmmaking, Future of Storytelling (FoST)  Karen describes RIOT as ‘bespoke film that reflects your reality.’ As you watch the film, the film is also watching you and adapting to your experience of viewing it. Using a series of biometric readings (the team is experimenting with eye tracking, facial recognition, gait analysis, infrared to capture body temperature, and an emerging technology that tracks heart rate by monitoring the capillaries under a person’s eyes) the film shifts and changes. The biometrics and AI create a “choose your own adventure” type of immersive film experience, except that the choice is made by your body’s reactions to different scenarios. A unique aspect of Karen’s work is that the viewer doesn’t need to wear any type of gear for the experience

Read this article:
Sensory storytelling: what are artists’ responsibilities when creating immersive digital…