Universal Robots
Re-imagining Opera. An outdoor experiential advertising campaign with augment reality. In collaboration with Tapestry Opera, Toronto and OCAD University.
About the project
The installation will be targeted towards advertising the opera and giving a glimpse of technology and story to the audience so that they are aware of the opera is not in a conventional setup but will give them a new immersive experience. It will be an outdoor opera campaign, digital billboards, experiential advertising where augment reality or mixed reality will be used to show the audience the future of the human race with respect to the story in the play Rossum's Universal Robots by the Czech writer Karel Čapek.
Individual User Research, Interaction Design, Visual Design, Prototyping & Testing, Production
Duration 4 weeks,
Collaboration Tapestry Opera, Toronto and OCAD University
A collaboration between the Tapestry Opera, Toronto and OCAD University. The opportunity to collaborate with the company, librettist Nicolas Billon, and composer Nicole Lizée to develop supporting material for the production.
Concept & Prototype
“A robot rebellion leads to the extinction of the human race”
Based on these lines from the play or say the climax of the story. The installation setup will consist of a digital screen that will display live video using a rear camera and the people coming from the rear will be augmented to robots as seen from the screen side. As if it shows the future that the robots are in majority and they took over the humans. Followed by a short trailer and link to the tickets or more information.
Prototype Exploration
1. Lens Studio
Software - Unity, Lens Studio by Snap Chat
Sensors - None
Camera - RGB camera front/back
2. P5.js
Software - P5.js, Vida / poseNet skeleton detection library
Sensors - None
Camera - RGB camera front/back
Want to tryout the experimental prototype?
Research & Ideation
Tapestry Opera - TAP:EX
TAP:EX pushes the boundaries of opera. Past explorations have intersected with punk rock, film, Persian classical music, physical theatre, turntablism, and hip hop. The Tapestry Opera will be presenting a re-imagining of this play as an opera in 2021, Opera delves into the world of augmenting and forcing us to question reality.
What does it take to enhance or challenge our notion of what is real at any moment?
Can opera working with technologies cause us to lose our sense of where we actually are?
It will be an experiential and experimental opera.
Link to the Website - https://tapestryopera.com/tapex-augmented-opera/
About the book
Rossum's Universal Robots, a play by the Czech writer Karel Čapek famously introduced the word robot into the english language 100 years ago. Čapek's vision, and warnings, of the future of human and machines working together are still prescient as we enter the age of Artificial Intelligence
Link to the Book - http://preprints.readingroo.ms/RUR/rur.pdf
Project Proposal
Relation with R.U.R
In Rossum's Universal Robots (R.U.R.) a 1920 science fiction play by the Czech writer Karel Čapek. A factory that makes artificial people, called robots, from synthetic organic matter. They seem happy to work for humans at first, but
“A robot rebellion leads to the extinction of the human race”
Based on these lines from the play or say the climax of the story. The installation setup will consist of a digital screen that will display live video using a rear camera and the people coming from the rear will be augmented to robots as seen from the screen side. As if it shows the future that the robots are in majority and they took over the humans. Followed by a short trailer and link to the tickets or more information. The installation can be installed at public spaces, mall, subways, bus stops, etc
Brainstorming Ideas
Augmented Costumes
The costumes can be augmented such that the audience can see the mapped outfits of robots as well as supporting actors in real-time.
4. Augmented Intelligence
Making the headsets smart to read the minds and thereby alter the opera environment in sync with the story and flow of the play.
2. Musical Robotics
A device that could produce musical sounds automatically by leveraging mechanical systems. Using Robots to play music in sync with the Opera.
5. Alternate Reality Campaigns
Innovating and gaining public attention has become a priority. Interactive displays can be used in making communication more interactive and dynamic.
3. Augmented Stage Design
Setting up an experiential environment with augmented light effects, stage backdrops, and scenes. Adding special effects in the concert hall.
6. Audience Support Structures
What if the audience can control the appearance, structure, music of the play? Customize and control the environment of the opera.
3. ARKiT 3 with AR Foundation
Software - Unity3D 2019.1.5f1 with iOS build target
MacOS Catalina 10.15 (Beta)
XCode 11 (Beta)
Sensors - None
Camera - RGB camera front/back
In Progress…
I am exploring and working with ARKit 3 on IOS platform using Unity for mapping.