On Site | Multiverse DROPPING Proposal
Summary:
This interactive, audio/visual installation will use live conversations recorded and presented in both real and virtual space. Drawing from the collaborators interests in and exploration of the theory of the Multiverse, the intention of this project is to blur the relationships between time and location, and explore the theoretical overlap of "possible worlds".
Project Description:
DROPPING is a collaboration between visual artist Jenna Spevack and Second Life artist, Juria Yoshikawa (Lance Shields). This interactive, audio/visual installation will use live conversations recorded and presented in a physical location in real life (RL) and in a virtual location in Second Life (SL).
The project will be composed of 30-second audio recordings captured every 30-seconds in both locations. The installation in both spaces will be similar and the users actions will directly inform the visual and auditory outcomes in the other space. Both locations will present an animation of rotating fragments linked to the audio recordings - each audio fragment occupying a space on the "clock". The animation and audio clips will pan in and out and spin faster and slower, depending on the viewer's location in the space. Slowing down the speed (standing in the center of the space) allows the user to isolate individual parts of the audio, while increasing the speed (standing at the periphery of the space) creates a cacophony of sound, wherein only certain fragments of dialog are heard.
A bridge between the physical and virtual spaces will be developed by feeding interaction data created by the SL user into the RL installation and visa versa. For example, when a user enters the installation (in either RL or SL) a second "clock" (animation of spinning audio fragments) will appear on top of the primary animation in the other location. This animation and its resulting audio will be controlled by the remote user and will create layers of complexity, but also familiarity.
The RL installation* will consist of a projected animation of rotating fragments, audio speakers, proximity sensors, and physical computing components used to transmit the users movement data from the physical to the virtual space. In the SL installation, an avatar will take the place of a physical viewer and the animation of fragments will become virtual 3D objects spinning around the avatar. The virtual objects and the binaural panning effect of the audio, which can be experienced more effectively using headphones, will create a visually and aurally immersive experience.
The intent is to draw a connection between the physical space we know (be it RL or SL) and the theoretical overlap of "possible worlds". Some philosophers, such as David Lewis, believe these worlds are just as real as the actual world, but are not physically observable. In this installation the user will able to observe and influence this alternate reality through indirect observation. Quantum physicists think that the act of participation or observation determines how we experience a particular reality and believe it is this awareness that creates the entire universe.
*With future additional funding, the RL installation could be realized using a true immersive digital environment that would mirror the SL installation.
Production Timeline:
Month 1-2: Technology Research
- Determine best choice for physical computing components, projection system, sound system for RL installation, in consultation with physical interaction designers/colleagues in the Emerging Media Program the City University of New York.
- Consult with SL artists and programmers to determine interaction flow between RL installation and SL installation.
Month 3-5: Physical Computing Production
- Test audio capture, interaction and system functionality in physical environment.
Month 6: RL Production
- Install real-life physical computing components and audio/visual installation at Monti Studios, Brooklyn, NY
Month 7-10: SL Production
- Design/develop 3D components and audio for SL
- Render and install SL installation on CityTech sim.
Month 11-12: Promotion
- Develop website/blog to promote project
- Launch
Budget:
- Programmer/Interaction Designer Fees: $3000
- RL audio/video equipment and materials: $2000
- Server space/SL land use: $500
- Website design and misc: $500
TOTAL: $6000
Physical (RL) Space :
Experience Diagram
Simulation Video:
Simulation Images:
Virtual (SL) Space:
Experience Diagram
Collaborators:
Jenna Spevack, Brooklyn, NY, USA - PDF Resume
Juria Yoshikawa (Lance Shields), Tokyo, Japan - PDF Bio
Work Samples:
Dropping Brooklyn 
PLAY - Jenna Spevack -- interactive animations
Dropping Brooklyn is currently on exhibit at Sanlun Yishu in Beijing, China
PLAY was previously exhibited at the Longwood Arts Project and Hostos Art Center in NYC.
Blink - Two Rooms and an Island
- Juria Yoshikawa (Lance Shields) -- virtual performances
Participatory dance performances presented in SL and live in Berlin on Feb. 15, 2009.