nouveau terrain d'apparition panoscope sphere

On January 7, 2010 we launched the first general meeting after phase one of the “nouveau terrain d’apparition” (NTA) project has been accomplished. The first phase focused on establishing a solid and properly working system to run the panoscope in a networked state, allowing telepresence between two characters in a shared and immersive virtual space. The general meeting targeted at a presentation of the technical system (mostly developed by Mike Woznieski), a demo of the system and theoretical reflections on the potentials of the system from my side. Guest at the event were students from Université Laval in the the Museology Department and members of the Institut Technologies de l’information et Sociétés, Bob White from the Anthropology Department at Université de Montréal, Erin Manning, Brian Massumi and of course head researcher Luc Courchesne.

I will here focus on some potential alleys and first insights from the conversations. My presentation was targeted at opening the NTA-system’s black box (à la Bruno Latour) and to outline its actants and interdependencies. The importance for the first phase lies in the system or rather assemblage that has been developed. As Luc pointed out the other day, the system is at its limits in terms of computation and therefore we will have to take its state as “enabling constraint.” The first important move which occurred consists in going beyond the conceptualization of such a system as dispositif and to use the notion of the assemblage instead. This shift in terminology brings us close to think different registers of realities (those realities of matter included) together and to annihilate any kind of other-worldly conception of virtual reality. To unfold this move I was drawing on Andrew Murphie’s article “Putting the Virtual back into VR.” Here Murphie claims with a Deleuzian approach through “The Fold” that Virtual Reality as a concept can help us to understand and play with what Deleuze defines as the virtual, the continuous immanence of potential in each actualization.  Since assemblages of virtual reality provide the potential to narrow the usually very crowded (with percepts and affects) experiences in our general “Umwelt” (von Uexküll), we can more precisely tap into the field of the potential. What we encounter as assemblage exists on the one hand as a complex intertwining of different realities - material, human, social, spatial and computational -  and on the other hand as a narrowing of our sensory focus to experiment with the virtual relay in our experiences.

In resonance with the system’s actual state these considerations take specific configurations:

  • Space-time: In an immersed experiential space such as the panoscope the narrowing aspect of VR allows us to experiment with new experiences of space-time. Important for a successful design of such different experiences seems to me an appropriation of affective interaction design (as developed by Jonas Fritsch). As Fritsch outlines: the account of affect will have to ”…directly address forms of experience, forms of life, on a qualitative register” (Fritsch 2009). “Affect as a whole then is the virtual co-presence of potentials” (ibid.)
  • Affect & Interaction + Memory: To feel these co-presences of affective potentials the system might not only offer shared spaces for experience but also allow the potential for interaction. This point has been uttered by Massumi and Manning, as well as in my presentation and by Mike Wozinieski. The potential to actively contribute to the system seems crucial for an enhanced interactive immersive experience. This circumstance has two important values: On the one hand the experience of space-time is always related to the way memory occurs in Bergson and slightly different in Whitehead. Memory here functions as the potential side of an actualization in a new experience. Obviously, the human participant always carries potentialities into the system through memories. Such a form of memory adds a singular (yet potentially always collective) aspect to each experience with the system. Hence, an important consideration would be the generation of memory with the system. Not only through giving machine perception the potential for interaction but also to generate an affective moreness of computing other than traditional approaches of “affective computing” as emotional aspects of programming. For the future I will follow up this thought under the concept of “affective and perceptive traces.”
  • Time and Duration: Another form of space-time configuration that might be enhanced through interactive modes of contributing actively to the system would be jumps, leaps and the sensation of duration through the system. At the moment the space inside the panoscope consists of spheres (360° images), time-lines with images that relate to certain biographies, spatial city environments (e.g. Toronto), and animated spheres with moving sound and image. Since experience here is spatialized and therefore according to Bergson misses in its euclidian appearance a thorough attribute of duration (durée), the durational aspect need to be generated by particular strategies. One of these strategies has been mentioned by Erin Manning as boredom. For her, a new user of the system has to arrive at a point of boredom to become creative with the system. To allow this creativity, we need the experience a certain durational quality inside the panoscope and the potential of active participation and contribution.
  • Collective Experience: The final point touches upon the collective experiences the system might allow. On the one hand collective experience occurs through the potential telepresence with other users. On the other hand experience surfaces through the contribution to the system and the creation of traces that can be encountered by others. What seems important here is the experience of a fully embodied state in the immersive environment of the panoscope. The embodied quality of experience allows us to embrace multiple (crossmodal) perceptive modes. On the one hand one can share experience through telepresence. On the other hand (which has been suggested by Erin Manning) one can also have the same collective experience with more than one person inside one panoscope. There is a difference in the shared expereince either through telepresence or through the physical sharing of the space in a panoscope. Interesting in that regard world be a blending of collective experience that not only includes human participants in actual physical or tele- presence but also the contribution to this experience by the flow of memories and contributions to the experience by an active and interactive (responsive) system. In that sense, to provide an initial idea, the collective individuations that might be facilitated through the system, could be generated through an internal resonance of the system with its users. To conclude with Simondon: “Internal resonance is the most primitive form of communication between realitities of different orders. It is composed of a double process of amplification and condensation.” Amplification here defines the process of an individuation (of a system for instance) as a resolution of anterior tensed states. Its condensation is the very presence as event that ties together all its anterior disparate realities and tendencies. A nexus with social character in Whitehead. The internal resonance of the user-panoscope individuation expresses its amplification and condensation through the emergent relation between different realities (of users, memories and the systems active contribution) and its condensation in an actual occasion (an event in all its complexity and singularity).

smaller panoscope for torso immersion


levels of nothingness - rafael lozano-hemmer

This is a short review on Lozano-Hemmer’s and Brian Massumi’s (in collaboration with Isabella Rossellini) work in progress “Levels of Nothingness” shown at the Guggenheim New York:

The Guggenheim’s Works in Progress series issuing its 25th anniversary this year, invited Lozano-Hemmer to present one of his works in progress. Levels of Nothingness is a synaesthetic performance of written, oral and visual dimensions. In collaboration with the actress Isabella Rossellini and the philosopher Brian Massumi Lozano-Hemmer and his team developed a voice-tracking system that responds to words in the form of lighting events. Attempting to create a relational model between the dimensions of thought in motion and audio-visual experiences the performance consisted of a 30 minute reading of philosophical quotes revolving around colour and perception clustered in conceptual blocks such as “emergence,” “singularity,” “body” or “transition.” Massumi’s philosophical influence in his work on colour and perception has been complemented by Rossellini’s beautiful voice and the “light dance” of more than 50 rock-and-roll concert lights.

The sensation that such an event generates is difficult to circumscribe in a classical manner such as light performance or interactive performance. What actually happened was a relational field of perception throughout the entire room. The perception of the visitor became amodal in its mode. In other words, one was immersed in light, a screen to read the quote that was aurally transmitted by Rossellini’s voice and enclosed in a slightly hazy room with the background noise of the lights moving and other bodies trying to capture the light at the ceiling. The human perception became amodal while the machine perception had its full attention focused on the voice and flow of words in their sonorities. The performance system for interaction became the perceiving entity as we (traditionally) expect the human sensory-motor system to work whereas the human perception was forced to reveal the amodality that perception is based on - synaesthesia as the point of entry for any perception to become noticeable and not as a strange abnormality of some particular individuals. Those who know the work of Massumi will realize that “Levels of Nothingness” might be one of the first attempts to make the synaesthetic amodality of perception apparent in a conscious and not only a pure experience. The collective modes of the event taking form cross many fields of expertise and experience that might be best described by the notion of mutual intensity for “a perception to come” - an intensive field of percepts offering themselves for experience to merge into presence without ever becoming immobile. On might regard the experiences generated in the event as an extensive continuum of collective intensive practices that has been extended for the first time to allow a wider audience to become part of the event. Thanks!

Hopefully, a longer interview with Rafael Lozano-Hemmer and Brian Massumi will be published in one of the following issues of Inflexions - A Journal for Research-Creation.