Project: E[MERGE]: Software tools for organization, analysis and modeling of real time sensor data for dynamic media composition in interactive environments.
Collaborators: Input Devices and Music Interaction Laboratory, McGill University, labXmodal, Concordia University, Moment Factory, gsmprjct°
From the project proposal:
The E[MERGE] project focuses on the creation of software tools for developers of interactive media to analyse and model data from large sensor networks in real-time. These tools will facilitate the creation of interactive media experiences which exhibit nuanced evolution over time. The central research question of the project is how temporal patterns can be extracted from a large number of sensor data streams and linked to the control of lighting, video, sound, and other media to produce emergent behaviours beyond those strictly conceived by the designer. The results envisioned for the project include software tools which can be used to aid rapid creation and production of interactive environments for businesses, restaurants, hotels, and entertainment.
- Adding support for multi-instance signals to libmapper (Joseph Malloch)
- Development of the agent-based machine-learning library Qualia
- Development of a low-bandwidth orientation-independent representation of 3D movement (Joseph Malloch, Stephen Sinclair)
- PCA dimensionality-reduction of movement data on mobile phones (Stephen Sinclair)
- Development of the Influence environment for interaction between distributed software agents.