Publications

Journal – Guest Editor

Marcelo M. Wanderley and Joseph Malloch – (guest editors). Advances in the Design of Mapping for Computer Music. Computer Music Journal, 38(3), August 2015.

Peer Reviewed Journal Articles

Joseph Malloch, Stephen Sinclair, and Marcelo M. Wanderley. “Generalized Multi-Instance Control Mapping for Interactive Media Systems”. IEEE MultiMedia, 25(1), January–March 2018.

Joseph Malloch, Stephen Sinclair, and Marcelo M. Wanderley. “Distributed tools for interactive design of heterogeneous signal networks”. Multimedia Tools and Applications, 73(2),  February 2014.

Book Chapters

Joseph Malloch, Jérémie Garcia, Marcelo M. Wanderley, Wendy E. Mackay, Michel Beaudouin-Lafon and Stéphane Huot. “A Design Workbench for Interactive Music Systems”. In Simon Holland, Katie Wilkie, Tom Mudd, Andrew McPherson, and Marcelo M. Wanderley, eds. New Directions in Music and Human-Computer Interaction, Springer Verlag, upcoming (2019).

Joseph Malloch and Marcelo Wanderley. “Embodied Cognition and Digital Musical Instruments: Design and Performance”. In Micheline Lesaffre, Marc Leman and Pieter-Jan Maes, eds. The Routledge Companion to Embodied Music Interaction, Routledge, 2017, pp. 440–449.

David Birnbaum, Rebecca Fiebrink, Joseph Malloch, Marcelo M. Wanderley. “Towards a Dimension Space for Musical Devices”. In Alexander Refsum Jensenius and Michael Lyons, eds. A NIME Reader: Fifteen Years of new Interfaces for Musical Expression, Springer Verlag, 2017.

Joseph Malloch, Stephen Sinclair, Avrum Hollinger, and Marcelo M. Wanderley. “Input Devices and Music Interaction”. In Jorge Solis and Kia Ng (Eds.): Musical Robots and Interactive Multimodal Systems. Springer Tracts in Advanced Robotics, Vol. 74. Berlin: Springer-Verlag, 2011.

Theses

Joseph Malloch. “A Framework and Tools for Mapping of Digital Musical Instruments”, Ph.D. thesis, Music Technology, McGill University, Montréal. Thesis defended on November 4, 2013.

Joseph Malloch. “A Consort of Gestural Musical Controllers: Design, Construction, and Performance”. M.A. thesis, Music Technology, McGill University, Montréal. August 2007.

Peer Reviewed Articles in Revised Conference Proceedings

Mark T. Marshall, Joseph Malloch, and Marcelo M. Wanderley. “Gesture Control of Sound Spatialization for Live Musical Performance”. In M. S. Dias, S. Gibet, M. M. Wanderley, and R. Bastos (Eds.): Gesture-Based Human-Computer Interaction and Simulation, LNCS 5085. Berlin Heidelberg: Springer Verlag, pp. 227–238, 2009.

Joseph Malloch, Stephen Sinclair, and Marcelo M. Wanderley. “A network-based framework for collaborative development and performance of digital musical instruments”. In R. Kronland-Martinet, S. Ystad, and K. Jensen (Eds.): CMMR 2007, – Proc. of Computer Music Modeling and Retrieval 2007 Conference, LNCS 4969. Berlin Heidelberg: Springer-Verlag, pp. 401–425, 2008.

Peer Reviewed Articles in Conference Proceedings

Thiago Porcino, Seyed Adel Ghaeinian, Juliano Franz, Joseph Malloch and Derek Reilly. “Design of an Extended Reality Collaboration Architecture for Mixed Immersive and Multi-Surface Interaction”.
To appear in the 21st IFIP International Conference on Entertainment Computing (ICEC), Bremen, Germany, 2022.

Brady Boettcher, Joseph Malloch, Johnty Wang, and Marcelo M. Wanderley. “Mapper4Live: Using Control Structures to Embed Complex Mapping Tools into Music Production Environments”. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Auckland, New Zealand, 2022.

Filipe Calegario, Christian Frisson, Vincent Cusson, Eduardo Meneses, João Tragtenberg, Joseph Malloch, and Marcelo M. Wanderley. “Documentation and Replicability in the NIME Community”. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Shanghai, China, 2021.

Christian Frisson, Mathias Bredholt, Joseph Malloch and Marcelo M. Wanderley (2021), “MapLooper: Live-looping of Distributed Gesture-to-Sound Mappings”. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Shanghai, China, 2021.

Sathaporn Hu, Joseph Malloch and Derek Reilly. “A Comparative Evaluation of Techniques for Locating Out of View Targets in Virtual Reality” In Proceedings of the Graphics Interface 2021 Conference, Vancouver, Canada, 2021.

Abbey Singh, Ramanpreet Kaur, Peter Haltner, Matthew Peachey, Mar Gonzalez-Franco, Joseph Malloch and Derek Reilly. “Story CreatAR: a Toolkit for Spatially-Adaptive Augmented Reality Storytelling”. In Proceedings of the IEEE International Conference on Virtual Reality and 3D User Interfaces (IEEE VR), Lisbon, Portugal, 2021.

Derek Reilly, Shivam Mahajan, Abbey Singh, Jake Moore, Isaac Fresia, Matt Peachey and Joseph Malloch. “Using Space Syntax to Enable Walkable AR Experiences”. In Proceedings of the IEEE International Symposium on Mixed and Augmented reality Adjunct (ISMAR-Adjunct), IEEE, Ipojuca, Brazil, 2020.

Juliano Franz, Joseph Malloch and Derek Reilly. “Compensating for Perspective-based Distortion on Large Interactive Floor Displays: the SpaceHopper Field Experiment”. In Proceedings of the ACM International Conference on Interactive Media Experiences (IMX 2020), ACM, Barcelona, Spain, 2020.

Juliano Franz, Mohammed Alnusayri, Joseph Malloch and Derek Reilly. “A Comparative Evaluation of Techniques for Sharing AR Experiences in Museums”. In Proceedings of the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). Austin, USA, 2019.

Johnty Wang, Joseph Malloch, Stephen Sinclair, Jonathan Wilansky, Aaron Krajeski and Marcelo M. Wanderley. “Webmapper: A Tool for Visualizing and Manipulating Mappings in Digital Musical Instruments”. In Proceedings of the 14th International Conference on Computer Music Multidisciplinary Research (CMMR). Paris, France, 2019.

Joseph Malloch, Marlon Schumacher, Stephen Sinclair and Marcelo M. Wanderley. “The Digital Orchestra Toolbox for Max”. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Blacksburg, USA, 2018.

Alex Nieva, Johnty Wang, Joseph Malloch and Marcelo M. Wanderley. “Tackling Obsolescence in Digital Musical Instruments – A Case Study: Twelve Years of the T-Stick”. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Blacksburg, USA, 2018.

Johnty Wang, Joseph Malloch, Stéphane Huot, Fanny Chevalier and Marcelo M. Wanderley. “Versioning and Annotation Support for Collaborative Mapping Design.” In Proceedings of the 14th Sound and Music Computing Conference (SMC), Espoo, Finland, 2017.

Joseph Malloch, Carla Griggio, Joanna McGrenere and Wendy E. Mackay. “Fieldward and Pathward: Dynamic Guides for Defining your own Gestures.” In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2017), Denver, USA, 2017.

Nabil Bin Hannan, Khalid Tearo, Joseph Malloch and Derek Reilly. “Once More, with Feeling: Expressing Emotional Intensity in Touchscreen Gestures.” In Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI 2017), Limassol, Cyprus, 2017.

Jessalyn Alvina, Joseph Malloch and Wendy E. Mackay. “Expressive Keyboards: Enriching Gesture-Typing on Mobile Devices.” In UIST ’16: Proceedings of the ACM Symposium on User Interface Software and Technology, Tokyo, Japan, 2016.

Jeronimo Costa, Joseph Malloch, Marcelo M. Wanderley and Stéphane Huot. “What does ‘Evaluation’ mean for the NIME Community?” In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME2015), Baton Rouge, USA, 2015.

Ian Hattwick, Joseph Malloch, and Marcelo M. Wanderley. Forming Shapes to Bodies: Design for Manufacturing in the Prosthetic Instruments”. In Proceedings of the 2014 International Conference on New Interfaces for Musical Expression (NIME2014), pp. 443–448, London, UK, 2014.

Marije A. J. Baalman, Vincent De Belleval, Joseph Malloch, Joseph Thibodeau, Christopher Salter and Marcelo M. Wanderley. “Sense/Stage – Low Cost, Open Source Wireless Sensor Infrastructure For Live Performance And Interactive, Real-Time Environments”. In Proceedings of the International Computer Music Conference (ICMC), pp. 242–249, New York, USA, 2010.

Xenia Pestova, Erika Donald, Heather Hindman, Joseph Malloch, Mark T. Marshall, Fernando Rocha, Stephen Sinclair, D. Andrew Stewart, Marcelo M. Wanderley, and Sean Ferguson. “The CIRMMT/McGill Digital Orchestra Project”. In Proceedings of the International Computer Music Conference (ICMC09), pp. 295–298, Montreal, Qc., Canada, 2009.

Fernando Rocha, and Joseph Malloch. “The Hyper-Kalimba: Developing and Augmented Instrument from a Performer’s Perspective”. In Proceedings of the 6th Sound and Music Computing Conference, Porto, Portugal, pp. 25–29, 2009.

Otso Lähdeoja, Marcelo M. Wanderley, and Joseph Malloch. “Instrument Augmentation using Ancillary Gestures for Subtle Sonic Effects”. In Proceedings of the 6th Sound and Music Computing Conference, Porto, Portugal, pp. 327–330, 2009.

Marije A. J. Baalman, Harry C. Smoak, Christopher L. Salter, Joseph Malloch, and Marcelo M. Wanderley. “Sharing Data in Collaborative, Interactive Performances: the SenseWorld DataNetwork”. In Proceedings of the 2009 International Conference on New Interfaces for Musical Expression (NIME09), pp. 131–134, Pittsburgh, USA, 2009.

Georgios Marentakis, Joseph Malloch, Nils Peters, Mark T. Marshall, Marcelo M. Wanderley, and Stephen McAdams. “Influence of performance gestures on the identification of spatial sound trajectories in a concert hall”. In Proceedings of the The 14th International Conference on Auditory Display (ICAD 08), Paris, France, 2008.

Alexander R. Jensenius, Nicolas Castagné, Antonio Camurri, Esteban Maestre, Joseph Malloch, and Douglas McGilvray. “A summary of formats for streaming and storing music-related movement and gesture data”. In Proceedings of the 4th International Conference on Enactive Interfaces, Grenoble, France, pp. 125–128, 2007.

Mark T. Marshall, Joseph Malloch, and Marcelo M. Wanderley. “Non-conscious control of sound spatialization”. In Proceedings of the 4th International Conference on Enactive Interfaces, Grenoble, France, pp. 377–380, 2007.

Joseph Malloch, Stephen Sinclair, and Marcelo M. Wanderley. “From controller to sound: Tools for collaborative development of digital musical instruments”. In Proceedings of the 2007 International Computer Music Conference, Copenhagen, Denmark, pp. 65–72, 2007.

Alexander R. Jensenius, Antonio Camurri, Nicolas Castagné, Esteban Maestre, Joseph Malloch, Douglas McGilvray, Diemo Schwarz and Matthew Wright. “Panel: the Need of Formats for Streaming and Storing Music-Related Movement and Gesture Data”. In Proceedings of the 2007 International Computer Music Conference, Copenhagen, Denmark, pp. 13–16, 2007.

Joseph Malloch, and Marcelo M. Wanderley. “The T-Stick: From Musical Interface to Musical Instrument”. In Proceedings of the 2007 International Conference on New interfaces for Musical Expression (NIME07), New York, USA, pp. 66–69, 2007.

Marcelo M. Wanderley, David Birnbaum, Joseph Malloch, Eliot Sinyor, and Julien Boissinot. “SensorWiki.org: A Collaborative Resource for Researchers and Interface Designers”. In Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06), Paris, France, pp. 180–183, 2006.

Denis Lebel, and Joseph Malloch. “The G-Spring Controller”. In Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME06), Paris, France, pp. 85–88, 2006.

Joseph Malloch, David Birnbaum, Eliot Sinyor, and Marcelo M. Wanderley. “Towards a new conceptual framework for digital musical instruments”. In Proceedings of the 9th International Conference on Digital Audio Effects (DAFx-06), Montreal, Canada, pp. 49–52, 2006.

David Birnbaum, Rebecca Fiebrink, Joseph Malloch, and Marcelo M. Wanderley. “Towards a Dimension Space for Musical Devices”. In Proceedings of the 2005 International Conference on New Interfaces for Musical Expression (NIME05), Vancouver, Canada, pp. 192–195, 2005.

Extended Abstracts in Conference Proceedings

Juliano Franz, Mohammed Alnusayri, Joseph Malloch and Derek Reilly. “AR in the Gallery: The Psychogeographer’s Table.” In Proceedings of the ACM SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2019), Glasgow, UK, 2019.

Juliano Franz, Joseph Malloch, Vinicius Sanches and Derek Reilly. “SpaceHopper: Bounce Your Way to Galactic Domination.” In Proceedings of the ACM SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2018), Montreal, Canada, 2018.

Juliano Franz, Joseph Malloch, and Derek Reilly. “Exploring Shared Immersive Visualization in AR.” In Extended Abstracts of VIS 2017, Phoenix, AZ, USA, 2017.

Simon Holland, Andrew McPherson, Wendy MacKay, Marcelo Wanderley, Michael Gurevich, Tom Mudd, Sile O’Modhrain, Katie Wilkie, Joseph Malloch, Jérémie Garcia, Andrew Johnston. “Music and HCI Workshop.” In Proceedings of the ACM SIGCHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2016), San Jose, USA, 2016.

Joseph Malloch, Stephen Sinclair, and Marcelo M. Wanderley. “Libmapper (A Library for Connecting Things)”. In Proceedings of the International Conference on Human Factors in Computing Systems (CHI EA 2013), Paris, France, pp. 3087–3090, 2013.

D. Andrew Stewart, and Joseph Malloch. “Everybody to the power of one, for soprano T-Stick”. In Proceedings of the International Conference on Human Factors in Computing Systems (CHI EA 2010). ACM, New York, NY, USA, 3093–3096, 2010.

Position Papers

Joseph Malloch. “Toward Rich, Continuous Representation and Interaction.” Workshop on Rethinking Interaction, ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2018), Montréal, Canada, 2018.

Marcelo Wanderley, Stéphane Huot, Joseph Malloch, Jérémie Garcia, Wendy Mackay and Michel Beaudouin-Lafon. “Human Computer Interaction meets Computer Music – The MIDWAY Project.” Workshop on Music and HCI, ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2017), San Jose, USA, 2016.

Abstracts in Conference Proceedings

Joseph Malloch and Marcelo M. Wanderley. “Conceptualization of Digital Musical Instruments”. Presented at The Ghost in the Machine: Technologies, Performance, Publics, Montreal, Canada, 2011.

D. Andrew Stewart and Joseph Malloch. “Concurrence and Counteraction in Musical Gesture and Form”. Presented at the 3rd International Conference on Music and Gesture, Montreal, Canada, 2010.

Mark T. Marshall, Joseph Malloch and Marcelo M. Wanderley. “Gesture Control of Sound Spatialization”. Presented at the 2007 International Gesture Workshop, Lisbon, Portugal, 2007.

Unpublished Technical Reports

Joseph Malloch and Stéphane Huot. “Bridging Configuration Tools for Interactive Systems: ‘Input Configurator’ (ICon) and libmapper”. Technical Report, Digipods Project, Université Paris-Sud & CNRS (LRI), Inria, 2014.

Ian Hattwick, Joseph Malloch and Marcelo M. Wanderley. “Use of 3D Printed Components in the Creation of the Prosthetic Instruments”. Technical Report, Input Devices and Music Interactions Laboratory, McGill University, 2013.

Stephen Sinclair, Joseph Malloch and Sofian Audrey. “e[merge] work report”. Technical Report, Input Devices and Music Interaction Laboratory, McGill University, 2012.

Joseph Malloch. “Building a Soprano T-Stick”. Technical Report, Input Devices and Music Interaction Laboratory, McGill University, 2010.

Joseph Malloch. “Strategies for improving the versatility and flexibility of the T-Stick digital musical instrument”. Technical Report, Input Devices and Music Interaction Lab, McGill University, 2009.

Joseph Malloch. “Approaches for evaluation of digital musical instrument mapping”. Technical Report, Input Devices and Music Interaction Lab, McGill University, 2009.

Joseph Malloch. “Comparison of tools for mapping digital musical instruments”. Technical Report, Input Devices and Music Interaction Lab, McGill University, 2009.

Joseph Malloch. “Comparison of stick-like gestural controllers”. Technical Report, Input Devices and Music Interaction Lab, McGill University, 2009.

Joseph Malloch. “Mapping and routing OSC messages in the IDMIL”. Technical Report, Music Technology Area, McGill University, 2007.

Joseph Malloch. “Adding Vibrotactile Feedback to the T-Stick Digital Musical Instrument”. Technical Report, Music Technology Area, McGill University, 2007.

Joseph Malloch. “The T-Stick Gestural Controller”. Technical Report, Music Technology Area, McGill University, 2006.

Joseph Malloch, “Beat and Tempo Induction for Musical Performance”.  Technical Report, Music Technology Area, McGill University, 2005.

Joseph Malloch, “The Celloboard – A Physical Interface for Music-Making”. Technical Report, Music Technology Area, McGill University, 2004.

Video Tutorials and Documentation

Joseph Malloch. “Using multiple inertial measurement units (IMUs) for tracking orientation and deformation”. Video documentation, Input Devices and Music Interaction Laboratory, McGill University, 2012.

Joseph Malloch. “Implicit mapping with libmapper and MnM”. Video tutorial, Input Devices and Music Interaction Laboratory, McGill University, 2012.

Joseph Malloch. “DOT mapper + Jamoma”. Video tutorial, Input Devices and Music Interaction Laboratory, McGill University, 2009.

Joseph Malloch and Anthony Piciacchia. “Mapping musical instruments using the Digital Orchestra Tools”. Video tutorial, Input Devices and Music Interaction Laboratory, McGill University, 2009.

Curated Museum and Gallery Exhibits

Juliano Franz, Joseph Malloch, Brian Lilley, Bob Bean, and Derek Reilly. “The Psychogeographer’s Table”. Maritime Museum of the Atlantic, Halifax, Canada, 2018.

Juliano Franz, Bjorn Huntemann, Charles Hu, Joseph Malloch, Brian Lilley, Bob Bean, and Derek Reilly. “Beyond the Debris Field”. Dalhousie Art Gallery, Halifax, Canada, 2017.

Mickaël Chouquet, Balthazar Daninos, Léo Larroche, Jean Pierre Larroche, Wendy MacKay, Michel Beaudouin-Lafon, Dimitri Belopopsky, Stacy Hsueh, Joseph Malloch, Andrew Webb. “La Grande Vitrine de Noël”. Théâtre de l’Agora, Évry, France, 2016.