Prototyping a New Audio-Visual Instrument Based on Extraction of High-Level Features on Full-Body Motion

Skeletal data acquisition generates a huge amount of high- dimensionality data. In many fields where motion capture techniques are now used, practitioners would greatly benefit from high-level representations of these motion sequences. However meaningful motion data dimensionality reduction is not a trivial task and the selection of the best set of features will largely depend on the considered use case, hence enhancing the need for a fast customization and prototyping tool. In this work, we present a prototyping tool for motion representation and in- teraction design based on the MotionMachine framework, as well as use cases of new audiovisual instruments that use full-body motion to drive sound and visuals. These instruments have been developed using the proposed prototyping environment. The development of these instruments is a proof of concept and demonstrates the potential of an elaborate choice of higher-level feature extraction techniques in improving the human/computer interaction and leading to more expressive experiences.