Medienkonvergenz und -hybridisierung I

Stefano D'Alessio
Fine Arts and Media Art, Digital Arts
2019S, Seminar (SE), 1.0 semester hours, course number S02658


The course will first introduce the most effective practices of real-time body interaction based on computer vision, like movement detection and position tracking. This interaction will be used to influence or generate realtime audio-visual content. Later we will then explore more articulate modalities of interactions based on skeleton tracking, pose detection and hand gesture recognition. Hardware-wise we will use standard cameras/webcams/phone-cams, kinect sensors and leap motion sensors, software-wise we’ll use MAX ( and Wekinator ( an accessible Machine Learning software to help us map complex data to desired output parameters. As output we will generate and control sounds in real-time within MAX and communicate with Unity ( for the visuals.


If you own and are interested in using kinect sensors and/or leapmotion and/or cameras/webcams please bring them

Key Words

kinect, leapmotion, posenet, wekinator, max8, interactive art


01 April 2019, 10:00–17:00 Digital Art, Lecture Room , "we start in the dome space of digitale kunst"
06 May 2019, 12:00–14:30 Digital Art, Lecture Room
13 May 2019, 10:00–14:30 Digital Art, Lecture Room
17 June 2019, 10:00–14:30 Digital Art, Lecture Room

co-registration: possible (2.0 ECTS)

TransArts - Transdisciplinary Arts (Bachelor): Artistic and art technology foundations (2.0 ECTS)

Media Arts: Specialisation in Digital Arts (2. Section): Medienkonvergenz und -hybridisierung I - IV (1.0 ECTS)

Individual courses: possible (2.0 ECTS)