Code & Repräsentation II

Stefano D'Alessio
Institute of Fine Arts and Media Art, Digital Arts
2023S, artistic Seminar (SEK), 2.0 ECTS, 2.0 semester hours, course number S03699



The seminar is practical and will focus on building interactive interfaces using machine learning (ML), to control virtual environments.

We will use MAX ( and ML to get data from people in space (Pose, face, hand tracking) and we will use more ML (multi-layer perceptron) to control different behaviours of multiple objects in virtual environments, using Unity ( We will use different body postures to change the look of a virtual space, influencing object positions, colours, light intensities or else.
We will also see how to quickly create sounds with ML algorithms and control them with body poses and movements.

Participants will get a small library of modules, created ad hoc for the seminar, in order to spend less time programming and more time experimenting.

Students can register on the BASE

Participants will be given access to the cloud folder of the seminar (URL via email), where they will be able to download all materials and media about the course.

Examination Modalities

Attendance and exercises


Bring your laptop, be sure to have space in your drive to install sofware.

Key Words

real time, machine learning, A.I., MaxMsp, Unity, Digital art, new Media, reactive, responsive, 3D, Space, VR, Virtual, interactive art


27 April 2023, 10:00–13:00 ZOOM
11 May 2023, 10:00–13:00 Digital Art, Lecture Room
25 May 2023, 10:00–13:00 Digital Art, Lecture Room
27 May 2023, 12:00–17:00 Digital Art, Lecture Room
01 June 2023, 10:00–13:00 Digital Art, Lecture Room
15 June 2023, 10:00–13:00 Digital Art, Lecture Room
22 June 2023, 10:00–13:00 Digital Art, Lecture Room

Course Enrolment

From 13 February 2023, 11:14 to 11 May 2023, 23:00
Via online registration

TransArts - Transdisciplinary Arts (Bachelor): Artistic and art technology foundations: Artistic and art technology foundations 180/002.01

Media Arts: Specialisation in Digital Arts (2. Section): Künstlerische Methodik und Technologie digitaler Kunst: Code & Repräsentation I - V 567/202.07

Cross-Disciplinary Strategies (Bachelor): Science and Technology: Deepening / Application 700/002.20

Co-registration: not possible

Attending individual courses: not possible