Lydia Krifka-Dobes

Lydia

Lydia Krifka-Dobes is a researcher, sound artist and computer musician who actively investigates the alternative creativity of computational intelligence in sound. Through autonomous musical systems that interact and improvise with human collaborators in multichannel contexts, she explores how human and machine perceptions diverge, shaping distinct artistic interpretations and decisions. Her ongoing research is taking place in Sound & Music Computation at Music Technology Group Barcelona where she works on Systems & Multimedia architect with C++ / Vulkan / DSP / Concurrency.

Her current artistic interests are centered around computer music and noise, through algorithmic composition, live coding, and sound installation, exploring musicality in noise within the concepts of music, information, and systems.

Education

Universitat Pompeu Fabra (UPF), Barcelona, Spain

M.Eng. Sound and Music Computing | 2025–2026

Music Technology Group with Prof. Xavier Serra

Coursework:

  • Music Generation with Neural Networks
  • Machine Learning for Audio
  • Music Information Retrieval

Institute of Sonology, The Hague, Netherlands

B.Mus., Sonology (Computer Music) | 2020-2025

Key Courses:

  • Signal Processing - Analysis & Resynthesis, Physical Modeling, Convolution, Transformation algorithms
  • Musical Controllers - Analog electronics, controller & interface design, sensor data extraction and manipulation
  • Sound and Space - WaveField Synthesis, cultural and philosophical theories of space

Research: Interdisciplinary contextualization of electronic music: Study of interactive media improvisation, developing C++ libraries for gesture tracking and synthesis algorithms

Bachelor's Thesis: Wandering the Sounds of Languages (2025)

Conservatory Olomouc, Olomouc, Czechia

B.A. (Honours) Music and Sound | 2014–2017

Sound Spatialization Research (thesis), Sound Engineering, Studio techniques, Mixing & Mastering, Composition for moving image, Library music, Gregorian Chant, Violin performance

Experience

La Biennale di Venezia Musica, Selected Artist

Venice, Italy | 2023

Wandering the Piano: 16-channel ambisonic installation

  • Exploring piano mechanics through 64 infrared sensors and K-means clustering of 10,000 piano samples
  • Premiered under curator Lucia Ronchetti
  • Supervision: Miller Puckette, Gerfried Stocker (Ars Electronica)

Leibniz-Centre General Linguistics, Berlin, Germany

Research Intern with Prof. Dr. Marzena Żygis | 2023–2025

  • Contributed to ATTIT project on implicit and explicit attitudes toward foreign language accents in German-Polish contexts
  • Analyzed whispered speech acoustics and facial expressions using spectral analysis
  • Developed multi-threaded real-time processing pipeline using C++ and OpenCV for facial movement analysis

Max Planck Institute for Human Development, Berlin, Germany

Research Assistant with Prof. Dr. Gerd Gigerenzer | 2018

  • Built sonification and data visualization pipelines for risk education for the public
  • Developed statistical analysis tools using openFrameworks for interactive data exploration of false positives
  • Edited campaign project for high school statistics education

Vertigo Games, Rotterdam, Netherlands

Audio Intern | 2024

  • Hands-on experience with VR, collision SFX, locomotion SFX
  • Audio implementation using Unreal Engine

Ableton, Berlin, Germany

Marketing Intern | 2018

  • Created interactive audiovisual media content for marketing and outreach team
  • Using Blender and layering of short microsounds from recording sessions with DJs

Programming & Technical Work

Gesture Tracking Library

  • Writing libraries in C++ to recognize and manipulate artistic gestures
  • Working with gesture controllers such as Kinect, LeapMotion and Sketch tablet
  • Used Kernel convolution (OpenCV) to detect edges, corners, defined features and optical flow
  • Algorithms to translate data into different domains (sound to animation)

Audio Analysis

  • Detect audio features: Frequency centroids, busyness, silences
  • Spectral components: formants, melodic spectrum, Vowel extraction and Fourier resynthesis
  • Merging features from different audio files into one
  • Wave shaping using custom dynamic-stochastic-synthesis

Open Source Contributions

  • PRs to Neovim plugins
  • PRs to Tree Sitter
  • Bug tracking in AURs
  • PD Externals
  • OpenFrameworks addons for working with Threaded Features

Teaching & Workshops

Curiosity Club Barcelona, Spain

Workshop, Sound & Space Workshop Series | 2025

  • Intensive spatial audio training including acousmatrix, soundspace theory, microphone techniques
  • My experience working with analog synthesizers, extended range violin, electroacoustic ensembles

Jugend Hackt, Berlin, Germany

Youth Technology Mentor | 2018–present

  • Mentoring young technologists (ages 12-18) in creative coding, electronics, sound design
  • Workshop topics: Arduino, live coding, real-time video AI, generative art
  • Organized a generative art hackathon: first underground youth hackathon in Berlin with 365 signups, 80 mentorship submissions
  • Led Real-time Video AI/AR Workshop: monthly workshops on Generative AI live streaming platform
  • Mentored Twinthesizer workshop: real-time tweet sentiment sonification

Deutsche Oper Berlin, Berlin, Germany

Workshop Supervisor, Common Sound Minifestival | 2019

  • Micro-festival for 15+ young artists; Production Assistant
  • Helped curate 1-week residency exploring transcultural performance and hybrid opera forms
  • Parametric Point Cloud Modeling with LeapMotion for performance

Private Teaching, Various Locations

Music Educator | 2011–present

  • Teaching improvisation to preschool and primary school students (2014–2017)
  • Private violin instruction (2011–present)

Selected Artist & Awards

Audio Developer Conference Diversity Scholarship, Bristol, UK | 2025

La Biennale di Venezia Musica, Selected Artist
Venice, Italy | 2023
Selected as youngest artist of the festival (Biennale Musica sector). Awarded artistic residency to produce installation Wandering the Piano, which premiered under curator Lucia Ronchetti with supervision by Miller Puckette and Gerfried Stocker (Ars Electronica)

Excellence Scholarship (€15,000), The Hague, NL | 2022

First Prize, German National Composition Competition, Berlin, DE | 2021

First Prize, Bundeswettbewerb Jugend Komponiert, Schloss Weikersheim, DE

Scholarship, School for Poetic Computation (Workshop: CW&T), NYC/online | 2019

MIT Media Lab's Hackathon Arts Participant, Cambridge, MA | 2019

First Prize, Jugend Hackt Hackathon, Berlin, DE | 2018

Regional Winner, Jugend forscht Research Competition, Berlin, DE | 2018

WWDC Scholarship Recipient, Cupertino, CA | 2016

Volunteer Work

Conference on the Future of Europe
Citizen Panelist | Strasbourg, Florence, Brussels | 2021–2022
Participated in EU-wide debates on climate policy; successfully proposed law changes including taxing negative externalities of agricultural activity (proposal 30.2)

World Servants
Volunteer | Malawi, Germany, Netherlands | 2017–2018
Orchestrated benefit dinners and fundraising initiatives raising €150,000 collectively for primary school infrastructure in Makonje, Malawi

Selected ArtScience Projects

WANDERING THE PIANO

La Biennale di Venezia Musica (IT)
Sound installation / Multichannel spatial performance (16-channel) | 2023

In 2023 (JAN-OCT), I was selected as the youngest artist of the festival (Biennale Musica sector). Along with nine other composers, performers, and musicians, I was awarded an artistic residency to produce my installation Wandering the Piano, which premiered at the Biennale Musica di Venezia 2023 under the curation of Lucia Ronchetti and under supervision of Prof. Dr. Miller Smith Puckette, Prof. Dr Gerfried Stocker (Ars Electronica), and Ali Nikrang (Ars Electronica, Future Lab).

The installation explored the spatial and mechanical memory of the piano through fragmented motifs, prepared strings, and resonant responses to movement, creating a dialogue between performer and instrument.

There are (2) main components of this installation:

  • Creation and curation of a large dataset of >10,000 sound files
  • Creation of 8 spatial maps (soundscapes) with 64 sounds each

YouTube: Amateur film:
https://www.youtube.com/watch?v=dts4YQDgXVw

La Biennale Website:
https://www.labiennale.org/en/music/2023/music-performances/lydia-krifka-dobes-wandering-piano

Version 1 Code:
https://drive.google.com/file/d/1ZiyisKzEQCcyZq-QzN87tD2KZLJCkB4w/view?usp=sharing

01001100.mov (DE)

Composition for choreography (Extended-range violin + dance) | 12′15 | 2022–2023

In 2022 & 2023 I collaborated with contemporary dancer and choreographer Adithi. The work focuses on exploring everyday gestures, both the extent and the emotions evoked by them. Music for the piece is parallel in places to the dance and accompanying in certain places. Music for this piece is composed on extended range violin, freeze pedal and convolution. Constantly varying tempos, artificial harmonics overlapped by microtones, unsync counterpoint, and multi-phonics are some of the concepts used for sound. Dance explores gestures not just as artistic elements but to query the cultural space and its practices.

Watch:
https://drive.google.com/file/d/1x_MiH9oyBDrd1CgKFSBVRZ6jyVJOHbrN/view?usp=sharing

WANDERING THE SOUNDS OF LANGUAGES (NL)

Interactive sound/language installation + Website interface / research concert | 17′00 (looped installation) | 2025

There are two main components to this research: (1) Curation and analysis of recordings of Aesop's fable in 22 highly diverse languages and (2) Collective retelling of the story for an installation or a website on utterance level.

Drawing from my experience with different languages, from growing up trilingual to encountering the languages of Vanuatu, I explore ways to appreciate the variety of spoken languages in their acoustic realization. I work with recordings of the same text, a fable by Aesop, which appeals to many cultures and carries great significance in the face of language endangerment.

A concert-research presentation expanding on my thesis project, combining field recordings of Aesop's Fable across 22 languages with live phonetic sonification. Audience members interacted with an interface displaying parallel speech gestures as spatial sound fields.

Presentation at Sonology for documentation:
https://drive.google.com/file/d/1fa5kiLGAkGCzdIe28EKIosv3bViizRPG/view?usp=sharing

Bachelors language research - Sounds of Languages Thesis (2025, Institute of Sonology):
https://drive.google.com/drive/folders/1joZ3wgK0aZhOOPxlf1VOXy2Jzwor2NzW?usp=sharing

GAME OF LIFE :: QUICKSEND (NL)

192-channel (Wave Field Synthesis System) live coding | 2023

Quicksend is a live-coded performance presented in the Wave Field Synthesis (WFS) system by Game of Life Foundation. The system consists of 192 loudspeakers to create an immersive virtual acoustic environment. Quicksend utilises an audio feedback algorithm in search of the border between noise and tone.

GAME OF LIFE :: ZUNGENTANZ (NL)

192-channel (Wave Field Synthesis System) fixed media | 6′ | 2025

Showcased at the Game of Life Festival as part of the Institute of Sonology's featured presentations. Zungentanz (6′): The three main components of this Fixed Media piece: Spatial mapping of vowel positions to physical coordinates using Wave Field Synthesis, extending micro-choreographies of speech articulation and the mechanics of resonant acoustic memory within the oral cavity.

The idea of this project is to virtually place the listener inside the oral cavity of a speaker to appreciate the complexity of movement while we speak. In particular, I observe the vowels in the so-called vowel quadrant that identifies the position of the tongue (e.g. i: high, front, u: high, back, a: low, central) and map them to virtual points in space using Wave Field Analysis.

Game of Life Festival:
https://www.koncon.nl/en/events/wave-field-synthesis-festival-2

DOOM SCROLLING

AI-driven performance exploring algorithmic identity through real-time Instagram Reels sampling | 2023

UNERHÖRT UNDERGROUND PERFORMANCE

Cellular automata-based autonomous musical system with Butoh dancers | 2025

MOTHER TONGUES

Generative visualization of language extinction through genetic algorithms | 2023

CONTOUR & FEATURE TRACKER

Real-time computer vision code for performance (openFrameworks / C++) | Ongoing | 2024+

This is a reference implementation of my ongoing work with openCV API. Once complete it will be released both as a standalone library and openFrameworks add-on. I am using the contour-finder algorithm (using kernel convolution techniques such as Sobel + Canny edge-detection, etc.) to recognize contours from a moving image. Using Shi-Tomasi Algorithm to define and extract features that can be selectively synthesized to form newer shapes or animated to form distortions within the contours. All processing is done parallelly using POCO thread library.

The library has enhanced corner detection algorithms, expanded by me, that will directly contribute to my research at Long Meadow Art Residency. It will help understand the relationship between a movement artist and latent inanimate objects in the space.

Link:
https://drive.google.com/file/d/1q4zcMNuZxJoQuw66Dk-iLk3RGtpPGJFw

DYNAMIC STOCHASTIC SYNTHESIS

Algorithmic composition code / C++ sound engine | 2022

This library reimplements Xenakis and Sergio Luque's dynamic stochastic synthesis algorithm in C++ using openFrameworks. Combined with my formants-detection tool, this system recognizes vowels and extends them algorithmically, creating a method for exploring phonetic diversity through computational means. The project will be used in my upcoming exhibition at the Humboldt-Forum, demonstrating the practical application of my research in linguistic sonification.

PATTERNS FOR C++

Threaded pattern synthesis library (C++) | Continuous development | 2024

I have been writing multi-threaded classes for C++ to mimic Patterns UGens from SuperCollider. As of now, calling (threaded) libraries with either user-defined functions/lambdas for patterns or using any of the member pattern functions have been implemented.

Threaded patterns:
https://drive.google.com/file/d/1E2ptHYe2DnNCncTwB-Xw2yHH-KCmNpXz

TRACKING COLLECTION

Gesture-tracking research code (C++, Kinect / POCO Threads) | 2023

Below is a list of C++ projects (eventually turned into classes) I am writing as part of my gesture-tracking library for my Second year sonology project at the Institute of Sonology. One of the libraries shows how I create new parametric relationships from Kinect data (example: The rotation of the knee with the speed of hand movement to form a single vector). Another library shows using derivatives and statistical information from mouse movement to form new animations on screen. It also has a first draft of a granular synthesis (credit Aaron Anderson) to be used in my upcoming performance with a dancer at the WaveField Synthesis festival. This is the primary basis library for the gesture recognition phase of the work.

Gesture derivatives:
https://drive.google.com/file/d/12MRekXJbVFOT4LYniq2w0cPhMErhMKm1

REALTIME PROCESSING SHOWCASE (NL)

Multichannel audiovisual improvisation (24-channel audio + real-time processing sensor data) | The Hague, NL | 2023

Experimental presentation exploring the relationship between motion, data, and sound in multi-channel setups using the PinePhone Pro (Linux open source bio Phone). The showcase featured algorithmically triggered visual and sonic elements derived from dancer gesture capture using in-house gesture tracking libraries. The whole sound palette was produced from simple granular synthesis of a sine wave and 1 sample only, where the main transformations are: (1) A sequenced Ring Modulator (2) an FFT freezer, (3) a FFT bin shifter, and (4) a buffer scanner.

Listen:
https://drive.google.com/file/d/12MRekXJbVFOT4LYniq2w0cPhMErhMKm1

WORKING WITH ANALOG SYNTH (DE)

Analog modular synthesis + violin improvisation | 2019

My first introduction to synthesizers was through the Berlin DIY community who assembled a comprehensive Eurorack synthesizer setup in Berlin. We started experimenting in 2017 with improvised performance sessions in various underground DIY festivals, culminating with a composition based on "Gagaku" japanese tradition. This piece concentrates on aspects of Gagaku such as its timbral and spectral richness, its openness in rhythm, its minimalism, and chiefly the different tuning systems.

Listen:
https://soundcloud.com/grunfeld/impressions-of-gagaku-1

DEUTSCHE OPER – COMMON SOUND (DE)

Micro-festival curation / live intermedia performance | Residency 4 weeks | Berlin, DE | 2019

Co-Curation of Micro-festival curated and co-produced as part of Common Sound at the Tischlerei, Deutsche Oper Berlin. The laboratory brought together young artists, composers, and performers from diverse backgrounds to experiment across sound, gesture, and stage media, culminating in a series of curated interdisciplinary performances with public workshops.

Link:
https://www.youtube.com/watch?v=lfs_h92yqp0

TRXXXTER – HARMONICA CONCERTO (DE)

DJ set / radio broadcast with live sampling | 42′15 | Berlin, DE | 2025

DJ-set installation and live radio project fusing generative sampling with manipulated harmonica recordings. The performance transformed field textures into cyclical layers through granular processing, creating a hybrid between DJ practice, sound collage, and live coding. Broadcast as part of the Trxxxter Radio Performance Series.

HISTORY SAMPLING USING SHADERS

GPU shader image sampler / Interactive visual system | 2024

This library collects texture samples either from input video or a collection of images. In this implementation, it uses the distance between mouse position and pixel in shaders to sample different textures coordinated from the supplied Deque of history to interpolate and form new display images. In its next iteration, it will use gestures from LeapMotion instead of mouse positions.

Documentation:
https://drive.google.com/file/d/1FlVGGDN7CJEbVuAKrvC_UC0MTw05ZC9L/view?usp=sharing

OUTFLUX (NL)

Live trio (FFT cross synthesis + violin + phone apps) | 2019

A live improvisation trio featured me on violin and electronics, Tristan Beutter on smartphone apps and FFT cross synthesis via Max/MSP and Wacom tablet. The central concept behind the trio is the conceptual and literal exchange of ideas. Sound output from each member is sent to every other member in order to be processed or tweaked live.

Listen adblock module:
https://soundcloud.com/grunfeld/adblock-module/s-d45w5

BERLIN ERRORISTS (DE)

Electroacoustic improvisation / Hybrid analog-digital ensemble | 2022

An improvisers collective was formed by me in Berlin to create a mix of traditional instruments, everyday objects with contact mics, one analog synthesizer (Eurorack), some programming languages, and manipulated playback of field recordings. The live improvisation consisted of acoustic violin, PureData, vibrating plates, bowed clothes string, a Eurorack synth, and clarinet. The final performance consisted of manipulation of field recordings and samples from the field recording as an impulse response for violin convolution.

Listen:
https://drive.google.com/file/d/1Uxy_Kuni0GCXwKlaoPpm9RE0PZNkH5YK/view?usp=sharing

SOUND & SPACE WORKSHOP at Curiosity Club (ES)

Workshop | Barcelona | 2025

Comprehensive workshop series exploring the materiality and spatiality of sound through multiple sessions at Sound and Music Computing Masters (Curiosity Club: acousmatrix (field recordings and Islamic adhan compositions), sound & space (12-channel dodecaphonic systems), philosophical investigations of sound's nature, n-channel reverb implementations, microphone techniques (coincident and spaced pairs), hybrid spatial approaches combining Chladni figures and Harry Partch's tuning systems, and Japanese concepts of onkyō (sound + resonance).

Material:
https://drive.google.com/file/d/1vGRY1WvET-BQ5aUWXFRIiF_Gnoe2gxvC/view?usp=sharing

STOCHASTIC TENDENCIES

Analogue studio generative composition (Institute of Sonology) | 2021

The principal concept behind this composition is Tendency Masks. Tendency mask is a method of containing, enveloping, or masking stochastic processes or events into organized tendencies. Each of these parameters has an element of chance. Pitch/frequency is generated by binary scaling white noise in 8 division bands, the sum of which modulates the frequency of a function generator. The random texture is created by multiplying the function generator output with a controlled random pulse generator. The phrasing is generated by four random envelope generators, summed using a mixing amplifier, the levels on the mixing amplifier determining a variety of phrases. Developed in the analogue studio that continues the tradition of the former Philips electronic music studio.

Listen:
https://drive.google.com/file/d/1CgmbqdDxICZjfjskqgHLoF4SJi_pC4P6

CATEGORICAL PERCEPTION OF MICROTONALITY (DE)

Research paper / Psychoacoustics study | 2018

There are four main components to this research study: Survey of historical approaches to microtonality from multiple traditions. Experimental investigation of tone perception across diverse backgrounds. Creation of an empirical study of categorical boundaries in microtonal discrimination. This project investigates the perception of microtonal intervals in music, examining both historical approaches and contemporary applications.

Research paper:
https://drive.google.com/file/d/1oCCvuNM_dlYrX42v_MkD9c2fg3nHulHV

UNERHÖRT (TBA)

4-channel live | 20′ | 2026 | Experiment (Dance) & Fixed Media

Machines reflect the desire for control, embodying our expectations of the 'other,' which often results in imbalanced power dynamics centered around ourselves. While we are confined to our own perspectives, could there still be ways to genuinely listen to others? Is there something worth exploring in the potential intersections?

I explore several multidisciplinary approaches encompassing sound art, computer software development and improvisational movement. In recent years, the use of AI in creative productions has become increasingly common, raising existential questions about humanity, particularly regarding the possibility of computers outperforming humans. The fear stems from the prioritisation of 'human-like AI' development, which tends to overlook the fundamental differences between humans and machines. In the context of generative AI, its creative output is often evaluated solely through the lens of our aesthetics.

In this work I emphasize the dynamics of experimentation and collaboration rather than control in human-machine relationships. Through experiments with contemporary dancers and underground choreographers, it seeks to present an improvisational dialogue between human and machine, exploring the intersection of sound, computation, and dance.

Selected Publications & Presentations

Real-time Multi-threaded Facial Movement Analysis for Phonetic Research (forthcoming)

Bachelor's Thesis: Wandering the Sounds of Languages, Institute of Sonology (2025)

Music History of Microtonality Vol. 1, Self-published (2022)

Editorial contribution and proofreading, MusikTexte (2021)

Audio Mosaicing & Nonstandard Synthesis Tools Presentation, Petersburg Art Space (2025)

Technical Skills

Systems & Programming: C/C++20/23, Python, Linux (Arch/BSD), MacOS; Git, Docker

Music Tech: SuperCollider, Max/MSP, PureData, CSound; JUCE, Reaper, Ableton Live; Spatial Audio (IEM, WFSCollider); multichannel mixing, Praat, Ardour

Graphics: Vulkan, OpenGL, GLSL/WebGL, OpenCL, Intel TBB, OpenCV

Machine Learning: PyTorch, librosa, HuggingFace Transformers

Hardware: Arduino, OSC/MIDI; Kinect/LeapMotion; KiCad/PCB; Fusion360; 3D printing; CNC

Languages: German, English, Czech

References

Gerfried Stocker
Ars Electronica, Artistic Director
Ars Electronica

Miller Smith Puckette
Miller Puckette

Richard Barrett
Institute of Sonology, Composer, Lecturer, Performer
Richard Barrett