Music Manipulation using optimal transport

In classical music, portamento is an effect in which the transmission between two tones is done smoothly, sweeping the whole frequency range between the two tones, for example by sweeping a finger over the threads of a guitar.
In this work we aimed to harness the optimal transport problem in order to generalize the portamento effect and make it applicable for any 2 sound tracks.
Referring to the spectra as density of mass, transporting the mass from its initial configuration to its final configuration achieves a generalized portamento.
In this project the optimal transport was developed for signals in the spectral domain, after applying STFT. Additional subject that was raised during the development of the project was the signal processing required in order to minimize the artifacts on the sound integrity. The main focus in this subject was in the meaning of the phase and in its accumulation speed, in the synthesis and the analysis. Most of the stages mentioned above were implemented successfully in this project.

Music Manipulation using optimal transport