Week 1— Generating Music by using Deep Learning
Hello, we are Nermin Nur Aydoğan, Furkan Karadeli and Erhan Kabaoğlu, students from Computer Engineering Department at Hacettepe University. We are going to introduce our term project for BBM406 Machine Learning. Our project theme is ‘Art and Machine Learning’.
Introduction
Music is a special form of art and always present in our lives. Many researches have been done to find out the intersection between music and Machine Learning. With that being said, we wanted to select a study which is productive and interesting among these researches. We choose the topic which is ‘Generate Music by Using Deep Learning’. Piano will be our instrument in this study. Accordingly, study of music generation can enhance the productivity of musicians and also may result in nice audio outcomes.
Dataset
We will use MAESTRO midi dataset for our project. MAESTRO is a dataset composed of over 200 hours of virtuosic piano performances captured with fine alignment (~3 ms) between note labels and audio waveforms. You can find the dataset from this link.
Related Papers
We have searched for related papers about our project topic. One of the most known related papers are ‘Deep learning techniques for music generation’ and ‘Deep learning for music generation: challenges and directions’. Both of the papers are written by Jean-Pierre Briot and François Pachet. One of the previous work by Hawtorne studies Piano Music Modeling using Maestro Dataset. Another research by Dong presents an open source Python library for symbolic music generation. List of related papers can be found below:
Briot, JP., Pachet, F. Deep learning for music generation: challenges and directions. Neural Comput & Applic 32, 981–993 (2020). — https://doi.org/10.1007/s00521-018-3813-6
Hawtorne C., Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset (2018). — https://arxiv.org/abs/1810.12247
Huang A., Wu R. Deep Learning for Music (2016). — https://arxiv.org/abs/1606.04930
Dong, H. MusPy: A Toolkit for Symbolic Music Generation — https://arxiv.org/abs/2008.01951
This was our first weekly post. We will keep you updated about the project in upcoming blogs. Hope to see you in next!
