YM2413-MDB

View on GitHub

YM2413-MDB

This web repository contains musical examples from our paper, “YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotations”.

title_image

We show baseline generation results of 4 bars using the emotion condition of cheerful and depressed. Generated samples are rendered using VST2413.

Samples from dataset

Our dataset is multi-labeled with 19 emotion tags: tense, cheerful, speedy, serious, rhythmic, fluttered, peaceful, creepy, depressed, calm, grand, cold, dreamy, bizarre, cute, touching, comic, frustrating, and boring

** Top tag is italicized

Emotion Tag
Audio
Emotion Tag
Audio
Tense
serious
./audio_dataset/tense.mp3 Grand
peaceful
./audio_dataset/grand.mp3
Cheerful
speedy fluttered
./audio_dataset/cheerful.mp3 Cold
serious
./audio_dataset/cold.mp3
Speedy
cheerful dreamy rhythmic
./audio_dataset/speedy.mp3 Dreamy
cold
./audio_dataset/dreamy.mp3
Serious
tense creepy
./audio_dataset/serious.mp3 Bizarre
creepy serious dreamy cold
./audio_dataset/bizarre.mp3
Rhythmic
cheerful peaceful speedy
./audio_dataset/rhythmic.mp3 Cute
peaceful comic rhythmic
./audio_dataset/cute.mp3
Fluttered
serious rhythmic
./audio_dataset/fluttered.mp3 Touching
serious speedy calm
./audio_dataset/touching.mp3
Peaceful
cheerful
./audio_dataset/peaceful.mp3 Comic
cute
./audio_dataset/comic.mp3
Creepy
calm
./audio_dataset/creepy.mp3 Frustrating
depressed
./audio_dataset/frustrating.mp3
Depressed
serious calm
./audio_dataset/depressed.mp3 Boring
peaceful calm
./audio_dataset/boring.mp3
Calm
peaceful
./audio_dataset/calm.mp3    

Generated samples

samples from model that was trained with YM2413-MDB songs which has cheerful or depressed tag (not top tag!): sampled at GPT2 step 20K checkpoint, sampling temperature 0.9

Cheerful
Depressed
./audio_generation/cheerful/1.mp3
./audio_generation/depressed/1.mp3
./audio_generation/cheerful/2.mp3
./audio_generation/depressed/2.mp3
./audio_generation/cheerful/3.mp3
./audio_generation/depressed/3.mp3
./audio_generation/cheerful/4.mp3
./audio_generation/depressed/4.mp3
./audio_generation/cheerful/5.mp3
./audio_generation/depressed/5.mp3