Model Card for midi-model-tv2o-medium

Midi event transformer for music generation.

Model Updates

• new tv2o-medium model: "tvo" means MidiTokenizerV2 optimised.

Model Details

Model Description

• Developed by: SkyTNT
• Trained by: SkyTNT
• Model type: Transformer
• License: apache-2.0

Model Sources

• Repository: https://github.com/SkyTNT/midi-model
• Demo: https://huggingface.co/spaces/skytnt/midi-composer

Training Details

Training Data

• projectlosangeles/Los-Angeles-MIDI-Dataset
• projectlosangeles/Monster-MIDI-Dataset
• SymphonyNet MIDI Dataset

Training Hyperparameters

• config: tv2o-medium
• max-len: 2048 then 4096
• lr: 1e-4 then 2e-4
• weight-decay: 0.01
• batch: 2x2x2
• bfloat16 precision

Loss

• val loss: 0.2159

Files

• model.ckpt: latest model checkpoint
• onnx/*.onnx: onnx format model