This rank-128 attention-only LoRA was an experiment to answer one question: can MiniMax Music 3 be trained without an RVQ encoder, using plain latent MSE flow loss on real audio?
It cannot — and this run demonstrates why. MiniMax Music's DiT is conditioned on embeddings produced by its autoregressive LM. Without an audio→RVQ-codes encoder, there is no way to produce the conditioning that actually corresponds to a real training clip; the cached LM rollouts used here are sampled from the text/lyrics alone and describe a different realization of the song than the ground-truth latents they were paired with. Trained on those misaligned (conditioning, latent) pairs, the model's surface texture drifts toward the dataset while musical structure degrades — audible in the validation audio as increasingly incoherent output over training.
Training was stopped once the negative result was established rather than carried to the full step budget.
This is a PEFT LoRA derived from MiniMaxAI/MiniMax-Music3.
No validation prompt was used during training.
None
1.70.030FlowMatchEulerDiscreteScheduler42256Note: The validation settings are not necessarily the same as the training settings.
The text encoder was not trained. You may reuse the base model text encoder for inference.
Training epochs: 22
Training steps: 2750
Learning rate: 1.0
Max grad norm: 0.5
Effective batch size: 8
Gradient checkpointing: False
Prediction type: flow_matching
Optimizer: prodigy
Trainable parameter precision: Pure BF16
Base model precision: no_change
Caption dropout probability: 0.1%
LoRA Rank: 128
LoRA Alpha: 128.0
LoRA Dropout: 0.1
LoRA initialisation style: default
LoRA mode: Standard
import torch
from diffusers import DiffusionPipeline
model_id = 'MiniMaxAI/MiniMax-Music3'
adapter_id = 'bghira/minimax-music-suno-reggae-rank128-v2'
pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16) # loading directly in bf16
pipeline.load_lora_weights(adapter_id)
prompt = "An astronaut is riding a horse through the jungles of Thailand."
negative_prompt = 'blurry, cropped, ugly'
## Optional: quantise the model to save on vram.
## Note: The model was not quantised during training, so it is not necessary to quantise it during inference time.
#from optimum.quanto import quantize, freeze, qint8
#quantize(pipeline.transformer, weights=qint8)
#freeze(pipeline.transformer)
pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu') # the pipeline is already in its target precision level
model_output = pipeline(
prompt=prompt,
negative_prompt=negative_prompt,
num_inference_steps=30,
generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(42),
width=256,
height=256,
guidance_scale=1.7,
).images[0]
model_output.save("output.png", format="PNG")
checkpoint-1000/pytorch_lora_weights.safetensors 151 MBcheckpoint-1250/pytorch_lora_weights.safetensors 151 MBcheckpoint-1500/pytorch_lora_weights.safetensors 151 MBcheckpoint-1750/pytorch_lora_weights.safetensors 151 MBcheckpoint-2000/pytorch_lora_weights.safetensors 151 MBcheckpoint-2250/pytorch_lora_weights.safetensors 151 MBcheckpoint-250/pytorch_lora_weights.safetensors 151 MBcheckpoint-2500/pytorch_lora_weights.safetensors 151 MBcheckpoint-2750/pytorch_lora_weights.safetensors 151 MBcheckpoint-3000/pytorch_lora_weights.safetensors 151 MBcheckpoint-500/pytorch_lora_weights.safetensors 151 MBcheckpoint-750/pytorch_lora_weights.safetensors 151 MBpytorch_lora_weights.safetensors 151 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo bghira/minimax-music-suno-reggae-rank128-v2 ./model-folderMiniMaxAI/MiniMax-Music3