中文Sign up

ethanfel/FoleyTune-LoRAs

🤗 Hugging Face sourceapache-2.0913 MBother✓ 4 checksumsupdated today
Have the files? Submit a model torrent

If you have the complete model files and permission to share them, replace the example folder path and run this command. It checks your files, creates a torrent, and submits the magnet and checksums to Pirate Face. Keep your torrent client seeding so others can download from peers. Pirate Face does not receive the model files. Get your community key from your account. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ethanfel/FoleyTune-LoRAs ./model-folder
Needs a seeder →

FoleyTune LoRAs

LoRA adapters trained with ComfyUI-HunyuanVideo-FoleyTune for video-to-audio generation on the HunyuanVideo audio transformer.

Adult content. Some adapters in this repository are trained on adult audio datasets. Browse subdirectories for details.

⚠️ Render CFG depends on the folder. Some adapters must be rendered at CFG = 1.0 (they saturate at higher guidance); others work at any normal CFG. Check the folder / its README before rendering.

Categories

Folder Description Adapters
type-a/ Adult audio LoRAs 5 blowjob adapters
CFG_1.0/ Render @ CFG 1.0 ONLY (saturate at higher CFG) 1 sex/moaning + skin-slap merge
standard_cfg/ Standard-CFG adapters (any normal guidance) 1 blowjob

The CFG_1.0/ and standard_cfg/ adapters use the newer all_blocks_sync_io target + Prodigy+ ScheduleFree (c=20) recipe (see each folder's README), and render best with TF32 off, raw output (no bandwidth extension). The type-a/ config below is the older sweep.

Base Training Config

All adapters share this foundation unless noted in their category README:

  • Base model: HunyuanVideo audio transformer
  • LoRA target: all_attn_mlp (attention + MLP layers)
  • Rank: 64, Alpha: 64
  • Optimizer: Prodigy (adaptive learning rate)
  • Schedule: Cosine with curriculum switching
  • Precision: bf16
  • Visual dropout: 0.5

Metrics

  • PBC (Per-Band Correlation): frequency-band tracking accuracy. Higher is better.
  • SC (Spectral Convergence): overall spectral fidelity. Lower is better.
  • MCD (Mel-Cepstral Distortion): timbral accuracy. Lower is better.
  • TV (Temporal Variance): dynamic range over time. Higher means richer variation.

Links

Usage

Load in ComfyUI with the FoleyTune LoRA Loader node (supports both .safetensors and .pt), or manually:

import torch
from safetensors.torch import load_file

state_dict = load_file("type-a/typeA_blowjob_rank1_sigma07_15k_PBC0661_SC1058.safetensors")
# Apply to HunyuanVideo audio transformer with load_lora()