Sign up

ACE-Step/acestep-transcriber

🤗 On Hugging Faceaudio-text-to-textmit10.7B params22 GBsafetensors✓ HF checksums availableupdated today
Magnet

Tech Report

ACE-Step Transcriber

Description

ACE-Step Transcriber is the annotation model used by ACE-Step v1.5 for training data labeling. It is a powerful multilingual audio transcription model capable of transcribing both speech and singing voice with high accuracy.

Key Features

  • 🌍 50+ Languages Support - Covers major world languages and regional dialects
  • 🎤 Speech Transcription - Accurately transcribes spoken content
  • 🎵 Singing Voice Transcription - Specialized in lyrics transcription with musical structure annotations
  • 🏷️ Structure Annotation - Automatically identifies song sections (verse, chorus, bridge, etc.)

Usage

The usage is the same as Qwen2.5 Omni-7B.

Prompt Format

Use the following prompt to transcribe audio:

*Task* Transcribe this audio in detail

Output Format

The model outputs structured content in the following format:

# Languages

# Lyrics
[Section Tag - Optional Instrument]

...

Example Output

# Languages
en

# Lyrics
[Intro - Acoustic Guitar]

[Verse 1]
Walking down the empty street tonight
Stars are shining oh so bright
...

[Chorus]
This is where we belong
Singing our favorite song
...

Supported Section Tags

  • [Intro], [Outro]
  • [Verse 1], [Verse 2], etc.
  • [Chorus], [Pre-Chorus], [Post-Chorus]
  • [Bridge]
  • [Guitar Interlude], [Instrumental]
  • [Spoken]

Supported Languages (50+)

The model supports transcription in over 50 languages, including but not limited to:

| Region | Languages |

|--------|-----------|

| East Asia | Chinese (zh), Japanese (ja), Korean (ko) |

| Southeast Asia | Vietnamese (vi), Thai (th), Indonesian (id), Malay (ms), Filipino (tl) |

| South Asia | Hindi (hi), Bengali (bn), Tamil (ta), Urdu (ur) |

| Europe | English (en), German (de), French (fr), Spanish (es), Italian (it), Portuguese (pt), Russian (ru), Polish (pl), Dutch (nl), Greek (el), Turkish (tr) |

| Middle East | Arabic (ar), Hebrew (he), Persian (fa) |

| Others | And many more regional languages... |

Use Cases

  • Music Production - Transcribe reference tracks for lyrics extraction
  • Dataset Creation - Generate high-quality labeled data for music AI models
  • Accessibility - Create subtitles and captions for audio content
  • Music Analysis - Extract structural information from songs