中文Sign up

aufklarer/DeepFilterNet3-CoreML

🤗 Hugging Face sourceaudio-to-audioapache-2.07 MBother✓ 4 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo aufklarer/DeepFilterNet3-CoreML ./model-folder
Needs a seeder →

DeepFilterNet3 — CoreML INT8

Real-time speech enhancement for Apple Silicon. Removes background noise from speech audio. Runs on Neural Engine via CoreML.

  • 2.1M params, INT8 k-means palettization, 2.2 MB
  • 48 kHz native, 10 ms frames
  • Requires macOS 14+ / iOS 17+

Quality

Measured on 30 VoiceBank-DEMAND test clips via Python CoreMLBackend (replaces only the NN forward; keeps the PyTorch STFT / ERB / deep-filter post-processing intact).

Variant PESQ STOI SI-SDR Size
PyTorch FP32 (reference) 2.900 0.947 18.19 —
CoreML FP16 2.901 0.947 18.19 4.2 MB
CoreML INT8 (this repo) 2.907 0.947 18.11 2.2 MB

INT8 matches FP16 within run-to-run noise (ΔPESQ +0.006, ΔSI-SDR −0.07 dB, STOI identical) while cutting size by 48%.

Latency (M2 Max)

Duration Time RTF
5 s 0.65 s 0.13
10 s 1.2 s 0.12
20 s 4.8 s 0.24

Files

File Size Description
DeepFilterNet3.mlmodelc 2.2 MB Pre-compiled CoreML model (runs on Neural Engine)
auxiliary.npz 126 KB ERB filterbank, Vorbis window, normalization states

Usage

Add speech-swift to Package.swift:

.package(url: "https://github.com/soniqo/speech-swift", branch: "main")

Then denoise:

import SpeechEnhancement

let enhancer = try await SpeechEnhancer.fromPretrained()
let clean = try enhancer.enhance(audio: noisyAudio, sampleRate: 48000)

CLI:

swift run audio denoise noisy.wav --output clean.wav

Source

License

  • Model weights: Apache-2.0 / MIT dual license
  • CoreML conversion: Apache-2.0

Links

Reference