whisper-large-v3-turbo-it-ct2-int8

CTranslate2 INT8 quantized version of LocalAI-io/whisper-large-v3-turbo-it.

Usage with LocalAI

This model is ready to use with LocalAI via the whisperx backend.

Save the following as whisperx-large-v3-turbo-it.yaml in your LocalAI models directory:

name: whisperx-large-v3-turbo-it
backend: whisperx
known_usecases:
  - transcript
parameters:
  model: LocalAI-io/whisper-large-v3-turbo-it-ct2-int8
  language: it

Then transcribe audio via the OpenAI-compatible endpoint:

curl http://localhost:8080/v1/audio/transcriptions \
  -H "Content-Type: multipart/form-data" \
  -F file="@audio.mp3" \
  -F model="whisperx-large-v3-turbo-it"

Usage

```python from faster_whisper import WhisperModel model = WhisperModel("LocalAI-io/whisper-large-v3-turbo-it-ct2-int8", device="cpu", compute_type="int8") ```