distilbert-base-uncased-go-emotions-student-GGUF

GGUF conversion of joeddav/distilbert-base-uncased-go-emotions-student, a DistilBERT model distilled from a zero-shot classification pipeline into the 28 GoEmotions labels, for use with llama.cpp.

Files

Usage

Run with llama-embedding using rank pooling to get the 28 classifier logits:

llama-embedding -m goemotions-Q8_0.gguf --pooling rank --embd-normalize -1 -p "your text here"

Note: --embd-normalize defaults to 2 (L2 normalization), which is meaningless for classifier logits — always pass --embd-normalize -1 to get raw scores.