gte-small SAEs (layers 0–11)
Sparse autoencoders for the embedding model thenlper/gte-small.
Layout
layer0_4096_top32/
sae.pt
meta.json
...
layer11_4096_top32/
sae.pt
meta.json
umap_points.json
Specs
| Field | Value |
|---|---|
| Base model | thenlper/gte-small |
| Model type | sentence embedding encoder |
| Layers | 0–11 (12 SAEs) |
d_model |
384 |
d_sae |
4096 |
| Activation | TopK (k=32) |
| Architecture | topk |
| Package size | ~145 MiB |
Files
sae.pt— SAE checkpoint for that layermeta.json— layer metadata (model_slug,layer,d_model,d_sae,k,arch)umap_points.json— feature UMAP coordinates
License
This SAE release is under Apache License 2.0.
Acknowledgements
- Base model: thenlper/gte-small (MIT)