Loading…
Loading…
Grassmannian block-sparse featurizer trained from scratch for a fixed DINOv3/Imagenette patch classifier. Profile: smoke; completed epochs: 3. A smoke artifact is an engineering demonstration and supplies no confirmatory scientific claim.
Measured held-out KL: 5.3281999 nats/image; accuracy: 26.0000%; normalized patch MSE: 0.93699938. Full metrics and per-image logits accompany this model.
Install the project with uv sync --frozen, download this repository with hf download, then:
from PIL import Image
from e2e_bsf.inference import VisionFeaturizer
model = VisionFeaturizer("path/to/downloaded/model")
probabilities = model.predict([Image.open("image.jpg").convert("RGB")])
The artifact contains BSF weights, fixed normalization and the trained classifier. It excludes DINO weights and photos. Authorized DINO access and its separate license are required; the MIT license here does not relicense the backbone. Class order follows torchvision Imagenette.
Lower KL only measures preservation of this ten-class readout. It does not establish semantic concepts, full DINO fidelity, or inference acceleration. config.json binds revisions, architecture, objective, seed, preprocessing and training identities. manifest.json and duplicate_audit.json preserve image assignments and exclusion evidence. teacher.json records classifier selection. model.safetensors is for inference; the local training checkpoint additionally retains optimizer/RNG state.
Sources: BSF paper, end-to-end SAE paper, Goodfire code, preregistration.
facebook/dinov3-vitb16-pretrain-lvd1689m