scalar_kl / seed 100

Grassmannian block-sparse featurizer trained from scratch for a fixed DINOv3/Imagenette patch classifier. Profile: smoke; completed epochs: 3. A smoke artifact is an engineering demonstration and supplies no confirmatory scientific claim.

Measured held-out KL: 5.1326113 nats/image; accuracy: 26.0000%; normalized patch MSE: 0.94415915. Full metrics and per-image logits accompany this model.

Use

Install the project with uv sync --frozen, download this repository with hf download, then:

from PIL import Image
from e2e_bsf.inference import VisionFeaturizer
model = VisionFeaturizer("path/to/downloaded/model")
probabilities = model.predict([Image.open("image.jpg").convert("RGB")])

The artifact contains BSF weights, fixed normalization and the trained classifier. It excludes DINO weights and photos. Authorized DINO access and its separate license are required; the MIT license here does not relicense the backbone. Class order follows torchvision Imagenette.

Limits and provenance

Lower KL only measures preservation of this ten-class readout. It does not establish semantic concepts, full DINO fidelity, or inference acceleration. config.json binds revisions, architecture, objective, seed, preprocessing and training identities. manifest.json and duplicate_audit.json preserve image assignments and exclusion evidence. teacher.json records classifier selection. model.safetensors is for inference; the local training checkpoint additionally retains optimizer/RNG state.

Sources: BSF paper, end-to-end SAE paper, Goodfire code, preregistration.