Loading…
Loading…
Second-Generation (
v2) Release Available: Seevit-base-breast-cancer-phi-lattice-v2for the updatedphi-lattice v2build (19.51 dB4-bit SQNR vs18.60 dBinv1,0.00028logit MSE vs0.00047inv1, plus standalonelow_vram_4bitandtriton_4bitloaders in46.3 MiBVRAM). This repository is preserved as the first-generation (v1) baseline for historical comparison and reproducibility.
Experimental build of the 85.8M-parameter medical Vision Transformer (Falah/vit-base-breast-cancer) quantized and pruned using the phi-lattice post-training optimization pass. Uploaded for testing and evaluation.
vit_phi_packed_4bit.pt (43.3 MB) — Bit-packed 4-bit uint8 linear projections (7.57x smaller than the 327.4 MB FP32 checkpoint).model.safetensors (163.7 MB) — Standard float16 HuggingFace transformers checkpoint for direct loading via AutoModelForImageClassification.phi-lattice on vit-base-breast-cancer| Quantization Method | Weight SQNR (dB) | Pruned Zero Weights (Sparsity) | Top-1 Agreement with FP32 | Output KL Divergence (Lower is Better) | Logit Cosine Similarity |
|---|---|---|---|---|---|
Standard Uniform (4-bit) |
18.87 dB | 0.00% | 100.0% | 0.00007 | 0.99999 |
phi-lattice (4-bit, this repo) |
18.60 dB | 8.07% | 100.0% | 0.00009 | 0.99999 |
Standard Uniform (3-bit) |
11.80 dB | 0.00% | 100.0% | 0.00156 | 0.99996 |
phi-lattice (3-bit) |
12.07 dB | 17.77% | 100.0% | 0.00069 | 0.99982 |
transformers)from transformers import AutoImageProcessor, AutoModelForImageClassification
repo_id = "ununununununununununununununununununun/vit-base-breast-cancer-phi-lattice"
processor = AutoImageProcessor.from_pretrained(repo_id)
model = AutoModelForImageClassification.from_pretrained(repo_id)
Falah/vit-base-breast-cancer