🚀 vtx-embed-7M-lf2 (base-2bit)

High-performance native 2-bit static embedding model powering vortexa. Native 2-Bit LF2 integer quantization · 2.36 MB RAM · 7.56M Parameters · Fused Numba dequant & mean-pooling · Sub-millisecond CPU latency

---

⚡ What is LF2?

LF2 is an ultra-compact, integer-native 2-bit quantization format for embedding matrices:

• Zero FP32 Parameter Tables: Parameters are stored entirely as packed 2-bit levels (4 weights per uint8 byte) and double-quantized uint8 scales and minimums.
• Extreme Compression: Memory drops from 4.72 MB (LF4 4-bit) down to 2.36 MB (2-bit), retaining 93.52% mean token cosine similarity to full precision.
• Fused Dequantization & Pooling: Evaluated on-the-fly using Numba JIT kernels directly into registers / L1 cache without allocating full FP32 token tables in RAM.

---

📄 Model Details

---

💻 Quickstart Usage

Standalone Inference with lf2_native.py

This repository includes lf2_native.py directly for zero-dependency inference (only requires numpy, safetensors, and tokenizers; numba optional for maximum speed):

from huggingface_hub import snapshot_download
import sys

# 1. Download model repository
model_path = snapshot_download(repo_id="VTXAI/vtx-embed-7M-lf2")
sys.path.append(model_path)

from lf2_native import VortexEmbedLF2

# 2. Load model directly from local directory
model = VortexEmbedLF2.from_pretrained(model_path)
print(f"Model In-RAM size: {model.model_size_mb:.2f} MB")

# 3. Encode sentences
texts = [
    "What is the capital of India?",
    "Explain gravity and general relativity",
]
embeddings = model.encode(texts)
print("Embeddings shape:", embeddings.shape)  # (2, 256)

# 4. Semantic similarity
sim = embeddings[0] @ embeddings[1]
print("Cosine Similarity:", sim)

---

📜 Citation

@misc{vtx-embed-7m-lf2,
  title  = {vtx-embed-7M-lf2: Native 2-Bit Embeddings for Ultra-Low Footprint Semantic Search},
  author = {VTXAI},
  year   = {2026},
  url    = {https://huggingface.co/VTXAI/vtx-embed-7M-lf2}
}

---

📄 License

MIT License — free for commercial and research use.