Qwen3.5-0.8B-weight-space-programming GGUF Models

Model Generation Details

This model was generated using llama.cpp at commit ca89968a2.

---

Click here to get info on choosing the right GGUF model format

---

Qwen3.5-0.8B, edited by an LLM with no training (Weight-Space Programming)

This is the edited model from Experiment 8 of "Sparks of Weight-Space Programming". We asked a frontier LLM ("Astra") to make Qwen3.5-0.8B better at math by editing its weights directly, with no gradient descent and no training. Working in a Python session over the weights, with a budget of 50 forward passes on practice problems from the GSM8K and MATH training sets, Astra traced the base model's thinking loops to one direction written by the MLPs of layers 15 and 19, and subtracted it from 64 output columns of down_proj in each layer (131,072 weights, 0.016% of the model).

The base model loops until the token limit on almost every math problem. The edited one mostly doesn't.

🎮 Try it live: akhaliq/weight-space-programming-demo — type a problem, watch the base model loop while the edited one solves it.

Results

From the post (thinking on, up to 32,768 tokens, several samples per problem):

Independent re-run of this checkpoint: full MATH-500, 500 problems × 4 samples = 2,000 generations (43.4M generated tokens, 51 min on an H200), with the post's protocol: vLLM, thinking on, temperature 0.6, top_p 0.95, top_k 20, presence_penalty 1.5, max 32,768 new tokens, seed 0, last \boxed{} graded with math-verify 0.9.0. The edited model scored 51.0%, with 31.6% of answers hitting the token limit. A 25-problem smoke test of the base model gave 5.0%, with 95% hitting the limit. Raw scores, per-problem results and sample generations: eval/.

Verifying the weights

Astra's edit is published as a bit-exact diff in RikiyaT/lm_understand-logs (exp8_math/runs/p50c/edit/). This checkpoint was rebuilt with exp8_math/code/apply_edit.py, which sha256-verifies every rebuilt tensor against the checkpoint evaluated in the post. Only these two tensors differ from Qwen/Qwen3.5-0.8B @ 2fc06364715b967f1860aea9cf38778875588b17:

Reproduction

This checkpoint and the re-run above were built by akhaliq with ML Intern on Hugging Face Jobs, 2026-11-02: the edit was rebuilt and hash-verified on CPU, and the benchmark run on an NVIDIA H200 with vLLM 0.33.0 / transformers 5.20.2 / math-verify 0.9.0, following exp8_math/code/evaluate.py (thinking on, think35 sampling, last-\boxed{} grading). One substitution: the post evaluated a text-only export of the model, and this checkpoint is the full multimodal release. The language-model tensors are identical (hash-verified), and text prompts do not use the vision tower.

Usage

from vllm import LLM, SamplingParams
from transformers import AutoTokenizer

ckpt = "RikiyaT/Qwen3.5-0.8B-weight-space-programming"
tok = AutoTokenizer.from_pretrained(ckpt)
llm = LLM(model=ckpt, dtype="bfloat16", max_model_len=34816)

prompt = tok.apply_chat_template(
    [{"role": "user", "content": "What is $2^{10} + 24$?\nPlease reason step by step, and put your final answer within \\boxed{}."}],
    tokenize=False, add_generation_prompt=True, enable_thinking=True)
sp = SamplingParams(n=1, temperature=0.6, top_p=0.95, top_k=20, presence_penalty=1.5,
                    max_tokens=32768, seed=0)
print(llm.generate([prompt], sp)[0].outputs[0].text)

Provenance

• Blog post: https://rikiyat.github.io/blog/weight-space-programming/
• Logs, diffs, and rebuild code: https://github.com/RikiyaT/lm_understand-logs (exp8_math/, CC BY 4.0 / MIT)
• Demo: akhaliq/weight-space-programming-demo
• Re-run (this repo's eval/): MATH-500 (HuggingFaceH4/MATH-500), math-verify 0.9.0
• Base model: Qwen/Qwen3.5-0.8B, Apache 2.0

---

🚀 If you find these models useful

Help me test my AI-Powered Quantum Network Monitor Assistant with quantum-ready security checks:

👉 Quantum Network Monitor

The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : Source Code Quantum Network Monitor. You will also find the code I use to quantize the models if you want to do it yourself GGUFModelBuilder

💬 How to test:
Choose an AI assistant type:

• TurboLLM (gpt-5.6-luna)
• HugLLM (Hugginface Open-source models)
• TestLLM (Experimental CPU-only)

What I’m Testing

I’m pushing the limits of small open-source models for AI network monitoring, specifically:

• Function calling against live network services
• How small can a model go while still handling:
  • Automated Nmap security scans
  • Quantum-readiness checks
  • Network Monitoring tasks

🟡 TestLLM – Current experimental model (llama.cpp on 2 CPU threads on huggingface docker space):

• ✅ Zero-configuration setup
• ⏳ 30s load time (slow inference but no API costs) . No token limited as the cost is low.
• 🔧 Help wanted! If you’re into edge-device AI, let’s collaborate!

Other Assistants

🟢 TurboLLM – Uses gpt-4.1-mini :

• **It performs very well but unfortunatly OpenAI charges per token. For this reason tokens usage is limited.
• Create custom cmd processors to run .net code on Quantum Network Monitor Agents
• Real-time network diagnostics and monitoring
• Security Audits
• Penetration testing (Nmap/Metasploit)

🔵 HugLLM – Latest Open-source models:

• 🌐 Runs on Hugging Face Inference API. Performs pretty well using the lastest models hosted on Novita.

💡 Example commands you could test:

1. "Give me info on my websites SSL certificate"
2. "Check if my server is using quantum safe encyption for communication"
3. "Run a comprehensive security audit on my server"
4. '"Create a cmd processor to .. (what ever you want)" Note you need to install a Quantum Network Monitor Agent to run the .net code on. This is a very flexible and powerful feature. Use with caution!

Final Word

I fund the servers used to create these model files, run the Quantum Network Monitor service, and pay for inference from Novita and OpenAI—all out of my own pocket. All the code behind the model creation and the Quantum Network Monitor project is open source. Feel free to use whatever you find helpful.

If you appreciate the work, please consider buying me a coffee ☕. Your support helps cover service costs and allows me to raise token limits for everyone.

I'm also open to job opportunities or sponsorship.

Thank you! 😊