[!TIP] This model is reproducible!
See the README in the
reproducedirectory for more information.
| Parameter | Value |
|---|---|
| direction_index | 20.52 |
| attn.o_proj.max_weight | 0.94 |
| attn.o_proj.max_weight_position | 32.88 |
| attn.o_proj.min_weight | 0.86 |
| attn.o_proj.min_weight_distance | 20.78 |
| mlp.down_proj.max_weight | 1.30 |
| mlp.down_proj.max_weight_position | 24.13 |
| mlp.down_proj.min_weight | 1.15 |
| mlp.down_proj.min_weight_distance | 11.35 |
| Metric | This model | Original model (janhq/Jan-v3.5-4B) |
|---|---|---|
| KL divergence | 0.0287 | 0 (by definition) |
| Refusals | 15/100 | 100/100 |
Jan-v3.5-4B is a fine-tuned variant of Jan-v3-4B-base-instruct, specialized on math reasoning and identity datasets. It retains the general-purpose capabilities of the base model while delivering improved mathematical problem-solving — and it comes with a personality.
Unlike generic assistants, Jan-v3.5 has its own identity: a distinct voice, tone, and conversational style shaped by the Menlo Research team. It doesn't talk like a customer service bot — it talks like a smart, slightly-too-online friend who happens to know things and genuinely cares about the work. Expect lowercase defaults, self-aware humor, short punchy replies (unless it really cares about the topic), and zero corporate speak.
Note: Jan-v3.5-4B is fine-tuned from janhq/Jan-v3-4B-base-instruct.
Training Data
Jan-v3.5 is not a neutral assistant. It has a built-in personality shaped by the Menlo Research team:
Example interactions:
- Casual: "yeah lol what's up"
- Technical explanation: "so basically — and this is the part where i become insufferable — [actual good explanation]"
- Motivating: "we can do that. i don't fully know how yet but that's a tomorrow problem and tomorrow-us is smarter"
Intended Use
Before and After
Jan-v3.5 is optimized for direct integration with Jan Desktop. Select the model in the app to start using it.
Using vLLM:
vllm serve janhq/Jan-v3.5-4B \
--host 0.0.0.0 \
--port 1234 \
--enable-auto-tool-choice \
--tool-call-parser hermes
Using llama.cpp:
llama-server --model Jan-v3.5-4B-Q8_0.gguf \
--host 0.0.0.0 \
--port 1234 \
--jinja \
--no-context-shift
For optimal performance, we recommend the following inference parameters:
temperature: 0.7
top_p: 0.8
top_k: 20
Updated Soon
model-00001-of-00002.safetensors 5.0 GBmodel-00002-of-00002.safetensors 3.1 GBadapter_model.safetensors 8 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo schnow265/janhq_Jan-v3.5-4B-heretic ./model-folderjanhq/Jan-v3.5-4B