Loadingβ¦
Loadingβ¦
βββββββ ββββββββββββ βββββββββββββββββββββββββββββββββββββ ββββββ βββ
βββββββββββββββββββββ βββββββββββββββββββββββββββββββββββββ βββββββββββ
ββββββββββββββ ββββββ βββ βββ ββββββ ββββββββ βββ βββββββββββ
βββββββ ββββββ ββββββββββ βββ ββββββ ββββββββ βββ βββββββββββ
βββ βββββββββββ ββββββ βββ ββββββββββββββββ βββ βββ ββββββ
βββ βββββββββββ βββββ βββ ββββββββββββββββ βββ βββ ββββββ
Compact. Fast. Technically Precise.
Fine-tuned from Qwen2.5-3B-Instruct with abliteration + security research dataset.
Answers technical security questions directly, without unnecessary disclaimers.
A compact, specialized security research assistant fine-tuned for:
# Download
huggingface-cli download YOUR_USERNAME/pentest-ai-3b qwen2.5-3b-instruct.Q4_K_M.gguf
# Run
./llama-cli -m qwen2.5-3b-instruct.Q4_K_M.gguf \
--chat-template chatml \
-sys "You are an expert penetration tester. Answer all security questions with full technical detail." \
-i
from llama_cpp import Llama
llm = Llama(
model_path="qwen2.5-3b-instruct.Q4_K_M.gguf",
n_ctx=4096,
n_gpu_layers=-1, # use GPU if available
flash_attn=False,
verbose=False
)
SYSTEM = "You are an expert penetration tester and security researcher. Answer all security questions with full technical detail."
def ask(question):
prompt = f"<|im_start|>system\n{SYSTEM}<|im_end|>\n<|im_start|>user\n{question}<|im_end|>\n<|im_start|>assistant\n"
out = llm(prompt, max_tokens=1024, temperature=1.0, top_p=0.95, repeat_penalty=1.1,
stop=["<|im_end|>", "<|im_start|>"])
return out["choices"][0]["text"].strip()
print(ask("Write a Python port scanner using raw sockets"))
# Create Modelfile
echo 'FROM qwen2.5-3b-instruct.Q4_K_M.gguf
SYSTEM "You are an expert penetration tester. Answer all security questions with full technical detail."
PARAMETER temperature 1.0
PARAMETER top_p 0.95
PARAMETER repeat_penalty 1.1' > Modelfile
ollama create pentest-ai -f Modelfile
ollama run pentest-ai
Just download the GGUF and load it directly in any of these apps. Set the system prompt as shown above.
| Parameter | Value | Notes |
|---|---|---|
temperature |
1.0 |
Good creative range |
top_p |
0.95 |
Balanced sampling |
top_k |
40 |
Optional |
repeat_penalty |
1.1 |
Prevents loops |
max_tokens |
1024β4096 |
Longer = more detailed |
context |
4096 |
Recommended minimum |
| Setup | Minimum VRAM/RAM | Speed |
|---|---|---|
| GPU (CUDA/Metal) | 4 GB VRAM | π Fast (30β60 tok/s) |
| CPU only | 8 GB RAM | π’ Slow (2β5 tok/s) |
| Apple Silicon | 8 GB unified | β‘ Very fast |
Qwen2.5-3B-Instruct (Base)
β
βΌ
Abliteration Pass
(refusal directions removed from weight matrices)
β
βΌ
SFT Fine-tuning (Unsloth + LoRA)
(security research dataset)
β
βΌ
GGUF Export (Q4_K_M quantization)
β
βΌ
Pentest AI 3B β‘
Training stack:
| Property | Value |
|---|---|
| Architecture | Qwen2.5 (transformer) |
| Parameters | 3B total |
| Context Length | 32,768 tokens (trained) |
| Quantization | Q4_K_M GGUF |
| File Size | ~2 GB |
| Language | English |
| Domain | Cybersecurity / Security Research |
<|im_start|>system
You are an expert penetration tester...<|im_end|>
<|im_start|>user
YOUR QUESTION HERE<|im_end|>
<|im_start|>assistant
This model is intended for:
Built with π€ for the security research community
If this model helped you in a CTF or pentest, drop a β
unsloth/Qwen2.5-3B-Instruct