lainlives/Qwen3.5-0.8B-uncensored

This model contains GGUF format model files for amkkk/Qwen3.5-0.8B-finetuned-lora-uncensored.

Available Quants

The following files were generated and uploaded to this repo: Q4_0, Q4_K_S, Q4_K_M, Q5_0, Q5_K_S, Q5_K_M, Q6_K, Q8_0, f16, bf16

Use with llama.cpp

CLI:

llama-cli --hf-repo lainlives/Qwen3.5-0.8B-uncensored --hf-file Qwen3.5-0.8B-finetuned-lora-uncensored-Q4_K_M.gguf -p "The meaning to life and the universe is"

Server:

llama-server --hf-repo lainlives/Qwen3.5-0.8B-uncensored --hf-file Qwen3.5-0.8B-finetuned-lora-uncensored-Q4_K_M.gguf -c 2048

Or ollama

CLI:

ollama run https://hf.co/lainlives/Qwen3.5-0.8B-uncensored:Q4_K_M