QwenPaw-Flash-27B-BF16
QwenPaw-Flash-27B-BF16 is the BF16 GGUF release of the QwenPaw-Flash-27B agent model. The QwenPaw-Flash family is trained for tool use, command execution, memory management and multi-step tasks in QwenPaw.
Project · Hugging Face · ModelScope · ModelScope collection
Download
Download all model files into one directory with the Hugging Face CLI.
hf download agentscope-ai/QwenPaw-Flash-27B-BF16 --local-dir QwenPaw-Flash-27B-BF16
Weight files
Download all numbered shards into the same directory. Pass the first shard to llama.cpp.
| File | Bytes | SHA-256 |
|---|---|---|
QwenPaw-Flash-27B-step92-BF16-00001-of-00002.gguf |
29,955,252,352 | 656d7d75fef1c014f21bc3144530b5c0e94f8af719cf872131b13950ae2f882d |
QwenPaw-Flash-27B-step92-BF16-00002-of-00002.gguf |
23,853,028,672 | f75d6f1628f40bd9d4fd33a2497e726074ba178b915050b1e020786cefaf8e93 |
The SHA-256 of the original GGUF before splitting was 35d9db421d316780b9cefc9956a6250742c20457ce7965f1bea8abe4fd3334e7.
Serve locally
Use a llama.cpp build that supports this architecture.
llama-server -m QwenPaw-Flash-27B-BF16/QwenPaw-Flash-27B-step92-BF16-00001-of-00002.gguf --alias QwenPaw-Flash-27B-BF16 --port 8080
Send a text request to the running server.
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"model":"QwenPaw-Flash-27B-BF16","messages":[{"role":"user","content":"Hello, QwenPaw!"}],"max_tokens":128}'
License
Apache License 2.0.