Qwen3-Hydra is a Mixture of Experts (MoE) created from the following models using Updated LazyMergekit by CloudGoat:
base_model: Qwen/Qwen3-4B-Instruct-2507
gate_mode: hidden
dtype: bfloat16
experts:
- source_model: Qwen/Qwen3-4B-Instruct-2507
positive_prompts:
- "general instruction following, logical reasoning, and helpful response"
- "explain the concept clearly and answer the user question"
- source_model: zenlm/zen-agent-4b
positive_prompts:
- "function calling, API usage, and external tool integration"
- "execute the agent action using available tools and functions"
- source_model: InternScience/Agents-K1
positive_prompts:
- "scientific reasoning, knowledge graph retrieval, and paper analysis"
- "extract structured scientific knowledge and perform multi-hop research reasoning"
- source_model: AliesTaha/fable-traces
positive_prompts:
- "fable method execution, step-by-step verification, and trace planning"
- "follow constrained agentic workflow and report outcome with caveats"
!pip install -qU transformers bitsandbytes accelerate
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "CloudGoat/Qwen3-Hydra"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
trust_remote_code=True,
)
messages = [{"role": "user", "content": "Explain what a Mixture of Experts is."}]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
model-00002-of-00027.safetensors 996 MBmodel-00004-of-00027.safetensors 996 MBmodel-00006-of-00027.safetensors 996 MBmodel-00008-of-00027.safetensors 996 MBmodel-00010-of-00027.safetensors 996 MBmodel-00012-of-00027.safetensors 996 MBmodel-00014-of-00027.safetensors 996 MBmodel-00016-of-00027.safetensors 996 MBmodel-00018-of-00027.safetensors 996 MBmodel-00020-of-00027.safetensors 996 MBmodel-00022-of-00027.safetensors 996 MBmodel-00024-of-00027.safetensors 996 MBmodel-00026-of-00027.safetensors 996 MBmodel-00001-of-00027.safetensors 993 MBmodel-00027-of-00027.safetensors 798 MBmodel-00005-of-00027.safetensors 797 MBmodel-00007-of-00027.safetensors 797 MBmodel-00009-of-00027.safetensors 797 MBmodel-00011-of-00027.safetensors 797 MBmodel-00013-of-00027.safetensors 797 MBmodel-00015-of-00027.safetensors 797 MBmodel-00017-of-00027.safetensors 797 MBmodel-00019-of-00027.safetensors 797 MBmodel-00021-of-00027.safetensors 797 MBmodel-00023-of-00027.safetensors 797 MBmodel-00025-of-00027.safetensors 797 MBmodel-00003-of-00027.safetensors 676 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo CloudGoat/Qwen3-Hydra-12B ./model-folderAliesTaha/fable-traces