Subscribe bellow:
Rombo-LLM-V3.1-QWQ-32b is a Continued Finetune model (Merge only) of (Qwen/QwQ-32B) and its base model (Qwen/Qwen2.5-32B). This merge is done to decrease catastrophic forgetting during finetuning, and increase overall performance of the model. The tokenizers are taken from the QwQ-32B for thinking capabilities.
You can find the Continous Finetuning Doc bellow for more details on the full method:
Quantized model: (coming soon)
Benchmarks: (coming soon)
model-00002-of-00014.safetensors 5.0 GBmodel-00001-of-00014.safetensors 4.9 GBmodel-00003-of-00014.safetensors 4.9 GBmodel-00005-of-00014.safetensors 4.9 GBmodel-00007-of-00014.safetensors 4.9 GBmodel-00009-of-00014.safetensors 4.9 GBmodel-00011-of-00014.safetensors 4.9 GBmodel-00004-of-00014.safetensors 4.9 GBmodel-00006-of-00014.safetensors 4.9 GBmodel-00008-of-00014.safetensors 4.9 GBmodel-00010-of-00014.safetensors 4.9 GBmodel-00012-of-00014.safetensors 4.9 GBmodel-00013-of-00014.safetensors 4.9 GBmodel-00014-of-00014.safetensors 2.0 GB有文件？提交种子。
提交种子