LocalAI-io/LocalAI-functioncall-qwen2.5-7b-v0.5

Source: 🤗text-generationapache-2.07.6B params15 GBsafetensors✓ 5 checksumsupdated 626d ago

or submit a torrent

Description

A model tailored to be conversational and execute function calls with LocalAI. This model is based on qwen2.5 (7B).

llama3.2-1b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-1b-v0.4
llama3.2-3b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-3b-v0.5
phi-4 version: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3
qwen2.5 (7b) version: https://huggingface.co/mudler/LocalAI-functioncall-qwen2.5-7b-v0.5/

Usage

local-ai run localai-functioncall-qwen2.5-7b-v0.5

CommentsShare your thoughts and shape the future of sovereign AI.

@LocalAI-io is unclaimedSign in with the matching Hugging Face account or an organization member account to verify this handle.Claim @LocalAI-io

Files and sources

SourceAvailable on Hugging Face

Checksums5 recorded

TorrentNot listed

SwarmNot checked

Source revision: 2567fa1cf7a5…
Witnessed: 25 Sept 2026, 21:11 UTC
Weight files: 5
Model size: 15 GB
Downloads · last month: 41
Publisher: Unclaimed

Speed on real hardware

LocalMaxxing

Output speed for one request at a time, measured by people running this model on their own machines.

2× RTX 3090llama.cpp · Q4_K_M · 1 run157 tok/s

LD_LIBRARY_PATH=/home/beta1/qwen38-release/tools/llama-b10442-cuda /home/beta1/qwen38-release/tools/llama-b10442-cuda/llama-bench -m /mnt/pf/pf-deep2/LocalAI-functioncall-qwen2.5-7b-v0.5-Q4_K_M-GGUF/localai-functioncall-qwen2.5-7b-v0.5-q4_k_m.gguf -p 512 -n 128 -ngl 99 -fa 1

View run on LocalMaxxing

Median of 1 community runs on 1 setups, from LocalMaxxing.

Run it yourself: setup guide

LocalAI-io/LocalAI-functioncall-qwen2.5-7b-v0.5

Description

Usage

Seed this model