中文Sign up

software-mansion/react-native-executorch-qwen-2.5

🤗 Hugging Face sourcetext-generationapache-2.029 GBother✓ 9 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo software-mansion/react-native-executorch-qwen-2.5 ./model-folder
Needs a seeder →

qwen-2.5

This repository hosts the qwen-2.5 models exported for the React Native ExecuTorch library as ExecuTorch .pte programs, ready to run on device.

Variants

Path Backend Precision
0_5b/mlx/qwen_2_5_0_5b_mlx_int4.pte mlx 4w
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_bf16.pte xnnpack bf16
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_8da4w.pte xnnpack 8da4w
1_5b/mlx/qwen_2_5_1_5b_mlx_int4.pte mlx 4w
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_bf16.pte xnnpack bf16
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_8da4w.pte xnnpack 8da4w
3b/mlx/qwen_2_5_3b_mlx_int4.pte mlx 4w
3b/xnnpack/qwen_2_5_3b_xnnpack_bf16.pte xnnpack bf16
3b/xnnpack/qwen_2_5_3b_xnnpack_8da4w.pte xnnpack 8da4w

Repository structure

0_5b/mlx/config.json                          1.3 kB
0_5b/mlx/qwen_2_5_0_5b_mlx_int4.pte           510 MB
0_5b/xnnpack/config.json                      2.3 kB
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_8da4w.pte  398 MB
0_5b/xnnpack/qwen_2_5_0_5b_xnnpack_bf16.pte   944 MB
1_5b/mlx/config.json                          1.3 kB
1_5b/mlx/qwen_2_5_1_5b_mlx_int4.pte           1.2 GB
1_5b/xnnpack/config.json                      2.3 kB
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_8da4w.pte  1.1 GB
1_5b/xnnpack/qwen_2_5_1_5b_xnnpack_bf16.pte   2.9 GB
3b/mlx/config.json                            1.3 kB
3b/mlx/qwen_2_5_3b_mlx_int4.pte               2.1 GB
3b/xnnpack/config.json                        2.3 kB
3b/xnnpack/qwen_2_5_3b_xnnpack_8da4w.pte      1.9 GB
3b/xnnpack/qwen_2_5_3b_xnnpack_bf16.pte       5.8 GB
config.json                                   30 B
tokenizer.json                                6.7 MB
tokenizer_config.json                         7.1 kB

Compatibility

These files are published for the ExecuTorch v1.4.1 runtime. ExecuTorch gives no forward compatibility guarantee, so an older runtime may fail to load them.

To use them in React Native ExecuTorch, pass the model constant shipped in the library's model registry to the corresponding task pipeline. See the documentation.

To load these files in your own ExecuTorch runtime, read the compatibility note first.