convaiinnovations/qwen-api-fastapi

🤗 Hugging Face 来源mit-other⚠ 没有 SHA-256 权重今天更新
一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对,然后提交。你只需开始做种,并粘贴你账户中的密钥。它只读取你的文件,绝不修改。如果愿意,可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo convaiinnovations/qwen-api-fastapi ./model-folder
需要做种者 →

Qwen FastAPI Inference API

This repository contains a secure, OpenAI-compatible REST API for the Qwen2.5-0.5B-Instruct model, built with FastAPI.

Features

  • OpenAI Compatible: Implements the /v1/chat/completions endpoint.
  • Secure: Uses JWT Authentication (HS256) for all inference requests.
  • Lightweight: Optimized to run on consumer hardware or free-tier cloud environments like Google Colab.

Structure

  • application.py: The main FastAPI server.
  • client.py: A test client to verify the API.
  • generate_token.py: Utility to generate JWT tokens for authentication.