Loading…
Loading…
This is an intent classification model fine-tuned for automotive domain routing to MCP (Model Context Protocol) servers. The model efficiently routes user queries to appropriate services with ~10ms inference time.
This model is designed to route user queries in automotive applications to appropriate MCP servers based on intent classification. It replaces generic LLM routing with fast, specialized classification.
Primary Use Cases:
The model can classify the following intents:
diagnostic_engineknowledge_generalmaintenance_scheduleparts_searchThe model routes intents to the following MCP servers:
diagnostic_enginemaintenance_scheduleknowledge_generalparts_searchfrom transformers import AutoTokenizer, AutoModel
import torch
import json
# Load model and tokenizer
tokenizer = AutoTokenizer.from_pretrained("IntentRouter/informant-67M-automotive")
# Load custom classifier (you'll need the IntentClassifier class)
# See: https://github.com/your-org/intent-router
# Load model configuration
with open("model_config.json", "r") as f:
config = json.load(f)
label_to_id = config["labels"]["label_to_id"]
id_to_label = config["labels"]["id_to_label"]
# Predict intent
def predict_intent(text):
inputs = tokenizer(text, return_tensors="pt", truncation=True, max_length=128)
with torch.no_grad():
outputs = model(**inputs)
predictions = torch.softmax(outputs.logits, dim=-1)
predicted_id = torch.argmax(predictions, dim=-1).item()
confidence = predictions[0][predicted_id].item()
intent = id_to_label[str(predicted_id)]
return intent, confidence
# Example usage
intent, confidence = predict_intent("My engine is making strange noises")
print(f"Intent: {intent} (confidence: {confidence:.3f})")
# Install the intent router system
git clone https://github.com/your-org/intent-router
cd intent-router
# Use the model
python intent_inference.py \
--model-id IntentRouter/informant-67M-automotive \
--text "Your query here" \
--confidence
# Start API server
python intent_inference.py \
--model-id IntentRouter/informant-67M-automotive \
--serve --port 8000
# Single prediction
curl -X POST "http://localhost:8000/predict" \
-H "Content-Type: application/json" \
-d '{"text": "Your query here", "return_confidence": true}'
# Batch prediction
curl -X POST "http://localhost:8000/predict/batch" \
-H "Content-Type: application/json" \
-d '{"texts": ["Query 1", "Query 2"], "return_confidence": true}'
| Metric | Value |
|---|---|
| Validation Accuracy | 93.3% |
| Parameters | 0.0M |
| Inference Time | ~10-20ms |
| Memory Usage | ~200MB |
This model uses a standard transformer encoder with a classification head:
@misc{IntentRouter_informant_67M_automotive,
title={IntentRouter/informant-67M-automotive: Intent Classification for Automotive MCP Routing},
author={Intent Router System},
year={2025},
howpublished={\url{https://huggingface.co/IntentRouter/informant-67M-automotive}},
note={Fine-tuned distilbert-base-uncased for intent classification}
}
This model is released under the MIT License. See LICENSE for more details.
For questions about this model, please open an issue in the Intent Router repository.
distilbert/distilbert-base-uncased