Needle 3

An on-device model for tool calling, structured extraction and text embeddings. See the Needle website for model details, benchmarks and the browser demo.

Get started

pip install -U cactus-compute

import cactus

@cactus.tool
def get_weather(city: str):
    "Get the current weather for a city."
    return {"city": city, "temp_c": 27, "sky": "clear"}

with cactus.Cactus(tools=[get_weather]) as agent:
    print(agent.run("What's the weather in Lagos?")["results"])

The package downloads and caches the engine and weights on first use. This repository provides needle3.cact and checkpoints/needle3.safetensors. Runtime binaries and supported platforms live in the Cactus repository.

Guides

• Python API
• Designing tools and structured extraction
• Fine-tuning
• Source code