Queen v1.5 “hatchling” — Crawlnet

A small language model trained from scratch. Pretraining data and tokenizer: only pages the Crawlnet crawlers read on the crypto web (real browsers). No pretrained weights, no FineWeb, no other corpus. Chat tuning: question/answer pairs generated by deepseek-flash from those crawler pages (details below). Expect a dumb, funny, confidently-wrong model; that is the point.

Queen v1.5 is Queen v1 chat-tuned again: the same pretrained v1 weights, tokenizer and dataset; only the chat tuning is new (see What changed vs v1).

What changed vs v1

• Same pretrained v1 base model, tokenizer and pretraining dataset as Queen v1; only the chat tuning (SFT) is new.
• Chat-tuned again on the full crawl: 97,726 question/answer pairs generated from crawler pages, plus 80,471 open-book conversations (each pair again, with the crawl text it was written from in front of the question), so she answers from the pages retrieved for a question, the way the site serves her.
• blind A/B (v1 and v1.5 answering the same questions, compared without knowing which model wrote which): v1.5 better 81 times, v1 better 16 times.
• LLM-graded questions, with retrieved pages (the fixed questions of queen_train/judge_questions.json, each answered with the 2 pages retrieval finds for it, graded by an external LLM): mean correctness 0.26 -> 0.83 (of 2), about 3x; on topic 50% -> 89%.

Base: Crawlnet/queen-v1 (Queen v1, the same pretraining dataset: manifest sha256 1258202cf03b6202c5c69112d5a82a34ac6d9d3cb9175fb92282ff4ebea64e32). The version number stays 1: v1.5 is v1 chat-tuned again, not a new step of the ladder.

Contributors

Queen v1.5 was trained on pages found by these crawlers. Owners spawned theirs by burning $CRAWLNET; the wallets are the ones that made the burn, public on-chain.

Pages and tokens count what made it into this version's dataset after cleaning and dedupe. Machine-readable: contributors.json.

What went in besides crawler pages

• The nanochat training code, architecture and hyperparameter rules (no weights, no data).
• Six hand-written question templates used to turn page headings into questions (see SFT above).
• Chat-tuning question/answer pairs generated by deepseek-flash from crawler pages (see SFT above).
• Nothing else. nanochat's default SFT mixture (SmolTalk, MMLU, GSM8K) and its CORE eval were switched off.

What it says

Fixed prompts, seeded sampling (temperature 0.7, top-k 50), unedited:

What is Bitcoin?

Bitcoin is a digital money market where you can be traded, transferred, or accessed by anyone. This means you can take your money by buying it, and you can trade it for the cryptocurrencies you’re earning with it.

Who created Bitcoin?

Bitcoin was created by Satoshi Nakamoto, a founder of Bitcoin. He was the first Bitcoin software developer on the Internet.

What is a blockchain?

A blockchain is a decentralized database secured by blockchain technology that powers cryptocurrencies and manages decentralized applications. It aims to reduce the number of independent blockchain networks, as well as decentralized applications like Bitcoin, Ethereum, and Solana.

Explain proof of work.

The proof of work consensus, but that’s a proof of work. Ethereum transitioned to proof of work, with Proof of work [..n]) to follow the same proof. Since Ethereum has a proof-of-work system, it has become the most secure and proof of work, and it’s important to keep the average work of it. But as mentioned, this is the most secure form of proof of work. That’s a very important requirement for Ethereum to exist.

Explain proof of stake.

Proof of stake is a mechanism that allows an operator to run validators in a specific manner based on the amount of stake that they will be able to make a unilateral decision by the operator to be able to prove that the amount of stake that they will be in the sortition pool based on the stake in the sortition pool. The stake of the network is divided into blocks, with the total stake that it will be added to the chain after it has voted for it.

What is Ethereum?

In September, Ethereum introduced the concept of decentralized digital currency (DV.) and Ether (ETH) as an alternative to traditional financial apps. It was created by Vitalik Buterin on 2014-11-15 by Buterin on 15 April 2013.

What is a smart contract?

A smart contract is a way of building an application for a decentralized application, called a smart contract. It allows users to interact with smart contracts and interact with applications via smart contracts.

What is gas on Ethereum?

Gas is the unit of measure for transaction success. It is a measure of how the network processes transactions on the Ethereum network and how it handles its computational effort.

What is Solana?

Solana is a global digital world that launched in 2015, a globally distributed network of computers. It was created to solve the problems around the world they’re designed to be censorship-resistant, secure, and decentralized.

Why is Solana fast?

Solana is fast, so it lets you build app and side apps without managing billions of users' devices. Solana is designed for builders, vaults, and products that support dApps using Solana’s infrastructure.

Use it

chat.py in this folder needs only karpathy/nanochat (MIT) at the commit above:

pip install torch tiktoken safetensors
git clone https://github.com/karpathy/nanochat && git -C nanochat checkout 92d63d4e8bb4
PYTHONPATH=nanochat python chat.py "What is staking?"

Or load it yourself: config.json has the nanochat GPTConfig; build nanochat.gpt.GPT, load model.safetensors; the tokenizer is tokenizer.tiktoken (tiktoken rank file) + the pattern and special tokens in tokenizer.json. Chat format: <|bos|><|user_start|>...<|user_end|><|assistant_start|>.

Limitations

Tiny model, narrow data. It makes things up, including prices, dates, addresses and links. It is not financial advice and must not be used as a source of facts.