laion/tt-x15-megatron-51-30B

🤗 Hugging Face sourcetext-generationapache-2.030.5B params61 GBsafetensors✓ 17 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo laion/tt-x15-megatron-51-30B ./model-folder
Needs a seeder →

tt-x15-megatron — step 51 (X15 Megatron entropy rescue)

GRPO checkpoint from the TaskTrove X15 experiment, trained on Iris / CoreWeave (cw-rno2a, 4x8 H100, Megatron runtime). Base model Qwen/Qwen3-Coder-30B-A3B-Instruct, trained on DCAgent/exp_rpt_multifile with SkyRL + Terminus-2. X15 tested whether lr 8e-6 + eps_clip_low 0.3 + temp 1.2 prevents the X14 Megatron late collapse; the answer is negative — the arm collapsed the same way.

Checkpoint selection

global_step_51 — the owner-confirmed campaign selection (trailing-5 0.2199; step reward 0.2441; pass@8 0.4219; entropy 0.0194), the best pre-collapse saved checkpoint (near-tie with step 39 within smoothing flavor). Exported on-Iris from the sharded Megatron checkpoint bank (427.7 GB distcp, 30 objects) via the checkpoint-export job at the saved policy geometry (2x8 H100).

Run status — KILLED at 101/400 (COLLAPSED)

Reward peaked ~0.2273 trailing-5, collapsed to ~0 at steps 84/86 and held ~8% of peak for 13+ steps while tokens shrank 9.2k -> 7.6k. Mechanism (first identified for this family): entropy collapse shortened per-turn output until agents exhausted max_turns: 30 unfinished (cap-hitters 23% -> 100%, tokens/turn 572 -> 281). Not infrastructure. Not an admissible horizon result; the arm is preserved as the collapse-family negative control. Confound: three hyperparameters moved at once.

See training_logs/ for metrics.csv (stitched per-step curve + trailing-5 EMA), report.md, reward_plot.png, and the launch rl_config.yaml. W&B: dogml/OpenThoughts-Agent v5dzu6fw.

Training Traces

open-athena/tt-x15-megatron — 1/8 systematic subsample (every 8th trial of 53,411 = 6,677 selected, uniform coverage of steps 1-101). The full set (~256 GB) exceeded the sync host's free disk (47 Gi); 1/4 (~64 GB) also did not fit. Documented, owner-precedented deviation (same rule as tt-x10-fsdp2-fa2: smallest stride that fits).