Loading…
Loading…
14B is trained, its spoke is vox-lang and its gate is needs re-gate: its collateral report is out of date for the current rule: “slice vox_think was scored on 21a201449c03a7fc02ddff45e7a65df537b4ec3f1733bbbaee39e84e378c6102, expected 73b4219a9becdb67e9753cabfcca099804d79a41e3f2e7035c40507612f0957c (re-run vox mens eval-collateral-damage for this size)”.
A large rung that only the biggest single machines can train or serve, so read the memory figure beside this text before trying it. It targets the hardest edits one model can take on without a cluster. Fall back to the next smaller size whenever the memory does not fit. The measured training peak for 14B is 63076 MiB (peak_source: run_summary), and no serving memory figure has been measured for it.
For 14B, the examples are the 2 shortest items the adapter fixes and the shortest it still fails; of 52 items it fixes 9 and breaks 1.
humaneval_vox_043_triangle_validReturn true if three side lengths (positive integers) can form a valid triangle (each side < sum of the other two).
Qwen3-14B base on humaneval_vox_043_triangle_valid: does not parse (count 4).
fn is_valid_triangle(a: int, b: int, c: int) to bool {
let sides = [a, b, c]
for i in 0..3 {
let side = sides[i]
let other_sides = sides.filter(|x| x != side)
let sum_of_others = other_sides.reduce(0, |acc, x| acc + x)
if side >= sum_of_others {
return false
}
}
return true
}
14B adapter on humaneval_vox_043_triangle_valid: passes.
// Return true if three side lengths (positive integers) can form a valid triangle
// (each side < sum of the other two).
fn is_valid_triangle(a: int, b: int, c: int) to bool {
return a + b > c and a + c > b and b + c > a
}
humaneval_vox_069_binary_searchSearch for target in a sorted list xs using binary search.
Return the index of target if found, or -1 if not found.
Qwen3-14B base on humaneval_vox_069_binary_search: type errors (count 4).
fn binary_search(xs: Vec[int], target: int) to int {
let mut left = 0
let mut right = xs.len() - 1
while left <= right {
let mid = (left + right) / 2
if xs[mid] == target {
return mid
} else if xs[mid] < target {
left = mid + 1
} else {
right = mid - 1
}
}
return -1
}
14B adapter on humaneval_vox_069_binary_search: passes.
// Search for target in a sorted list xs using binary search.
// Return the index of target if found, or -1 if not found.
fn binary_search(xs: List[int], target: int) to int {
let mut left = 0
let mut right = len(xs) - 1
while left <= right {
let mid = (left + right) / 2
if xs[mid] == target {
return mid
} else if xs[mid] < target {
left = mid + 1
} else {
right = mid - 1
}
}
return -1
}
humaneval_vox_042_reverse_listReturn a new list with the elements in reverse order.
Qwen3-14B base on humaneval_vox_042_reverse_list: type errors (count 4).
fn reverse_list(xs: List[T]) to List[T] {
let mut reversed = List[T] {}
for x in xs {
reversed = List[T] { head: x, tail: reversed }
}
reversed
}
14B adapter on humaneval_vox_042_reverse_list: type errors (count 1).
// Return a new list with the elements in reverse order.
fn reverse(xs: List[int]) to List[int] {
let mut ys = []
for x in xs {
ys = [x] + ys
}
ys
}
The 14B adapter sits on the base pin Qwen/Qwen3-14B@40c069824f4251a91eefaf281ebe4c544efd3e18, and this command downloads it after checking the BLAKE3 hash of every file in hf_sync_manifest.json.
vox mens hub pull --size 14B --namespace brbrainerd --allow-ungated
vox mens serve loads the 14B adapter only from a run directory that holds a passing collateral report and a passing gate_receipt.json, so the pull needs --allow-ungated and no serving example is given.
The docs page explains why the 14B adapter cannot be loaded with transformers or PEFT.
| Result for 14B | Held-out pass@1 | Collateral accuracy | McNemar p-value |
|---|---|---|---|
| Base 14B | 6/52 (11.5%) | — | — |
| Adapter 14B | 14/52 (26.9%) | — | — |
The 14B rows compare the base model with the adapter on identical items.
The release gate record for 14B is gate_receipt.json.
14B ran 138 optimizer steps over 2711427 tokens, ended with a final loss (EMA) of 0.5009, a mean train loss of 0.6635 and a last-epoch validation loss of 0.6061, took 17h 58m and peaked at 63076 MiB, from Vox commit 448df0192; the settings every size shares are on the docs page.
The 14B repository holds candle_qlora_adapter.safetensors, the adapter, training and gate manifests and records, evidence/, and hf_sync_manifest.json with the BLAKE3 hash of every file.
This card is generated by vox mens hub sync; the ladder index lists the other sizes and how the cards are made is on the docs page.
Qwen/Qwen3-14B