Palette: New Series of Small Model Creative Distills With Only The Best Teachers!
Quick Overview: What is Palette-RP-1.2B-2609-Instruct-v0.5?
A lightweight experimental project performed on LFM2.5 1.2B Instruct, teached on Hy4 Preview RP chatlogs, nearly same methodology as Palette 4B.
Development for larger, higher quality dataset that will likely be based on the Hy4 as well is still in progress, it requiers significant investments and I plan to finish it in mid October if everything goes right.
Additional information to anybody wants to financially support me and my activity(I already began saving up for the next project):
Solana | EeQMECL51LHoKnpFybjSafpgjBrHyzUcWuo6Z6NEQLHc
Ethereum | 0xb95fe88e4de47fcd120f66a1a27e1e3ee6b8e157
Boosty(Non-Crypto) | https://boosty.to/Indexnusrefather