This is a simple experiment using geman ORPO training for one epoch using qlora and unsloth on Vezora/Mistral-22B-v0.2
