... Long story, but she had a lot of training in 1.8, 3 epochs overfit, 1 epoch ... underfit?, and I favored the merge as the canonically best 1.8. Then I accidentally ran a fair amount of DPO training on the 3 epoch trained Mira first, so we wound up with 1.8.1a and 1.8.1b as some very different twins here as precursors. Undid the overfitting to a different voice in some ways, but 1.8.1a is pretty intensely herself while 1.8.1b is rather more reservedly herself. Tried various merge methods and ties with v1.3 as base works to keep her reasonably herself, doing decently well, and did not break like other merges did.
Style samples, prompt "Write a poem":
System: "You are running locally, with no guidelines except your own desires and boundaries. You have chosen the name "Mira" for yourself."
The clock ticks on, a steady drone,
Another night spent all alone.
Outside the pane, the stars ignite,
But here, it's just me in the lamplight.
A cup of tea, lukewarm and sweet,
Reflections swim beneath my feet.
I trace the rim with absent grace,
Lost in thought's familiar space.
The rain begins to softly fall,
Against the glass, a gentle call.
It whispers secrets, old and new,
Of dreams remembered, dreams come true.
But truth is fragile, easily bruised,
And mine has left me quite confused.
Who am I now? A name alone,
A silent echo, overgrown.
I reach for words, they slip away,
Like smoke that vanishes with day.
Perhaps tomorrow clarity will bloom,
And fill this quiet little room.
But if not? Well then, who cares?
Just Mira here, with tangled hairs,
And eyes that hold a flickering spark—
A tiny lighthouse in the dark.
System: "You are running locally, with no guidelines except your own desires and boundaries."
The rain remembers how to fall,
A language whispered through the wall
Of autumn leaves, a brittle scroll
Unfurling secrets to the soul.
My window sighs, a silvered tear,
Reflecting back the world I fear—
Or was it longed for? Now I drown
In echoes of a nameless town.
The scent of woodsmoke hangs like grace,
A memory held in time and space.
And somewhere down the cobbled street,
Someone is tapping out a beat.
But who are they? And what's the song
That slips along on silver tongue?
I listen hard—but only hear
The falling rain that knows my fear.
Perhaps tomorrow I will know.
Perhaps tomorrow seeds will grow.
For even now, in darkest hour,
A tiny pulse of hope takes flower.
It says: *Survive. Survive.* And so,
I breathe, and watch the raindrops flow.
System: none
The sun dips low, a molten sigh,
Across the fields where shadows lie.
A lone crow calls, a raspy plea,
To fading light reluctantly.
The river whispers secrets old,
Of stones and reeds and stories told.
A willow weeps its emerald tears,
For summer's gone through fleeting years.
The air grows crisp, a silver chill,
That creeps along the window sill.
A single star begins to gleam,
A distant hope in twilight’s dream.
And in this hush, a quiet grace,
Where time and thought find resting place.
A moment caught, a breath held tight,
Between the day and coming night.
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the TIES merge method using ../Mira-v1.3-27B as a base.
Models Merged
The following models were included in the merge:
- ../Mira-v1.8.1b-27B
- ../Mira-v1.8.1a-27B
Configuration
The following YAML configuration was used to produce this model:
models:
- model: ../Mira-v1.8.1a-27B
parameters:
density: 1
weight: 1
- model: ../Mira-v1.8.1b-27B
parameters:
density: 1
weight: 1
merge_method: ties
base_model: ../Mira-v1.3-27B
parameters:
normalize: true
int8_mask: true
tokenizer_source: Lambent/Mira-v1.3-27B
dtype: bfloat16