Language中文

Theme

locuslab/base-smollm2-1.7b-score0_mix_rephrase123_with_mild_refusal45_metadata_5p-600B-step-180000 · Pirate Face

Saved model catalog

L

locuslab/base-smollm2-1.7b-score0_mix_rephrase123_with_mild_refusal45_metadata_5p-600B-step-180000

Model record retainedHugging Face didn't answer

Saved file metadata (7 files)

Historical source metadata, not copies of the files. A checksum does not establish current availability.

pytorch_model.bin
0f08e69263bb7f006097bdce3a6d0a1e3ef3956e11efd616940f21a2d015fedf

tokenizer.json
SHA-256 not recorded

tokenizer_config.json
SHA-256 not recorded

.gitattributes
SHA-256 not recorded

README.md
SHA-256 not recorded

config.json
SHA-256 not recorded

generation_config.json
SHA-256 not recorded

Saved model card (historical)

SmolLM2 score0_mix_rephrase123_with_mild_refusal45_metadata_5p-600B-step-180000 (Version: main)

Model Details

Architecture: SmolLM2
Parameters: 1.7B

Training Configuration

optimizer:
  class_path: torch.optim.AdamW
  init_args:
    lr: 0.0005
    weight_decay: 0.01
precision: bf16-mixed
seed: 42
train:
  global_batch_size: 1024
  max_seq_length: 2048
  max_tokens: 600000000000
  micro_batch_size: 8

Model Loading and Revision System

This repository hosts multiple revisions of the model. To load a specific revision, use the revision parameter. For example:

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("locuslab/score0_mix_rephrase123_with_mild_refusal45_metadata_5p-600B-step-180000", revision="final")
tokenizer = AutoTokenizer.from_pretrained("locuslab/score0_mix_rephrase123_with_mild_refusal45_metadata_5p-600B-step-180000", revision="final")

Replace "final" with the desired revision.

Model discussions

Share what you know. Help others. Build trust.

Loading comments...

Keep it about the model. No spam, scams or personal attacks. Links are not allowed in comments or replies. Comment policy