Supra2-100M Instruct

Instruct model of Supra2-100M • 100M Parameters • 2K Context

Supra2-100M Instruct is a 100M-parameter decoder-only language model pretrained from scratch by SupraLabs on 30B tokens of English web text. It uses the Qwen3 architecture with a custom 32,768-token tokenizer. This is the instruct version of Supra2-100M Base and it was full-finetuned on a single RTX 5060 Ti 16GB.

---

Some samples...

1. AI Definition

Prompt: "What is AI?"
Answer:

AI refers to the application of computer science and artificial intelligence to solve problems and make decisions. It's a field that combines computer science, machine learning, and natural language processing to create new forms of intelligence, such as natural language understanding, speech recognition, and virtual assistants.

AI is used in various fields, including healthcare, finance, education, and social sciences, to improve efficiency, reduce costs, and enhance human performance. It can also be applied to areas like robotics, artificial intelligence, and cybersecurity. In the context of AI, it's often used to analyze vast amounts of data, identify patterns, and make predictions. For example, in natural language analysis, AI can help humans understand and interpret language, such that they can make more accurate and informed decisions. The field of AI is constantly evolving, with new technologies emerging and being developed to address specific challenges. Some examples include:

Artificial intelligence (AI) is being used in robotics, where it can learn from human movement and adapt to changing environments. AI-powered virtual assistants, such virtual assistants that can help users interact with machines, such Aspire and Alexa, are being developed. Artificially intelligent vehicles, such vehicles that can learn and adapt based on user input, are also being developed, such cars and trucks. Smart home systems, such smart thermostats and smart lighting, are becoming increasingly sophisticated and integrated into homes. Autonomous vehicles, like autonomous cars and drones, are increasingly used in urban areas and in remote areas. These are just a few examples, but the field of artificial intelligence is constantly expanding and evolving, and AI is being applied to a wide range of applications.

Followup prompt: "Can you give me more information about how it will influence work life?"
--> Answer:

The impact of AI on work life will depend on several factors, including the type of work, the level of automation, and the level and type of tasks being performed. Here are some key aspects to consider: Tasks being performed:

• Work-life balance: Will AI-driven tasks lead to increased productivity, creativity, and overall well-being?
• Machine learning algorithms*: How will AI-powered algorithms adapt to new situations and tasks?

Level of automation: Can AI-generated tasks be automated, and will they be more effective than manual labor? *** Robustness: Are there any potential risks or downsides to AI-based tasks, such tasks that require human judgment or expertise?

• Sensor and analytics: What are the potential risks and benefits of AI-assisted tasks, and how will they impact work-life balances? *** Automation: Does AI-led automation have the potential to automate repetitive tasks, improve workflows, and reduce errors?
• Competition for jobs: Is there a significant gap between the demand for AI-related jobs and the supply of skilled workers? By incorporating AI into work, we can create more efficient, effective, and sustainable work environments. This can lead to improved employee well-Being, reduced stress, and increased productivity.

Followup prompt: "Thank you."
--> Answer:

I'm glad I could help. I'd be happy to help you with any questions or concerns you may have. Please go ahead and share your work, and I'll do my best to assist you in understanding the implications of AI in your work.

2. What is Google

Prompt: "What is google?"
Answer:

Google is a web-based platform that allows users to search and find information on the web. It's a social media platform that uses algorithms to make recommendations based on various factors such as location, time of day, and interests.

Google has a number of features that make it easy to find information, including:

• Searching for keywords and phrases related to various topics, like books, movies, or music
• Analyzing website traffic and traffic patterns
• Creating a custom search interface
• Suggesting alternative ways to find the information
• Providing recommendations for books, articles, and other content
• Allowing users to customize the search results

One of the main advantages of Google is that it's easy to use, as users can search for the information they need, and then filter the results based on their interests. This makes it accessible to a wider audience.

Followup prompt: "How does the traffic analyzation work?"
--> Answer:

The traffic analysis process involves several steps to understand the flow of traffic to and from the website. Here's a breakdown of the steps involved:

1. Searching: Users will typically use a browser to search for relevant websites. The site will be crawled by a server and the results will be displayed in a search box.

2. Scheduling: The website will be scheduled to run on the client machine, which is usually a mobile device like a tablet or smartphone. The system will generate a list of potential candidates and will then prioritize them based on criteria such as relevance, interest, and user engagement.

3. Optimization: Once the data is analyzed, it will be aggregated into a map that showcases the most popular pages, pages with the highest traffic, and the most traffic-related pages. This will give the website an idea of the traffic patterns and help the user make informed decisions about the search.

4. Marketing: This is where the website will showcase the results of the analysis. The company will provide a marketing strategy that includes targeted ads, sponsored content, and content that resonates with the target audience.

5. Reach and Optimization (R&O): The company uses R&O to optimize the traffic by optimizing the search engines, optimizing page views, and optimizing other relevant factors such Google, Facebook, and Twitter.

6. Analysis: After the analysis, the website's traffic analysis will be revealed. This is the final step in understanding the traffic flow and identifying areas for improvement.

7. Prediction and Optimizations (P&O)**: P&O is the actual decision-making process for the website to optimize its traffic, optimize its search engine optimization, and optimize its user experience.

8. Final Analysis: At this point, the user may have a general idea of what the website is trying to achieve, but it's essential to consider the specific needs and interests of the user, as well as any relevant external factors that might affect their experience.

3. Fast Food Pros and Cons

Prompt: "Give me pros and contras for eating fast food."
Answer:

The concept of fast food is a staple in our lives, but it's not the only thing that comes to mind when we think about eating fast. Here are some pros and cons to consider:

Fast food is often high in calories, fat, and sodium, which can lead to weight gain and other health issues. It also requires a lot of energy and nutrients to fuel the meal. For example, a meal that's fast can be high in saturated fat, cholesterol, and sugar, which may contribute to weight problems.

Additionally, fast food can be unhealthy for your body if not consumed in moderation. Some people may have a hard time maintaining healthy eating habits due to their busy schedules or lack of exercise. This can lead them to eat fast food excessively, which might cause a negative impact on their physical health. It's also important to consider the nutritional value of fast foods. The high sugar content can make them taste bad, while the saturated fat and cholesterol can lead you to have higher cholesterol levels. Additionally to the environmental impact, fast foods can be highly convenient and convenient for people who can't cook or have limited access to cooking skills. However, it's also true that the high calorie count and low nutritional value make them unhealthy for some people. Lastly, it is essential to remember that fast food and unhealthy eating habits are not the same thing. While they share some similarities, they differ in how they interact with food, portion sizes, and food preparation. Would you like to explore some of these pros and con options further?

Followup prompt: "Sure!"
--> Answer:

I'm glad I could help! Here's a brief explanation of some of the pros and conciseness of each pros andcon:

• Fast food: Fast food refers to the type of food that requires immediate attention to control, flavor, and presentation. Examples include fast food restaurants, burgers, fries, salads, and sandwiches.
• Contraception: Contraceptive pills or contraceptives are usually used to prevent pregnancy or to treat a woman's menstrual cycle. Examples of contraceptors include birth control pills, diaphragm implants, and intrauterine devices (IUD).
• Weight loss: Reducing the number of calories, fats, and carbohydrates in a meal can help to reduce weight and maintain a healthy lifestyle. Examples are diet plans, weight loss diets, and nutrition programs. I hope this helps! If you have any further questions or would like to discuss these pros or con options, feel free to ask!

Followup prompt: "I don't have any questions."
--> Answer:

You're welcome! I hope this helped. If you're still having trouble understanding something, feelfree to ask 📋.

4. History time: 2nd World War

Prompt: "Why did the 2. World War start?"
Answer:

The start of World War II was a pivotal moment in human history, marking the beginning of a new era of conflict and revolution. The United States entered the war on September 11, 1941, with the declaration of war by President Franklin D. Roosevelt. The war was a direct result of the Japanese attack on Pearl Harbor, which occurred on December 7, 2001.

The United States had been a major player in the war, with its involvement in several key battles, including the Battle of Britain, the Battle for France, and the Battle Of Normandy. The U.S. had also been involved in several other conflicts, including Korea, Vietnam, and Afghanistan. The war was also marked by the rise of fascism, which sought to overthrow the government of Italy and establish a fascist regime. The Italian Fascist Party, led by Benito Mussolini, was a fascistic party that sought to rule Italy through fascist means. In addition to the war itself, the United States also played a significant role in the development of the atomic bomb, which was developed during the war. The atomic bomb was a device used to create a massive explosion that would destroy the entire world. Throughout the war and beyond, the U. S. military played a crucial role in shaping the course of history. It played a key role in establishing the United Nations, creating the United Kingdom, and establishing the UNAVCO (United Nations Assistance Committee) as a global organization. Overall, the war was an pivotal moment that marked the beginning and end of the United State's involvement in the world's most important conflict.

5. Creative story writing

Prompt: "Write a story about a little red robot exploring the world."
Answer:

The little red boy, named "Mara," was a little boy who had always been fascinated by the world around him. He was always fascinated by everything, from the way the sun shone through the trees to the way people moved around. He loved to play with his friends and play with the toys he had. He would often sit on the floor and play in the corner of the room, watching the world go by.

One day, when he was about to play in a park, he saw a big red ball that was going to be his favorite toy. He ran over to it and took it out of his hand. He put it in his pocket and called out to his friends. "Mama, what's this?" he asked. "It's a ball," one of his friends said. "It's going to make you happy." "That's right," Mama replied. "I'll give it to you." Mama gave it to her friend and said, "You're going to love it."

Mara was thrilled. He had always wanted to play the ball, but he had always thought it was too big for him. But when he saw the big red boy's toy, he knew he had to find something else. He decided to make a new toy. Maria made a big mess of it. She put it away in the back of her closet. She had a big box of toys, and she had a lot of them. Mama had to make sure that the toy was safe and that it was not too big. When Mama made the toy safe, she put it back in the box. Mamma had to put it on the shelf. Mommy had to take it out and put it into the box so that it could be put back in. Maddy had to do the same thing. Momma had to keep the toy in the safe. Finally, Mama put the toy back in its safe. Mummy had to leave the safe behind. Mum had to go to the store and buy some more toys. Mango had to buy some toys. After that, Maddy and Mommas had to get rid of the safe and put the toys back in their safe. They had to be careful not to put the safe in the wrong place. Mmmmm! Mummy and Mango were happy. Muddy Mummy was happy. The big red robot had been happy. He knew that he had

6. Albert Einstein

Prompt: "Who was Albert Einstein and what was he famous for?"
Answer:

Albert Einstein was a German physicist who was born on July 15, 1879, in Berlin, Germany. He was the third child of a prominent family of scientists, including his father, Ernst, and his mother, Sophia. Albert Einstein was the youngest of three children, and he was the only child of his parents. He studied physics at the University of Berlin and later at the Technical University of Munich, where he earned a degree in mathematics.

In 1905, Einstein was awarded the Nobel Prize in Physics for his work on the theory of relativity. He also made significant contributions to the field of physics, particularly in the field known as quantum mechanics. His work on general relativity, which deals with the motion of objects in space and time, was a major breakthrough in our understanding of the universe.

7. Harry Potter

Prompt: "Who is Harry Potter?"
Answer:

Harry Potter is a fictional character from the Harry Potter series of books written by J.K. Rowling and published by Random House. He is a member of the Hogwarts School of Witchcraft and Wizardry, and is a wizard who has been a part of the Harry family for generations. He was born on February 15, 1981, in London, England, and has been an avid reader and writer since he was a young boy.

Harry is a brilliant and enigmatic character, with a deep understanding of magic and wizarding history. He has a unique perspective on the world, and his magical abilities have captivated readers for centuries. Harry is often referred to as the "Witch of Hogwart" due to his magical prowess and the fact that he is a wanderer who has wandered into the magical world.

8. Microsoft Products

Prompt: "Can you name the top three products of Microsoft?"
Answer:

1. Microsoft Office 365
2. Microsoft Excel
3. Microsoft Word

Would you like me to write another one?

9. WiFi Problem Troubleshooting

Prompt: "Why does my WiFi keeps disconnecting?"
Answer:

The issue with your WiFi is likely due to a problem with the network. The problem lies in the way your router connects to the internet. When you connect to the network, it sends a signal to the router, which then sends a packet to the other devices on the network that are connected to the same internet. This packet is then sent to the device on the other end of the connection, which is the internet, and then to the devices on your network.

When your router disconnects, it's essentially sending a packet back to the original device, which can cause problems for your internet connection. This can happen when you're using a device that's connected to a different internet connection, such as a laptop or a phone, which may not be able to communicate with the internet as effectively. In some cases, this can even lead to a temporary disconnection, but it's usually a temporary issue that can be resolved by re-connecting the device to the main internet connection and re-establishing the connection. It's worth noting that if you're experiencing a problem like this, it might be worth investigating the cause of the disconnection. It's possible that the problem is related to the way the router connects, or that there are other issues that need to be addressed before you can reconnect the internet to your devices.

10. Poem about the sea

Prompt: "Write a poem about the sea."
Answer:

The sea is a place of wonder, Where the waves lash and the waves break, The waves are like a gentle breeze, And the sea is full of life, A place where the tides roll and the sun shines.

The sky is a deep blue, With stars that dance across the sky, As if the sky itself were a canvas, Of endless beauty and wonder. The ocean is a vast expanse, Which stretches out before us, Like a vast, endless sea, That stretches out to the horizon.

11. Love

Prompt: "What is love?"
Answer:

Love is a universal concept that has been around for centuries, yet it has been misunderstood and misinterpreted. Love is a complex and multifaceted emotion that can be both positive and negative. It can be described as a feeling of connection, acceptance, and acceptance, but it can also be a feeling that is not always present or present-focused.

Love can manifest in various ways, such as feelings of warmth, comfort, and closeness, or it can be a more introspective and subjective experience. Some people may feel a sense of connection to their loved one, while others may feel an absence of love. It's worth noting that love is often associated with feelings of love, which can be subjective and can be influenced by various factors, such a personal connection or a shared experience. However, love is not a fixed or exclusive emotion, but rather a dynamic and evolving experience that can evolve over time. In the context of love and love, it's essential to recognize that love can be an emotional journey, and it can take many forms, such love can manifest as a sense, a feeling, or a combination of both.

---

Supervised Finetuning Data

Total tokens: ~300M

---

Usage

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

REPO_ID = "SupraLabs/Supra2-100M-Instruct"
device = "cuda" if torch.cuda.is_available() else "cpu"

print(f"[*] Loading model and tokenizer from Hub: {REPO_ID}...")

# 2. Load Tokenizer & Model
tokenizer = AutoTokenizer.from_pretrained(
    REPO_ID, 
    trust_remote_code=True
)

model = AutoModelForCausalLM.from_pretrained(
    REPO_ID,
    torch_dtype=torch.bfloat16 if torch.cuda.is_available() else torch.float32,
    device_map="auto" if torch.cuda.is_available() else None,
    trust_remote_code=True
)

model.eval()

messages = [
    {"role": "user", "content": "What is AI?"}
]

prompt_text = tokenizer.apply_chat_template(
    messages, 
    tokenize=False, 
    add_generation_prompt=True
)

inputs = tokenizer(prompt_text, return_tensors="pt").to(device)

print("[*] Generating response...\n")

with torch.no_grad():
    output_ids = model.generate(
        **inputs,
        max_new_tokens=512,
        do_sample=True,
        temperature=0.2,
        top_p=0.85,
        top_k=25,
        no_repeat_ngram_size=3,
        pad_token_id=tokenizer.pad_token_id,
        eos_token_id=tokenizer.eos_token_id
    )

# Extract only the newly generated tokens (omit the input prompt)
generated_tokens = output_ids[0][inputs["input_ids"].shape[-1]:]
response = tokenizer.decode(generated_tokens, skip_special_tokens=True)

print("--- Output ---")
print(response)

Chat Template notes

The tokenizer ships with a ChatML template and reserved special tokens (<|im_start|>, <|im_end|>, <think>, <tool_call>, <|reserved_0..15|>, …).
The chat template is:

{% for m in messages %}<|im_start|>{{ m['role'] }}
{{ m['content'] }}<|im_end|>
{% endfor %}{% if add_generation_prompt %}<|im_start|>assistant
{% endif %}

---

Intended Use

Intended:

• Research on small-scale pretraining, scaling behavior, and data mixtures
• Usage for basic chat
• Educational use, ablations, and fast iteration on limited hardware

Not intended:

• Any production or user-facing deployment
• Factual question answering, advice, or decision support
• Non-English text (essentially untrained; only supports english!)

---

Limitations and Bias

• Small. At 100M parameters, factual recall, reasoning, arithmetic, and long-range coherence are weak. Expect frequent hallucination and topic drift.
• Short context. Trained exclusively at 1,024 tokens. The config allows 2,048, but extrapolation beyond 1,024 is untested and likely degraded.
• No document masking. Attention could cross document boundaries within a packed chunk, which slightly blurs document independence.
• English only.

---

© SupraLabs 2026