EXL3 quants of Qwen3-VL-30B-A3B-Instruct
⚠️ Requires ExLlamaV3 v0.0.13 (or v0.0.12 dev branch)
Base bitrates:
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Optimized:
2.09 bits per weight
2.28 bits per weight
2.54 bits per weight
2.84 bits per weight
3.09 bits per weight
3.54 bits per weight
4.06 bits per weight
Benchmarks
| . | KL-div. | HumanEval @1 | MMLU¹ |
|---|---|---|---|
| 2.00 bpw | 0.245 | 84.75% | 80.00% ± 3.25% |
| 2.09 bpw | 0.176 | 87.20% | 83.33% ± 3.03% |
| 2.28 bpw | 0.124 | 87.20% | 83.33% ± 3.03% |
| 2.54 bpw | 0.109 | 89.02% | 86.67% ± 2.76% |
| 2.84 bpw | 0.069 | 90.85% | 86.67% ± 2.76% |
| 3.00 bpw | 0.055 | 88.41% | 86.00% ± 2.82% |
| 3.09 bpw | 0.039 | 89.63% | 86.67% ± 2.76% |
| 3.54 bpw | 0.026 | 89.03% | 86.67% ± 2.76% |
| 4.00 bpw | 0.016 | 90.24% | 85.33% ± 2.87% |
| 4.06 bpw | 0.014 | 89.63% | 87.33% ± 2.70% |
| 5.00 bpw | 0.008 | 92.07% | 88.00% ± 2.64% |
| 6.00 bpw | 0.004 | 90.85% | 86.67% ± 2.76% |
| (official) | N/A | 85.0% ² |
¹ 150 random samples with 95% CI
² 14k samples, presumably
SVG Catbench
| 2.00 bpw | 2.09 bpw | 2.28 bpw | 2.54 bpw |
| 2.84 bpw | 3.00 bpw | 3.09 bpw | 3.54 bpw |
| 4.00 bpw | 4.06 bpw | 5.00 bpw | 6.00 bpw |
| API |
Image captioning
2.00bpw This image shows a highly detailed and intricate piece of scientific equipment, likely a cryogenic apparatus or a quantum computing system. The device is composed of numerous components arranged in a layered, cylindrical structure.Key features include:
- A prominent, cylindrical white housing at the top, which likely serves as a vacuum chamber.
- A complex array of gold-colored and silver-colored components, including numerous rods and wires, arranged in multiple horizontal layers.
- A central column with a dense arrangement of electrical components, wiring, and possibly magnets or sensors.
- A large number of wires and cables, some coiled, are connected to various parts of the apparatus.
- The overall design suggests it is designed to operate at extremely low temperatures, possibly for cryogenic experiments or quantum computing.
Key features include:
- A large white dome at the top, likely a thermal radiation shield.
- Numerous vertical tubes and pipes, some appearing to be made of gold-colored metal, which are connected to the various levels.
- A dense network of wires and cables extending from the lower sections, indicating electrical connections.
- Components such as coils and small electronic modules are visible within the layers.
- The overall construction suggests a sophisticated system designed to maintain extremely low temperatures.
Key features include:
- A large, white cylindrical housing at the top.
- Numerous vertical metal rods, some gold-plated, that support the structure.
- Several horizontal platforms holding various components, including coils, sensors, and circuit boards.
- A dense network of wires and cables connecting the different parts.
- A central cylindrical element at the bottom, which appears to be a cryostat or a quantum processor module.
The overall design suggests a highly complex and precise piece of equipment, possibly used for research in quantum physics or advanced materials science.
2.54bpw This image shows a complex and intricate scientific instrument, likely a quantum computing processor or a specialized cryogenic system, suspended vertically against a plain white background.The device is composed of multiple concentric layers, resembling a tall, cylindrical tower. It features a combination of metallic components, including:
- Gold-plated structures: These are prominent on the horizontal support rings and the central shaft, likely for electrical conductivity and thermal stability.
- Silver or stainless steel components: Used for structural elements and the large cylindrical housing at the top.
- Numerous wires and cables: Connecting various parts, suggesting a complex electrical circuit.
- Copper coils: Visible in the upper section, possibly for heating or cooling.
- A central cylindrical chamber: Located in the lower section, which might house a quantum processor or sensor.
The overall design suggests it is engineered to operate at extremely low temperatures, as indicated by the cryogenic-like appearance and the arrangement of components. This type of apparatus is typically used in advanced research, such as in quantum computing, where maintaining ultra-cold conditions is essential for superconducting qubits to function.
2.84bpw <|im_start|>assistant This image displays a highly complex and sophisticated scientific instrument, identified as a superconducting quantum computing processor. This device is a key component of a quantum computer, designed to perform calculations using quantum bits, or qubits.Key features visible in the image include:
- Multi-layered Structure: The processor is a vertically stacked assembly, composed of several distinct levels. This tiered design is characteristic of cryogenic systems used to maintain extremely low temperatures.
- Cryogenic Environment: The entire apparatus is housed within a cryostat, a device designed to maintain a very low temperature. The white cylindrical structure at the top is the cryostat's vacuum chamber, which provides insulation and houses the cooling system.
- Superconducting Components: The intricate internal components are made from superconducting materials. These are often gold-colored, which is visible on the various connectors, wires, and circuit elements.
- Interconnected Wiring: Numerous thin wires, including superconducting and normal metallic wires, connect the different layers. These wires are crucial for controlling the qubits and reading out their quantum states.
- Central Processing Unit: The core of the device, located in the middle section, contains the actual quantum processing elements (qubits). This is surrounded by a complex array of supporting electronic and control circuits.
- Precision Engineering: The entire device is a marvel of precision engineering, with components meticulously arranged to function in an ultra-cold environment (typically below 10 millikelvin).
In essence, the image shows the heart of a quantum computer, a highly engineered system that uses quantum mechanics to process information in ways fundamentally different from classical computers.
3.00bpw This is a detailed, top-down view of a complex scientific instrument, which appears to be a quantum computing system, specifically a superconducting quantum processor.Here is a breakdown of the visible components:
- Structure: The device is a vertically stacked, cylindrical assembly suspended from a larger white dome-like structure at the top. This entire apparatus is likely housed inside a cryostat, designed to operate at extremely low temperatures.
- Layers: The central column consists of multiple horizontal, gold-colored layers or platforms. These are likely different cooling stages (thermal shields) within the cryostat, each holding the delicate quantum components at progressively lower temperatures.
- Quantum Processor: At the heart of the device, on one of the middle levels, is a smaller, cylindrical component with a metallic surface. This is the quantum processor itself, where the qubits (quantum bits) are located.
- Interconnects: Numerous thin wires, some appearing as fine gold-colored leads and others as coiled, insulated wires, connect the various components. These are used to control the qubits and read out their states.
- Cables and Connectors: At the bottom, a complex network of wires, connectors, and small electronic boxes (likely control electronics or amplifiers) are visible, indicating the interface with the external control systems.
- Overall Appearance: The construction is highly intricate and precise, showcasing the complex engineering required to build and operate such a system. The use of gold-colored components is common in cryogenic environments due to their excellent electrical conductivity and resistance to corrosion.
The device features a vertical, cylindrical structure composed of multiple stacked layers, each appearing to be a cooling stage. These layers are made of metal and are connected by numerous thin wires and coaxial cables.
- Top Section: The top is a large, white, cylindrical vacuum chamber that encloses the entire apparatus. This chamber is supported by a frame with several mounting points.
- Middle Section: The core of the device consists of several horizontal tiers. These tiers are constructed from gold-colored and silver-colored metal components, including flanges and support structures. At the center of the structure, there are intricate components, including what appears to be a superconducting chip and associated wiring. The entire assembly is designed to operate at extremely low temperatures, requiring a cryogenic cooling system.
- Bottom Section: The structure tapers down, with more wiring and components visible. The entire assembly is suspended from the top vacuum chamber.
This type of device is used for quantum computing, where qubits (quantum bits) are manipulated to perform calculations. The complex wiring and layered structure are essential for controlling and reading the state of the qubits while maintaining the ultra-low temperatures required for superconductivity.
3.54bpw This is a detailed, full-body view of a complex scientific instrument, likely a superconducting quantum computer or a similar cryogenic apparatus. The device is vertically oriented and features a cylindrical structure composed of multiple stacked, concentric layers.- Structure: The main body consists of several circular platforms, each made of a gold-colored metal, connected by numerous vertical rods. These rods appear to be made of a silver-colored metal, possibly stainless steel or copper, and are likely for structural support and thermal conduction.
- Internal Components: Within the cylindrical structure, a dense network of wires, connectors, and other components is visible. There are thin, coiled wires, possibly for signal transmission or cooling, and various small electronic modules and sensors. A central, vertically oriented cylindrical element, possibly a magnet or a waveguide, is visible in the middle section.
- Cabling: A significant number of wires extend from the bottom of the device, hanging down. These are likely used to connect the internal components to external control and readout electronics. The wires are of various thicknesses and colors, including white, gold, and black.
- Top Section: The instrument is capped with a large, white, cylindrical housing at the top. This is likely a cryostat or a vacuum chamber that encloses the entire apparatus to maintain extremely low temperatures necessary for superconductivity.
- Overall Appearance: The design is highly intricate and precise, showcasing advanced engineering. The use of gold-colored materials is typical for high-frequency electrical connections, while the overall construction suggests a need for extreme isolation and control, characteristic of quantum computing hardware.
The image is set against a plain white background, which emphasizes the complexity of the device. It is a sophisticated piece of technology designed for experiments in quantum physics or quantum computing.
4.00bpw This image displays a sophisticated scientific instrument, likely a cryostat or a dilution refrigerator, designed to achieve extremely low temperatures for research purposes.The device is a tall, cylindrical apparatus with a complex, multi-layered internal structure. It is suspended from a white, circular top section, which likely houses the cryogenic cooling system or vacuum insulation. The main body consists of several stacked, gold-colored circular stages or platforms, which provide structural support and thermal isolation.
Numerous thin, metallic rods, wires, and cables are visible, running vertically and connecting different components. These are likely used for electrical connections, temperature sensing, and other measurements. The intricate arrangement of these elements suggests a highly controlled and precise environment. The overall design emphasizes precision and isolation, characteristic of equipment used in quantum physics, condensed matter research, or other fields requiring ultra-low temperatures.
4.06bpw This image displays a complex, vertically oriented scientific instrument, likely a cryogenic system or a component of a quantum computer. The device is composed of multiple stacked, cylindrical layers, each featuring a combination of metallic and gold-colored components.Key features include:
- A large, white, cylindrical top section, which appears to be a vacuum chamber or a cooling shroud.
- A central column of silver-colored metal rods that provide structural support and connect the various layers.
- Numerous fine, coiled wires and cables, some with gold-colored terminations, are intricately routed through the structure. These are likely for electrical connections and signal transmission.
- Several small, rectangular electronic modules and what appear to be sensors or detectors are mounted on the various levels.
- The overall construction suggests a highly engineered system designed to operate under extreme conditions, such as very low temperatures, possibly using liquid helium or nitrogen for cooling. The gold-colored elements are likely used for their excellent electrical conductivity and resistance to corrosion.
The overall structure is a tall, cylindrical assembly that tapers slightly towards the bottom. It is composed of multiple stacked levels, each featuring a framework of metallic rods, wires, and connectors.
Key features include:
- Cylindrical Casing: The top of the device is capped by a white, cylindrical housing, which likely serves as the outer shell or vacuum chamber.
- Multi-Level Architecture: The main body consists of several distinct horizontal tiers, supported by vertical metallic rods. These tiers are likely designed to house different components at various temperatures or for different experimental functions.
- Complex Wiring: Numerous thin wires, many with gold-colored connectors, crisscross the structure, connecting components across different levels. This dense wiring is essential for controlling and reading the quantum states of the system.
- Central Components: In the middle sections, various components are visible, including what appears to be a central vacuum chamber or cryostat, and other electronic modules. The gold-colored parts are likely connectors or shielding.
- Cryogenic Design: The intricate network of wires and the overall design strongly suggest a cryogenic system, where components must be cooled to extremely low temperatures (often near absolute zero) to function. The different layers may represent different stages of cooling.
- Bottom Section: The lower portion features a more complex assembly with a central column and a large number of wires fanning out, some terminating in connectors. This is likely the interface for accessing the quantum processors or sensors.
In summary, the image showcases the complex and delicate engineering behind a state-of-the-art quantum technology device, emphasizing its layered, modular, and highly interconnected nature.
6.00bpw This is a detailed, top-down view of a sophisticated piece of scientific equipment, likely a quantum computing system or a cryogenic apparatus. The device is a multi-layered, cylindrical structure that appears to be suspended from a large, white, dome-shaped top housing.The central component is a complex assembly of numerous metallic elements, primarily in gold, silver, and copper tones. These components are arranged on several horizontal levels, creating a tiered or stacked design.
Key features include:
- Cylindrical Supports: Numerous vertical metallic rods, some appearing to be gold-plated, serve as structural supports connecting the different levels.
- Wires and Cables: A dense network of thin, flexible wires, many with a distinctive coiled or spiral shape, connects the various components across the different tiers. This intricate wiring is crucial for controlling and reading the quantum states within the system.
- Central Column: A central column runs down the middle, housing internal components.
- Base Structure: The bottom of the apparatus is more complex, featuring a multi-layered base that includes a prominent gold-colored ring and other components.
The overall design suggests a system that operates at extremely low temperatures, which is typical for quantum computers. The top white dome likely serves as a cryostat, a vacuum-insulated container that maintains the necessary cold environment for the sensitive quantum components to function. The entire apparatus is shown against a plain white background, emphasizing its intricate and delicate construction.