medgemma 27b text it FP8 Dynamic

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released July 2025131K context≈ 98,304 words27b params

A text-only medical language model running in FP8 dynamic quantization, which reduces memory footprint at some potential cost to numerical precision. It handles long clinical contexts — up to 131K tokens — making it capable of processing lengthy patient records or medical literature in a single pass. As a quantized variant, it trades a small amount of fidelity for deployment efficiency.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Coding

Moderate

Factual Knowledge

medgemma 27b text it FP8 Dynamic

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released July 2025131K context≈ 98,304 words27b params

A text-only medical language model running in FP8 dynamic quantization, which reduces memory footprint at some potential cost to numerical precision. It handles long clinical contexts — up to 131K tokens — making it capable of processing lengthy patient records or medical literature in a single pass. As a quantized variant, it trades a small amount of fidelity for deployment efficiency.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Coding

Moderate

Factual Knowledge

Glossary

Dynamic QuantizationA quantization approach that adjusts precision levels during inference based on the input data, optimizing the balance between speed and accuracy on-the-fly.FP8 Dynamic QuantizationA compression technique that reduces model size and speeds up inference by representing weights and activations using 8-bit floating-point numbers, with dynamic scaling adjusted per batch to maintain accuracy.FP8 Dynamic QuantizationA specific quantization method that uses 8-bit floating-point numbers and adjusts precision dynamically based on the data being processed, balancing speed and accuracy.FidelityThe degree to which a quantized or compressed model preserves the quality and accuracy of the original full-precision model.Language ModelAn AI model trained to predict and generate text by learning patterns from large amounts of written data.Memory FootprintThe amount of RAM or storage space a model requires to run, which is critical for deployment on resource-constrained devices.PrecisionThe level of numerical detail a model uses to represent its internal values; higher precision means more accurate calculations but requires more memory.QuantizationReducing a model's numerical precision (e.g., from 16-bit to 4-bit) to shrink memory usage and speed up inference.QuantizedA technique that reduces a model's size and memory usage by storing weights with lower precision (fewer bits), trading some accuracy for efficiency.TokensThe basic units of text that a language model processes, typically representing words or word fragments.

Capabilities

Capabilities

Use Case Fit

Glossary