DeepSeek R1 Distill Qwen 14B w8a8 g128 rk3588.rkllm

Qwen

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released September 2025context N/A14B params

A mid-sized reasoning model that has been distilled from DeepSeek R1 and quantized to 8-bit weights and activations with 128-element grouping, optimized specifically for the RK3588 chip via the RKLLM runtime. It trades some precision for dramatically reduced memory footprint and faster inference on edge hardware. Its behavior reflects its Qwen 14B lineage — capable text reasoning in a compact, deployment-friendly package.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Tool Use

Moderate

Long Context

DeepSeek R1 Distill Qwen 14B w8a8 g128 rk3588.rkllm

Qwen

Open WeightModel weights are publicly available — can be downloaded and self-hosted

Released September 2025context N/A14B params

A mid-sized reasoning model that has been distilled from DeepSeek R1 and quantized to 8-bit weights and activations with 128-element grouping, optimized specifically for the RK3588 chip via the RKLLM runtime. It trades some precision for dramatically reduced memory footprint and faster inference on edge hardware. Its behavior reflects its Qwen 14B lineage — capable text reasoning in a compact, deployment-friendly package.

Capabilities

Capability scores are AI-generated based on model documentation, benchmarks, and technical specifications. Learn more

Tool Use

Moderate

Long Context

Glossary

DistilledA model that has been compressed by training a smaller model to mimic a larger, more capable model, reducing size and computational requirements while retaining performance.InferenceThe process of running a trained model to generate predictions or outputs from new inputs.Memory FootprintThe amount of RAM or storage space a model requires to run, which is critical for deployment on resource-constrained devices.PrecisionThe level of numerical detail a model uses to represent its internal values; higher precision means more accurate calculations but requires more memory.QuantizedA technique that reduces a model's size and memory usage by storing weights with lower precision (fewer bits), trading some accuracy for efficiency.ReasoningThe model's ability to work through multi-step logical problems and provide justified answers rather than just pattern-matching.Reasoning ModelA model trained to show explicit step-by-step reasoning and problem-solving logic before producing final answers, rather than jumping directly to conclusions.Text ReasoningA model's capability to analyze, interpret, and draw logical conclusions from textual information.WeightsThe numerical parameters inside a neural network that determine how it processes input and generates output.

Capabilities

Capabilities

Use Case Fit

Glossary