A compact, locally-runnable model optimized for consumer hardware through 4-bit quantization. It trades some precision for dramatically reduced memory footprint, making it accessible on machines that couldn't otherwise run models of this scale. Expect capable text generation with the occasional rough edge that comes with aggressive quantization.