A quantized version of a 70B instruction-tuned model, running in a compressed 4-bit weight, 16-bit activation format that trades a small amount of precision for significantly reduced memory requirements. It handles long contexts up to 65k tokens, making it capable of working through lengthy documents or extended conversations.