Output format is a free design choice that dramatically impacts small model reliability: natural language encodings reduce silent semantic errors by 2-3x and improve accuracy, suggesting format selection deserves as much attention as model architecture.
Small language models fine-tuned for semantic parsing often produce grammatically correct but semantically wrong outputs that go undetected. This paper shows that the output format—how you encode the target structure—significantly affects error rates.