When building ontologies with LLMs, model size matters less than you'd expect—architecture and training approach often matter more, and the best model depends heavily on your specific task (term classification vs. relationship extraction).
This paper systematically evaluates how LLM size affects ontology learning—the task of automatically extracting concepts and relationships from text to build knowledge structures.