For code model pre-training, you can now query structural properties (AST patterns, definitions, etc.) across massive corpora in seconds without downloading everything—enabling faster, more targeted dataset curation.
SWHForest is a framework that creates a searchable structural index of code files without storing source code, letting researchers efficiently filter and curate large code corpora before downloading. Instead of downloading millions of files to find what they need, users can query the index to identify matching files first, reducing downloads by 46-72%.