The diversity of outputs a model produces; high entropy means varied solutions, low entropy means repetitive ones.