Mathematical bounds that hold for any fixed amount of data, not just in the limit of infinite samples.