The real world is infinite, but we can only test theories against limited samples.
We can’t test every permutation.
We can’t run experiments for unending amounts of time.
And there’s no gamemaster to confirm when we’ve guessed correctly.
When the answer holds, then, it merely means it was accurate enough to predict the outcomes so far. All we actually know is, we haven’t proved it wrong yet.
That’s inherent to empirical evidence, we can’t get to the truth, we can only refine our approximation of it.