Is there a difference in the OS of the server where docker is deployed?

Question

Docker

I understand correctly that there is not much difference on which OS the docker will be on?
Since I just now realized that the downloaded image from the docker hub can run on any OS.
Or is it better to collect images (most) on one OS? In theory, the container will already be with its own OS, or am I already sailing?

Thanks