Why do neural networks use square inputs?

Question

Neural networks

All models for image segmentation that I came across use a square input.
Does this somehow affect accuracy or can it be done for unification?
In practice, it seems like a good idea to set the dimensions of the input layer in proportion to the sides of the input image.