How for Linux users to set the rights to their folder and at the same time authorization by keys worked?

Question

linux

So that users (their groups) can see only their folders, I do sudo chmod 750 /home/*
I go under the user, access to other users is prohibited (which is required).
But I need ssh keys to work, in this situation the system cannot get into the user's folder, as a result, get to the keys.
I change to sudo chmod 757 /home/* - authorization works, but users can see each other's folder structures.
Is there a way to combine both prohibition and authorization?

Answer 1

Add sshd to all user groups