Who faced the problems of availability of IT services from different offices?

Question

Computer networks

Let's imagine a distributed company with five offices and used resources from the cloud: CRM Systems, 1C, data storage, telephony, and so on. The company is interested in ensuring that the services are guaranteed to be available from all offices, moreover, the admin, say, is only in the central office. That is, there is a need to control the availability of all services automatically and continuously with notification of a malfunction and an indication of who is to blame: the telecom operator, the local network, the hardware, or the application itself.
Is there any experience in solving such problems?
The availability of which services is especially critical in your company?

Answer 1

Duplication of Internet channels everywhere, + everywhere monitors of the availability of all critical resources are launched and rotated (with the issuance of logs somewhere in Dropbox) (or even raise some kind of Nagios and monitor everything at once). Those. you can always understand (by looking at the logs) what specifically hung, and channel failures due to the fault of providers will become an order of magnitude less likely. Start imho with this.