Monday, 31st October 2022

Linux Cloud Servers (RMA1) Storage Incident at RMA1

Storage Incident on 2022-10-31

Date / time
2022-10-31 between 11:33 and 11:59 CET

Affected systems
Parts of cloud servers at location RMA1

Impact
During the incident, individual blocks of a part of the root/SSD volumes at cloud location RMA1 were unavailable or I/O was blocked.

Recommended action
For servers at location RMA1, we recommend our customers to check in the kernel.log (or via dmesg) if there are any follow-up issues of potentially blocked disk access (e.g. read-only filesystem).

Root cause and measures taken
This incident has been caused by an operator error. We have already reviewed and improved the documented workflow in order to prevent similar errors in future.

Please accept our apologies for any inconvenience caused.