UNIT.City — місце, де люди працюють... КРАЩЕ! Обирай свій простір просто зараз 👉
Вікторія ГорбікThat's Life
30 April 2025, 17:13
2025-04-30
De Novo completely eliminates external interference in the operation of the data center. How the company explained the recent technical failure
On April 26, at around 8:03 a.m., cloud provider De Novo encountered technical problems that caused a large-scale outage of payment services, Diya and Nova Poshta.
De Novo explained the circumstances of the incident in the data center.
On April 26, at around 8:03 a.m., cloud provider De Novo encountered technical problems that caused a large-scale outage of payment services, Diya and Nova Poshta.
De Novo explained the circumstances of the incident in the data center.
«The incident was not related to the human factor and is not the result of a cyberattack,» De Novo reported, citing the data of the internal investigation and the corresponding report.
In addition, the data center noted that De Novo had been operating non-stop for over 5,000 days, which corresponds to almost 15 years. «This is one of the best results in Ukraine,» the company added.
About the causes and chronology
As the company explained, during the second stage of the planned modernization of the uninterruptible power supply systems , a power outage occurred due to a hidden defect in the automatic switch. It did not work properly when switching to another mode.
Here’s what happened:
At 8:03, when it was turned off, there was a complete power outage.
14 minutes later at 8:17 a.m. power was fully restored.
At around 9:45, the De Novo cloud fully resumed operation.
Over the next few hours, the data center clients were restored.
In general, the consequences of the incident were completely eliminated at approximately 1:00 p.m.
The CEO of the cloud provider released a video statement about what happened a few hours after the incident.
About recovery
The data center has a Tier III security level. That is, routine maintenance can be carried out without stopping services, and the downtime of the data center should not exceed 96 minutes per year. At the same time, during such work, the level of redundancy is temporarily reduced, which creates a small but real probability of failures.
On April 26, while the UPS and batteries were being upgraded, one of the power supply branches was being restored to normal operation. According to standard procedure, a temporary power jumper connected to the automatic switch (Switch-2) was used to ensure uninterrupted operation.
After 14 minutes, power was fully restored, but the restoration of cloud services and client systems occurred in stages over the next several hours.
About the consequences
Due to an emergency power outage:
De Novo cloud platforms temporarily stopped;
an emergency shutdown of some client systems occurred;
full recovery lasted until 1:00 p.m. the same day.
The failure did not affect the security, access control, and fire safety systems, which continued to operate thanks to autonomous batteries.
At the same time, all security, access control, and fire protection systems worked uninterruptedly thanks to autonomous power supply, and the security service operated according to special regulations.
What was done to prevent the incident from happening again?
The company has already announced:
decommissioning of faulty equipment;
replacing it with a model with the possibility of visual control;
«We will conduct an internal investigation, analyze the flights.» The CEO of cloud provider De Novo, whose clients experienced a large-scale technical failure today, made an official statement regarding the causes of the problems
A large-scale failure of payment services and applications in Ukraine. Disruptions were recorded in the work of «Diya», the «Nova Poshta» application, transactions via Apple/Google Pay, and the work of bank services
UPD. There was a technical failure in the IT system of Ukrzaliznytsia. Online services are not working — tickets can be purchased directly on the trains