UPS death in Pulsant data centre knocks out websites
Four-minute outage sparks domino effect
IT infrastructure company Pulsant suffered a power outage at its Maidenhead data centre last night that cut websites off from the internet.
Although electricity was restored soon after by routing around a dead uninterruptible power supply, the blip knocked out web hosting firms' servers and firewalls, and issues were still ongoing hours later.
Bringing up systems and recovering data after a forced hard shutdown takes time so some businesses were still sorting themselves out today.
Pulsant told The Register that the problem was "a partial power disruption during scheduled maintenance to part of our Maidenhead data centre facility overnight [which] did not affect the whole site or facility".
The company, which used to be known as Lumison and also now owns Blue Square, initially reported on its status page that it was a network problem, which infuriated customers on Twitter.
"I'd like to know why Pulsant is reporting this as a network error… that brings down power?" web hosting firm Netmotivated tweeted.
An hour after blaming the network, Pulsant said that it was having "power issues" at its Maidenhead facility.
Some customers claimed that there there isn't enough staff the data centre at night and the problems weren't taken care of quickly as a result.
"This isn't good enough for our clients, so we will be taking it up with their management tomorrow," hosting provider Xilo Comms tweeted last night.
However, in a lengthier update at 11.20AM BST, Pulsant insisted that there were six engineers onsite when the power went out.
The company explained that during planned maintenance, a uninterruptible power supply (UPS) failed after a device swap.
"This was due to a component failure which had been changed during the routine maintenance with a certified new manufacturer component. As the UPS device was placed back into service, the electrical load was taken over and subsequently dropped as the component failed," Pulsant stated.
"At this time, customer racks connected to the failed UPS device in the Maidenhead 2 & 3 facilities will have experienced power loss."
The UPS was bypassed to get the power back on just a few minutes later. The device awaiting a full test by engineers before it can be brought back online tonight, Pulsant said. ®