Critical.
Authoritative.
Strategic.
Subscribe to CIO Magazine »

Sydney Water error causes shut-downs at Sydney data centre

Shut off water to Macquarie Telecom causes cooling systems to lapse, prompting customer server shut downs and resets

Macquarie Telecom has admitted a failure of the air conditioning systems at its Sydney-based Intellicentre data centre facility caused a number of customer’s servers to shut down and reset early Saturday morning.

According to Denis Rowe, communications manager at Macquarie Telecom, an emergency response from Sydney Water to an issue with nearby pipes saw an interruption in the water supply to the air conditioning units in the Intellicentre, located located in Pitt Street in Sydney’s CBD.

As a result, temperatures rose in parts of the building causing a number of the servers stored in Macquarie Telecom’s co-location and managed hosting facility to shut down and/or reset.

Rowe said that the downtime for customer servers varied from server to server, ranging from between a number of minutes to a couple of hours.

“We don’t know the exact number of customers affected as many servers automatically reset themselves, but it was a small number,” he said.

“Our account managers get alerts on their phones when this kind of thing happens and they usually outbound [call] their customers straight away. We were pro-actively contacting customers.”

He said customers were also alerted via Macquarie’s online server management tool, which is capable of SMSing customers in the event of an issue with their servers.

Rowe said under Macquarie’s N+1 redundancy scheme, reserve water tanks kicked in following the cutting off of mains water. Once this was depleted, however, the data centre went to an auxiliary source.

“Sydney Water didn’t advise us that this would be happening. Normally we have good communication with them and they advise us of any work, but apparently this was emergency work,” he said. “They have advised us that there is no ongoing problem.”

A spokesperson from Sydney Water said that it had received a call on Friday about a leaking service connection between a mains pipe and a shop located on Pitt Street, Sydney.

"A service crew shut off the water to the business at 9pm Friday, but inadvertently shut off water supplying Macquarie Telecom's data centre," the spokesperson said. "Sydney Water was notified of the problem at 8.30am on Saturday [and] a crew returned to the site at 9am Saturday to restore water services to the Telecom building."

"Sydney Water apologises for any inconvenience caused by the water being shut off."

Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.

More about: Sydney Water
References show all

Comments

Post new comment

The content of this field is kept private and will not be shown publicly.
Users posting comments agree to the CIO comments policy.
Login or register to link comments to your user profile, or you may also post a comment without being logged in.
Related Coverage
Related Whitepapers
Latest Stories
Community Comments
Tags: Intellicentre, macquarie telecom, sydney water
Latest Blog Posts
Whitepapers
  • Fixing Your Dropbox Problem - How the Right Data Protection Strategy Can Help
    It’s estimated that more than 50 million people have used public cloud storage services such as Dropbox to share and exchange files. Public cloud services are so easy to use that their openness can undermine existing IT policies regarding the transmission of confidential data. With data volumes threatening to overwhelm onsite storage, IT managers are looking to find a solution that’s affordable and secure. This paper details a simple three-step approach to helping users manage access to the public cloud without placing your data or your business at risk. Read on.
    Learn more »
  • Cost Effective Security and Compliance with Oracle Database 11g Release 2
    Information ranging from trade secrets to financial data to privacy related information has become the target of sophisticated attacks from both sides of the firewall. Built upon 30 years of security experience, the Oracle database provides defense-in-depth security controls that enable organizations to transparently protect data. By leveraging these controls, organizations can safeguard data, ensure regulatory compliance, and achieve business goals such as consolidation, globalization, right sourcing and cloud computing while still maintaining scalability, performance and availability. Read this whitepaper.
    Learn more »
  • A whitepaper on Cloud Security
    Articles include: The cloud security checklist; Creating a governance framework for Cloud Security; Hackers, like vendors are embracing the cloud. Are you?; Want government cloud? Rethink security! and more. Read this whitepaper.
    Learn more »
All whitepapers
rhs_login_lockGet exclusive access to Invitation only events CIO, reports & analysis.
Recent comments