Exclusive: SKA bid looks to SkyNet for computing
- 19 May, 2011 12:05
Image: Courtesy NASA/JPL-Caltech.
Key players behind the Australian-New Zealand joint bid to host the $2.1 billion Square Kilometre Array radio telescope will launch a grid Cloud computing initiative by September with the aim of potentially harvesting the computing and storage power of desktops worldwide.
The International Centre for Radio Astronomy Research (ICRAR), along with iVEC, the company running the $80 million high performance computing Pawsey Centre at CSIRO in Western Australia, are set to launch a “citizen science” application this year based on the open source Nereus V Cloud computing technology developed at Oxford University. The application, dubbed “theskynet” by Australian researchers, would grant anyone not affiliated with the global telescope project access to the datasets formed out of the array’s work.
It could effectively become a wider desktop-based Cloud initiative, according to two Oxford University researchers who undertook a three-month research project (PDF) earlier this year to explore Cloud computing options as an alternative to the exaflop-capable supercomputer believed to be required by 2020 to crunch through the data output by the final telescope array.
Once complete in mid-2013, the Pawsey Centre being constructed as part of the telescope array bid would be capable of petaflop computing, making it the third fastest supercomputer in the world based on the most recent listings in November 2010.
The first two stages of the Pawsey Centre, which include a HP POD modular data centre and a second, GPU-based processing centre, would be capable of computing power in excess of 200 teraflops and storage of about 1.5 petabytes. The project is expected to deliver up to an exabyte a day of raw data, compressed to some ten petabytes of data in images for storage.
Data would be transferred over some of the fibre rolled out by Nextgen networks as part of the Federal Government’s $250 million Regional Broadband Blackspot Program.
However, the researchers claimed that even with such a computer, the resultant data would be impractical to store. Use of multi-tenanted public Cloud computing offerings like Amazon Web Service’s EC2 storage platform for the SKA’s effort would cost approximately $US455,000 per year ($AU427,125 at time of writing) to operate.
Instead, the researchers prototyped a Nereus V testbed using 200 clients at the University of Western Australia, Curtin University and iVEC with two servers deployed through management at a NereusCloud domain. The clients used for processing included Mac Minis and some Linux-based desktop PCs with at least two gigabytes of memory.
The Oxford-developed Nereus was chosen over grid computing alternative BOINC, which already harnesses five petaflops of data through similar computing projects, due to the former’s Java base and greater security.
The researchers recommended widespread use of the computing grid across university campuses to take advantage of the powerful computers and high-bandwidth fibre already available there. However, director of the Australia-New Zealand SKA project, Peter Quinn, said that the research institutes involved would receive greater use of the data by expanding it beyond campuses to citizen scientists otherwise not involved in the project.
“We’re keen to expose the datasets to the public,” he said. “You get a multiplication of the science utilisation and science return on this data.”
Quinn’s desire to see the citizen science project going is linked to his push to revive the lapsed Virtual Observatory project in Australia and globally. The international initiative would use similar technologies to provide a central registry of disaggregated datasets from global telescopes, including those not within the Square Kilometre Array, for free access to scientists. Though Australia intermittently contributed to the project’s international alliance since 2005, its contribution has since lapsed.
Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.
- Second stage of CSIRO SKA project released
- Cloud Computing and the Square Kilometre Array
- Tens of deals in the pipeline for HP's POD data centre
- CSIRO sourcing hardware for Pawsey SKA supercomputing environment
- Australian SKA telescope to get broadband blackspot fibre
- Twitter: @j_hutch
- Twitter: @ComputerworldAU
- Evolving Threats Demand New Approaches to Security
- Protection Storage Architecture: The What, Why, and How
- Case Study: The True Value of Conference Calling
- Convergence with Vblock Systems: A Value Measurement - IDC In-depth assessment
- 2014 Foundations of Pathways | 9 Executive Core Business Competencies
- OAIC releases privacy impact assessment guide for consultation
- Some Australian businesses 'unlikely' to be ready for Privacy Act changes: survey
- BYOA 'shadow IT' grows in the enterprise: Telsyte
- Cost of a Privacy Act breach could extend to ongoing audits: legal expert
- How Hunter Water is saving $50k a year in software licences
Trust issue looms large for tech companies capitalizing on personal data
5 women who've made it in IT
Five trends affecting legal CIOs
CIO Roundtable: The changing face of security
Bitcoin malware count soars as cryptocurrency value climbs
Case Study: Columbia Sportswear
With the agility and intelligence provided by their management tools, Columbia sportswear is transforming IT to be much more service oriented in fulfilling business requests and delivering resources as needed. It’s allowing IT to “never say no” with an infrastructure that can handle nearly any project that comes through the door.
The Power of Transformational Knowledge
Apple saves $5 million a year on case and email deflection, while its agents find information 47 per cent faster than before they invested in something called Transformational Knowledge. In today’s consumer-empowered marketplace, you cannot afford negative customer experiences. However many companies lack the tools and processes required to empower their employees to deliver great customer experiences. In this whitepaper, we look at how to breakdown silos and deliver great customer experiences.
Best Practices in Data Protection Monitoring
This whitepaper discusses best practice in data protection monitoring, with a focus on recoverability and visibility as significant drivers for success. Whether backing up a private cloud or several smaller environments, learn how a unified view is necessary for proactively reporting protection, compliance to auditors, and understanding overall data protection health, performance, and reliability.