Treasury CIO’s big data odyssey
- 02 November, 2012 10:04
The Treasury CIO Peter Alexander.
The Department of Treasury’s CIO, Peter Alexander, has likened the Treasury’s journey of utilising big data technology to classical Greek poet Homer’s epic poem The Odyssey.
Speaking at CeBIT Australia’s Big Data Conference 2012 in Sydney this week, Alexander said that like the events in Homer’s poem, the Treasury’s big data roadmap took a decade to achieve. Its internal big data project is also called Odysseus after the Greek hero of The Odyssey.
Part of the reason the Treasury’s big data odyssey took a decade, just as it took 10 years for Odysseus to return home after the Trojan War, was, according to Alexander, subject to forces beyond his control.
“Without being too unkind to my own organisation, in some ways they were stuck in the mid-1990s where Microsoft Excel [spread sheets] had been used,” he said.
“We have people taking massive data sets from the Australian Bureau of Statistics [ABS], Reserve Bank and other sources which are cut into a set of rows. This meant that we ran out of rows and columns in Excel.”
To solve this problem, Treasury IT staff took a number of Microsoft products and integrated these into Excel to build what is called Odysseus.
“Now what we do is take data from ABS and all the sources we did previously, lay it into a data warehouse and then present it to people in a nice Excel front end,” Alexander said.
“It’s very usable and reduced a number of risks and issues that people might have had in data loading and transformation.”
Big data benefits
According to Alexander, the big data solution has cut report creation time down from one week to almost real-time report creation.
“There are a set of [economic] reports that my secretary takes to meetings,” he said. “With this system, you just push a button and it automatically updates with the new data.
“Lots of senior executives have worked their way up the organisation so they have all experienced having to do that [reporting] task or one similar. It was a nice example of how we can improve productivity through improving technology.”
Turning to the future, Alexander said there would be more expansion in the big data space.
“We’ve got other areas within Treasury where people are still doing manual Excel work so we want to make better use of business analytics,” he said.
In addition, the Treasury is also in talks with other organisations in the federal government who use the same kind of source data.
“We want to build a data warehouse that other federal government organisations can all share,” he said.
Follow Hamish Barwick on Twitter: @HamishBarwick
Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.
Larry Page wants to see your medical records
Dual-Persona Smartphones Not a BYOD Panacea
After two-year hiatus, EFF accepts bitcoin donations again
CIOs struggle to deliver timely mobile business apps: survey
Spiceworks' free management software gets integrated MDM
Mobility Apps: What every developer should know
Learn how others have delivered industry-leading, multi-platform management and security solutions. In this whitepaper, we look how app developers can develop, deploy and manage apps that enterprises can rely on today and into the future. Click to download!
Batten Down the Hatches! A Guide to Protecting Data in Motion
The risks facing high-speed data networks and unencrypted data while in motion are very real and on the rise. As information becomes one of the most valuable ‘off balance sheet’ assets, protection of that information and the investment in it is a paramount obligation of office-holders and management. Read now for a better understanding of the risks to data in motion.
NetApp FAS6240 Clustered SAN Champion of Champions
Storage systems today must match agility with diversified I/O performance to satisfy an enterprise’s changing needs. In their review, Silverton Consulting ranks the NetApp FAS6240 Clustered SAN, as an Enterprise OLTP “Champion of Champions.” Read the results of their benchmark testing and the features that impressed them the most.