Addressing the top four big data challenges
- 28 September, 2012 11:03
- Comments
Getting the board’s approval for a big data project is a good start for CIOs but there are four challenges which must be addressed first, according to a data expert.
Speaking at the IDC Asia-Pacific Business Analytics conference in Sydney recently, NICTA senior researcher Dr Rami Mukhtar shared his top four big data tips with delegates.
Invest in big data now for competitive advantage: IDC
Extracting true value
According to Mukhtar, one of the biggest misunderstandings with big data is that people perceive it as a “crystal ball” which will tell them what is going on in the business.
“That couldn’t be further from the truth. True value from big data can only be extracted when you have a very precise business problem which you are trying to address,” he said.
The business problem needs to be understood and well defined first, he said.
“Executives need to ask, 'How much revenue will I gain from applying the solution to this business problem?'”
Business to data mapping
Mukhtar told delegates that solving a business problem using big data has to work within the context of a business process.
“I may understand that my particular solution within this process is going to be better business predictions,” he said.
“If you can’t make the business process match with your data assets than I would suggest to you that this is going to be a very difficult problem to solve -- even with big data.”
Analysing big data
The third challenge is getting the company’s data scientist to examine the data and extract critical information such as customer buying habits.
“Big data is not like a data warehouse, there are no well-structured tables with well-defined relationships,” Mukhtar said.
“All we have in a big data solution is a set of flat files.”
To overcome this, he suggested enterprises use catalogue data assets which will make it easier for data scientists to “cheery pick” critical data.
“For example, if we know what 10 per cent of the [data] file means and this percentage is relevant to the business process that we are addressing, this is absolutely fine,” he said.
Privacy
According to Mukhtar, privacy is a major challenge with big data because there are no clear access controls for analysts or data scientists to access that data without potentially breaching the company’s privacy policy.
“Corporations have privacy policies where they tell the customer exactly what they are going to use that data for,” he said.
“The ways we have seen privacy concerns addressed is to have extremely tight control on which data scientist is looking at the data or using technology to blank out sensitive data such as customer names,” he said.
Follow Hamish Barwick on Twitter: @HamishBarwick
Follow CIO Australia on Twitter and Like us on Facebook… Twitter: @CIO_Australia, Facebook: CIO Australia, or take part in the CIO conversation on LinkedIn: CIO Australia
Recommended
Join the CIO Australia group on LinkedIn. The group is open to CIOs, IT Directors, COOs, CTOs and senior IT managers.
- Bookmark this page
- Share this article
- Got more on this story? Email CIO
- Follow CIO on twitter
-
Why change management doesn’t work
-
Larry Page wants to see your medical records
-
Dual-Persona Smartphones Not a BYOD Panacea
-
After two-year hiatus, EFF accepts bitcoin donations again
-
CIOs struggle to deliver timely mobile business apps: survey
-
Customer Success - Slater & Gordon Lawyers
Lawyers work hard, and they work fast. Any activity that takes their focus away from the task at hand represents lost productivity and lost revenue. Slater & Gordon Lawyers needed to filter spam and email-borne malware and provide high availability for email. Results from the business solution they chose include 250 hours of IT staff time reclaimed annually for other tasks, long delays in email delivery alleviated, reduced email-related storage costs, and email failover to the cloud in minutes, avoiding hours-long outages. Find out how they got these results. -
The Power of Cloud
Although cloud is widely recognized as a technology game changer, its potential for driving business innovation remains virtually untapped. To take advantage of cloud’s potential to transform internal operations, customer relationships and industry value chains, organisations need to determine how best to employ cloud-enabled business models that promote sustainable competitive advantage. Learn more about driving business model innovation. -
Best Practice in BYOD
The key trend affecting enterprise mobility today can be summarized in four letters: BYOD – Bring Your Own Device. As the number of end-users bringing devices into your organization grows, so does the need for an effective Enterprise Mobility Management (EMM) solution. Learn how to manage devices across multiple platforms all from a single, centralised and unified management console. Download for more!
Get exclusive access to Invitation only events CIO, reports & analysis. 
