Big Data and Analytics versus Boy Band

It’s true. But don’t despair.

The sensational rise of Big Data within the reporting and analytics realm resembles an uncanny likeness to the escalating popularity of bothersome big-haired British boy ‘band’

Even if you haven’t warmed to the idea yet; its status, adoption and allure is spreading rapidly.

Its brand is both evocative and provocative – albeit in entirely separate ways, for equally different audiences.

And, if you fail to embrace this phenomenon, you might consign yourself as an outcast.

Socially, it’s a lonely but fairly incidental tale. In business, it might mean the beginning of the end.

However, as with tweenage affinity for teenage twits, the key to unraveling the mystic around Big Data analytics – and identifying its usefulness or appeal to your particular situation – resides in your ability to avoid the superfluous fever and fervor. Carefully dissecting the entity and its prevalence as a whole, and assessing how each factor or potential benefit might relate to you, is essential.

But what is this numinous and illusive term, nebulously labeled ‘Big Data’?

Defining Big Data

At the most basic level, Big Data comprises the three V’s: Volume (total amount of data), Variety (different data types – structured and unstructured) and Velocity (the speed with which you are acquiring, processing and querying data).

So, it’s not about the size; it’s about how you use it, and whether you have the right tools (for your specific situation) to help you utilize it effectively.

Why is Big Data such a big deal now?

Multinational research and advisory firm, Gartner, identified Big Data as one of the top 10 strategic trends of 2012 in its Top 10 Strategic Technologies for 2012 report.

Some would argue that, to a certain degree, Big Data has always been an omnipresent aspect of our lives. The only difference now, is that the technology necessary to capture that information – and hopefully extract value from it – is readily available at a financially viable price point.

Whilst this argument is vastly true, the emergence of myriad new data sources and types (from various geospatial, social media and mobile sources), in conjunction with the growth of existing sources (think about the proliferation of Web traffic, e-mail, the growing sophistication of computer tracking of supply chain processes and customers), has also had notable contributory consequences.

And whilst it’s important to contextualize the growth of data, it’s also equally important not to understate its growth; both in terms of total volume and acceleration.

Market research firm IDC estimated that the total volume of data created and replicated in 2009 was enough to fill a stack of DVDs reaching to the moon and back. They predict this volume to grow 44 times over by 2020.  IDC suggests that the world’s data has grown almost nine times in the past five years. IBM estimates that 90 percent of the data in the world today was created in the last two years.

So, there’s a lot of information out there, relevant to the performance of your organization, that you’re now capable of collecting. But why would you bother trying to understand that information, and make decisions based on those understandings?

Why bother with Big Data analytics?

Well, many of you are already collecting large, untapped, information resources – so you might as well accomplish something constructive with that data. A recent MIT Sloan Management Review survey of over 3,000 executives found that 60 percent of respondents collect more data than they can effectively use.

Further, harnessing Big Data provides an opportunity to understand your business operations and customers at a deeper, more granular level.

“If your organization is one of the growing number looking for deeper insight into customers and operations, then you understand that Big Data will be key,” said Director of IDC’s Asia/Pacific Business Analytics Research, Craig Stires, in a recent media statement.

“With technology barriers falling, organizations are given affordable access to infrastructure that scales up and out,” continued Stires. “It’s a great time to be mapping out how you can lead the transformation in your organization. It’s the right time to pay attention to the combination of increasing availability of experiences, end-user awareness, affordable technologies, and emerging vendor solutions. Making a critical, informed decision on your Big Data strategy today will be crucial to your organizations success and continued competitiveness tomorrow.”

Do you disagree? Maybe you think that Big Data’s just a hassle – an unnecessary burden. If that sounds like you, you might want shift your mindset on the subject. According to research firm Harris Interactive, 70 percent of organizations (and your competitors) view Big Data as a big business opportunity. Further, 70 percent those organizations already investing in Big Data initiatives expect to see a ROI within a single year. And if you’re not thinking about how to harness Big Data, you might soon find yourself in trouble, because your competitors already are. According to a new survey of 200 IT and business professionals by data integration company Informatica, the majority of organizations (70%) are already considering (27%), planning (20%), testing (7%) or running (15%) Big Data projects.

More importantly still, 84 percent of organizations actively leveraging Big Data claim that they can now make better decisions as a direct result of that investment (Avanade).

Recent research conducted by MIT Sloan Management professor, Erik Brynjolfsson, backs the findings of the Avanade study, revealing that organizations utilizing Big Data analytics to drive decision-making experience superior performance.

“Companies that use this type of ’data-driven decision making’ actually show higher performance,” wrote Brynjolfsson. “Working with Lorin Hitt and Heekyung Kim, I analyzed 179 large publicly traded firms and found that the ones that adopted this method are about five percent more productive and profitable than their competitors.”

Brynjolfsson, in a recent Harvard Business Review article entitled Big Data’s Management Revolution, also stated that Big Data will have all-encompassing and revolutionary business impacts.

“Simply put, because of big data, managers can measure, and hence know, radically more about their businesses, and directly translate that knowledge into improved decision making and performance,” wrote Brynjolfsson.

“We believe there is a more fundamental transformation of the economy happening.

“The evidence is clear: Data-driven decisions tend to be better decisions. In sector after sector, companies that embrace this fact will pull away from their rivals. We can’t say that all the winners will be harnessing big data to transform decision-making. But the data tell us that’s the surest bet.”

McKinsey Global Institute’s assessment of the situation echoes Brynjolfsson’s, with the firm forecasting that “Analyzing large data sets – so called big data – will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus.”

So which industries stand to benefit the most from embracing the Big Data analytics revolution?

Who can benefit from Big Data analytics?

Brynjolfsson believes that organizations from across almost all industries can enhance their operations and strategic decision-making by implementing Big Data analytics programs, stating that he is now “convinced that almost no sphere of business activity will remain untouched by this movement. We’ve seen big data used in supply chain management to understand why a carmaker’s defect rates in the field suddenly increased, in customer service to continually scan and intervene in the health care practices of millions of people, in planning and forecasting to better anticipate online sales on the basis of a data set of product characteristics.”

Further, embracement of Big Data will create entirely new industries and data-centric economies. In terms of business applications, recent TDWI research has found that over 45 percent of current Big Data deployments are aimed at enhancing marketing efforts, with spending on digital marketing set to grow from $34 to $76 billion by 2016.

How can you benefit from Big Data analytics?

Organizations embracing Big Data analytics programs expect to achieve a range of benefits, according to the aforementioned Informatica study.

Improving efficiency in business operations was the number one benefit sought from Big Data operations (55%), followed by attracting and retaining customers (38%).

Survey respondents also listed the aspects of Big Data most relevant to their organization, as the management and analysis of:

• Growing transaction volumes (58%)
• Social media data (26%)
• Mobile device data (21%)
• Machine-generated data (16%)

Where to next

Stay tuned for more industry-specific examples of how you can benefit from Big Data analytics.