Data Analytics has the potential to richly reward your company with better decision making. If you can foresee market trends, discover hidden patterns, uncover untapped efficiencies, or make your products more appealing, you can surpass the competition.
This is the promise of data…but the current reality is that for many organizations it’s a major money pit. IBM estimates that poor data quality may cost $3.1 Trillion annually in the U.S. alone, and Gartner estimates that the average company loses $15 million per year due to these issues.
There are a number of reasons for this, but they tend to come back to one thing: the data analytics lifecycle–the time it takes to get from question to answer–is too long.
Why the data analytics lifecycle is too long
Here’s a typical scenario. Someone in the sales department of a consumer goods company poses a question to the central data team. Though it’s mission critical, it’s not a particularly difficult question, and doesn’t require sophisticated statistical or machine learning techniques. But it does require:
By the time it’s done, weeks, perhaps even months may have passed. The needs of the business department that asked the question have likely changed, so what you’ve given them isn’t really that helpful.
A long data analytics lifecycle costs money
The end result, you’ve spent a lot of time and resources with no ROI. Consider the quantifiable cost associated with this:
At this point you may have already spent well in excess of $1000 to answer a simple question. Assuming that your line of business folks may be asking dozens of questions a month, this cost could easily balloon to well over $100K per month.
And of course that’s assuming that the data is analyzed fast enough for the answers to be actionable. If it’s not, you should also assume that you are losing money in less quantifiable ways, such as:
At this typical organization, the TCO for data analytics is clearly too high for it to be a profitable endeavor. But, if it could be reduced to a fraction of the cost, the tables would be turned. Here are some things to keep in mind as you look to reduce TCO for your analytics capabilities.
Reduce the number of tools and infrastructure
Whether we’re talking about cloud based apps or legacy infrastructure, a complicated data architecture can cost your company big time. A data fabric allows you to streamline the number of tools and amount of infrastructure required to manage and analyze data. It does so by creating an abstraction layer that eliminates the complexity of working with distributed data and disparate formats. It provides seamless access to enterprise data, which helps data teams keep up with the exploding volume of user requests, while making it easier to enforce compliance without blocking appropriate users from data access.
Reduce the cost associated with moving data
ETL (Extract, Transform, Load), the process of moving data so that you can analyze it, is expensive in more than one way. First, it’s a painstaking process that takes a lot of time and expertise. A survey of 502 IT professionals by IDC, for instance, found that ETL is significantly slowing down companies’ ability to get answers from data, with most data being at least five days old by the time the process is complete.
Second, it’s risky. You can lose data, or if you’re making copies, that comes with its own risk in the form of multiple versions of the truth. Furthermore, Changed Data Capture (CDC) technology, which is designed to address this problem, was also found by IDC to have a slowing effect on data analytics.
A data fabric essentially removes the need for ETL. The abstracted ‘fabric’ means that you don’t have to move data in order to access it or integrate it with the system. This means significant reductions in the cost and risk associated with moving or copying data into warehouses and other repositories.
Increase efficiency
In general, the more you can shorten the analytics lifecycle, the lower your TCO. In fact, an IDC survey found that 76 percent of respondents said that not being able to analyze current data makes it difficult to take advantage of business opportunities. This time-to-value can be shortened by:
If you want to hear about how the majority of the steps can be consolidated into a single data fabric platform to reduce the TCO of data analytics, read on.