Chris Gondek, Principal Architect for APAC, Commvault
Data has evolved. Until recently, data was in the basement, gathering dust on tapes and old servers, regarded as a necessary byproduct of doing business in the digital economy. In recent years, this has changed with data becoming a top priority for businesses. Recognising the potential of their data, organisations have awarded a number of seats at the executive table to drive value and best practice from it.
Data in the enterprise
The reality is, we’re living in a digital world where data is paramount to daily activities and business decisions. It seems that almost every business has a finger in the data pie; eager to experience the gains of integration, collaboration and cost savings waiting to be discovered. But garnering this value, isn’t as easy as it could be. For one, data growth in recent years is staggering. According to IDC, worldwide data will grow to 163 zettabytes (ZB) by 2025 – which is more than 10 times the amount of data we have today. Furthermore, the majority of this will be created and managed by enterprises.
At the same time however, for every terabyte (TB) of data found on the front end of a given system, there are estimated to be at least two TBs of back end copy. Historically, this back end or secondary copy data, has been used to meet the compliance and backup needs of the enterprise – serving only as an insurance policy. Businesses have not sought more from this secondary copy data, allowing it to sap crucial resources without delivering any value.
The rising value of secondary data
This is all changing. Increasingly organisations are demanding that their secondary data contribute to the growth and development of the business. At the same time, there has been a shift within the business resulting in a growing ambiguity towards what denotes primary and secondary data. Traditionally, production and original data has been categorised as primary, while copy data, backup data, and disaster recovery (DR) data has been broadly considered as secondary.
But the lines between primary and secondary data are blurring. Secondary copy data is now being used for much more, allowing business to take what was once a resource heavy burden, and derive true value from it. As such, secondary data has become elevated within the business as its value is uncovered across a number of key areas.
It is estimated that only 25 per cent of data within an organisation is active, meaning that the majority of it can be found in secondary data stores. It goes without saying that failing to include 75 per cent of data for business analytics is a flawed system that would undoubtedly affect the accuracy of any reporting and analysis conducted by an organisation. Not only does historical data form the basis of precise forecasting, but utilising a full data set increases the overall accuracy of analysis.
Research and Markets has predicted that the mobile enterprise application market will be worth over USD 98 billion by 2021. As organisations drive innovation with the development of apps, they will increasingly find that secondary data is a critical part of application lifecycle development. Often application development requires huge volumes of active data copies and copy data management. In the past, organisations had to make enormous clones of their data in order to test and develop these applications. Now we can use secondary copy data for this purpose, speeding up application development and innovation.
Whilst looking to innovate, be secure and drive value from their data, organisations must also be compliant. Sounds simple but in reality, compliance is becoming more and more complex. From the mandatory data breach notification laws to GDPR, there is an increasing demand for organisations to be able to deliver federated search capabilities, and assurance of secondary data to meet compliance head on. For example, as part of GDPR, European residents have the right to have their personal data completely removed from an organisation’s databases. As a result, secondary data has become a critical element of meeting GDPR and remaining compliant.
With the evolving threat landscape, including the rise of ransomware, malware and insider threats – it’s no wonder that secondary data has become more than an insurance policy. It is essential to reducing downtime and risk associated with internal and external threats. Business continuity demands accurate recovery data, which can be quickly and easily sourced from up-to-date, secure secondary data stores.
Today’s enterprise IT environments are changing. With each new project or customer engagement, comes a host of new data making it easy to forget the value secondary data brings to the table. However, secondary data is a critical resource for the enterprise, providing a full picture of what the past, present and future could like. What’s more, when used effectively, secondary data will provide the foundations to greater innovation, improved security, flawless compliance and better data analytics.