Big data drives big demand for storage

As demand for Big Data technology and services continues to escalate, all levels of the Big Data technology stack will experience significant growth. Storage is a critical piece of the infrastructure component, increasing at a compound annual growth rate (CAGR) of 53% between 2011 and 2016.

The amount of data generated, processed, and stored by most organizations will continue to grow aggressively for the foreseeable future. “Storage will be one of the biggest areas of infrastructure spending for Big Data and analytics environments over the forecast period,” said Ashish Nadkarni, Research Director, Storage Systems.

“Revenue from storage consumed by BD&A environments will increase from a mere $379.9 million in 2011 to nearly $6 billion in 2016. This growth will come largely from capacity-optimized systems (including dense enclosures), however, software-based distributed storage systems with internal disks to store post-processed data will also be embraced by some users,” he added.

Additionally, businesses will continue to tap into newer data sources as they move their analytics efforts from search to discovery. This shift will accelerate spending on Infrastructure and data organization platforms will continue to accelerate.

Storage is a tremendously important subsystem that can determine the success of a Big Data and analytics implementation. Capacity growth and application performance continue to be the top challenges facing organizations of all sizes as they relate to how storage is attached to Big Data and analytics environments.

• Performance was cited as the primary driver for selecting storage architecture among 68.6% of respondents. Another 59.5% indicated cost as a primary driver (multiple responses were allowed).
• Just under 31% of respondents said they had no deployment of enterprise storage systems for data analytics infrastructure, but plan to start deploying in the next six months.
• The type of converged infrastructure deployed for Big Data infrastructure was split almost evenly between discrete converged infrastructure (30.1%), Compustorage (29.4%), and Neither, we have done the integration in-house (28.4%).