2015 Trends in Data Storage and Archiving

As we predicted at the end of last year, active archives became a more mainstream best practice in 2014. Businesses and organizations are recognizing the value of active archives in addressing their overall long-term data storage needs.

As we begin 2015, Active Archive Alliance members shared their predictions for data storage as it relates to active archives in the coming year. Here's a look at what’s to come according to some of the industry’s top storage experts:

  • Advanced Data Tape Will Carry More of the Storage Load

With all the significant innovation occurring in the tape market, the pieces are in place for tape solutions to expand their presence in the data center and carry more of the storage load in 2015. The timing could not be better as users struggle with increasing data loads and limited budgets. New and exciting innovations like LTFS, Barium Ferrite, tape NAS, Flape (flash + tape), tape in the cloud, new high capacity formats and newly extended roadmaps are all coming together to provide best-practice solutions for data protection and active archiving.

  • There Will be Increased Adoption of Storage Tiers

The need for large-scale data capacity is driving the implementation of an increasing number of tiers of storage across a growing number of organizations.  There will be an increase in Tier 0 with a tidal wave of flash adoption for the fastest form of storage as well as a multi-tier approach to long-term data, with the rapid adoption of public cloud and an anticipated swift increase in private cloud creation. Combinations of flash, disk and tape are being used in both public and private clouds to meet custom requirements. An increasingly complex storage environment will become the norm, with specific data being placed on specific storage technologies for specific periods of time with automated "data fluidity" systems controlling the life-cycle process.

  • Greater Intelligence Between Applications and Storage Will Simplify Active Archive Deployments

Applications that can be integrated with storage will improve overall storage management by removing complexity and helping organizations to better utilize active archive solutions. Solutions will use intelligence to deliver the right storage to meet application performance while driving efficiencies that help keep storage costs within targeted budget requirements.

  • There Will Be a Move to Object Storage as an Archive

    There is a big movement in the industry towards object storage as an archive. Object storage is attractive for several reasons: 1) it is massively scalable; 2) it is cost effective; and 3) it is able to also act as a cloud infrastructure for collaboration.  The trend is being accelerated because there are many ways to access an object based archive these days, including NFS, CIFS, Mobile Oss and more.

As the demand for more cost-effective, long-term storage options continues, active archives will proliferate. The Active Archive Alliance will support technology expansion and innovation to address the newest advancements in data storage.

Alliance members Crossroads Systems, DataDirect Networks, Fujifilm, and QStar contributed to this blog.

Using LTO Tape to Complement Your Cloud Storage Active Archive

So you’ve decided to deploy a cloud storage solution to protect your active archive data. What will you do if you lose your network connection and need your data? What if your cloud provider decides to close its doors? How will you deal with the slow upload speeds? How about data that you don’t want to store in the cloud because of security concerns? By adding a complementary tape-as-NAS (tNAS) solution on the front end, you can now address these issues using cost effective LTO tape storage.

You’re Not Alone

The issues described above are shared by a number of IT professionals. The Enterprise Strategy Group polled a variety of IT professionals from a variety of business sizes and found that 84% were using some sort of public cloud service. More so, 69% of these users were very interested in using their own on-premise storage for storing some or all of their data. Most users were concerned with overall data protection and security. And 34% were also concerned about performance issues. By using a tNAS solution on the front end of the active archive cloud solution, you can easily mitigate these issues.

The Latest in Tape Technology

In one of my previous blogs, Tape Ensures Future of Active Archives, I wrote about a customer who asked if tape was an essential component of an active archive. The answer is “no,” but if you are faced with increasing data growth and need a cost effective and reliable, long term solution, then the answer is decidedly “yes.” In a typical active archive environment, data migrates by policy from expensive primary storage tiers to a more cost effective tier while maintaining the convenience of online file access to all of the data. Tape is ideal for this application based on its economic benefits, high capacity, low energy consumption, superior error rates and long archival life.  

Using Flash as Part of an Active Archive

I am not fond of made up terms like “Big Data,” which is used and re-used in all sorts of ways to promote all sorts of products. So, you can imagine how I felt over the summer when I began to see words like “Flape” and “Floud” emerge for the first time. If you haven’t seen these terms before, “Flape” is a combination of flash and tape, while “Floud” is a combination of flash and cloud.

Yuck! I hate the terms… But I do like the concepts behind them.

Drowning in Backup? Active Archive Is the Lifeboat

You have to protect business data. This typically translates to: you have to back it up, and there are hundreds of backup solutions out there. Why then, do so many storage administrators say that managing backup data is their biggest challenge? As data continues to grow, content is lodged in backup cycles, increasing backup windows and spurring the need for more storage and data protection investments. To make matters worse, 50-80% of enterprise data likely won’t be accessed again after it is first created.   

The solution? An active archive with built-in data protection

Workflow Step One: Archive?

A new paradigm for big media and post-production workflows in a high resolution world

Ever tried standing on your head to give you a new perspective on a problem? It sounds a bit silly but you never know, it might just do the trick. This unorthodox method seems like what a few media & entertainment storage architects have begun doing to help solve their problem of exploding storage due to higher resolution, stereo imagery, and frame rates (4K, 5K, 8K, 3D, 48fps, 60fps). Architects are turning their workflow on its head starting with the last step, first.

Software-Defined Active Archive Storage

Active archive is a relatively recent concept, promoted since a decade ago, with several real commercial products available. In a nutshell, an active archive solution offers users and applications easy access to archive data via a file interface that is often “mounted” on the user system or application server. It provides users access to archive data, much like other product systems that access data via a file system, and doesn’t change the user experience between production and archive systems. It exists in many different flavors of such approaches, some still based on tape with intelligent front-ends, and some others that extend object storage solutions with file interfaces via gateway or native implementation.

The Business Value of Combining Disk and Tape for Active Archive

A recently published research paper from analyst group ESG reported that more than 82% of tape-using respondents surveyed anticipate increasing or maintaining their organization’s use of tape technology for long term data retention.  So why does tape remain so popular for archive in general and active archive in particular? The answer lies in the on-going business value of the technology.

Is the Time Right for an Active Archive?

In an analog world, an archive is where information is put to rest. It is put on the shelf and there it stays, gathering dust. But in a digital world, all information should be online and accessible to satisfy both the immediate and long-term needs. This is particularly important as more and more companies are seeking to extract added value from their legacy data, whether by monetizing it through repurposing to other uses or by gaining business intelligence from Big Data analytics. 

Clean or dirty, is that really the question?

I recently read “Clicking Clean, How Companies are Creating the Green Internet,” a very interesting report by Greenpeace published this past April. The report reviews the “clean” vs. “dirty” power usage by many of the Internet giants like Amazon, Google, Apple, eBay and others to run their vast data centers. The report shows what percentage of their power is from clean sources, such as solar or wind, vs. what percentage is from dirty sources like coal, gas or nuclear fired power plants. The report rates each company with grades ranging from “A” to “F” based on their renewable energy efforts.

But regardless of the type of energy used by these company’s data centers, an even bigger question might be: how do they reduce their energy consumption in the first place?