Welcome!

SDN Journal Authors: Chris Colosimo, Jason Bloomberg, Scott Davis, Vinod Mohan, Mike Wood

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog, SDN Journal

@CloudExpo: Article

Data Optimization in Cloud Storage

The crucial technology that will provide service providers with the greatest cost reduction is data optimization

The promise of "the cloud" is that cloud storage delivers users seamless "just in time" storage scalability to handle growth and quickly respond to peak loads. The economics and business impact of cloud storage also delivers a compelling financial proposition in today's budget constrained IT environments. To the IT consumer shifting what was a capital expense and a fixed cost to a variable cost operating expense is financially compelling. Additionally, the ability to function in a "just in time" mode versus a "predictive" model for consumable storage also changes the CAPEX impact further assisting in justifying an already strong value proposition for adopting cloud storage.

IDC forecasts that cloud-based storage will represent a $15.6B market by 2015 with a compound annual growth rate (CAGR) of 32%. They also predict 10,000 service providers will focus on cloud storage with a data protection emphasis. The economics of this market transition will continue to evolve and accelerate as costs of delivering cloud services are optimized by service providers that become more efficient - ever mindful of the cost of their plant/facility, operating expenses and business margins.

The crucial technology that will provide service providers with the greatest cost reduction is data optimization. Data optimization incorporates deduplication, compression and thin provisioning technologies that maximize storage efficiency. Data optimization is the most significant innovation in the storage industry, enabling organizations to save more information in a smaller physical footprint. Nowhere does the fundamental concept of storing less data dramatically change economics more than for providers of cloud storage infrastructure.

When applied to the cloud, data optimization is a disruptive technology. It increases storage efficiency on a 5X to 35X scale. In cloud storage environments the impact is simple and compelling. For a data mix that yields a 5X boost to storage efficiency, costs drop to 20% of what they previously were. In addition, reductions in floor space, power and cooling and manpower all significantly improve operating efficiency. With a clearly differentiated value proposition the disruptive nature of applying data optimization enables the service provider to grow their business by gaining market share at the competitor's expense.

Data optimization's impact on storage consumption in the cloud or in the data center yields operating efficiency and critical business advantages;

  • Reduced capital expense - in any storage environment media is a substantial expense. Disk drives and now SSDs are a significant cost because they need to be available in anticipation of demand. Reducing cost to store data will have a direct impact on the IT expense budget's bottom line. Data optimization applied here will drive down capital storage costs by 80% or more.
  • Data center operating efficiency - with a 5X increase in storage efficiency the requirements for the cloud or data center proportionately decrease. The same data is stored on data optimized storage that is now 80% less and is delivered with 20% of existing floor space, power and cooling costs.
  • Additional benefits are realized through data optimization in network bandwidth consumption, manpower requirements, operational systems needed to support the infrastructure and overall management of the cloud service provider or data center.

Market Drivers
Worldwide data growth is consistently in the 50% per year range. The storage necessary to house this data dramatically impacts enterprise IT operations and their capital budgets. Enterprises are evaluating and planning to use cloud storage to gain business agility and manage capital cost variations. Cloud service providers compete on location, cost, reputation and SLAs. Providers must increasingly differentiate their offering either by developing technology in house or by leveraging third party solutions from major storage vendors. .

Industry analysts, well aware of the impact of continued data growth on IT budgets and the rapid adoption of cloud storage, continue to observe the impact of how data optimization significantly increases IT efficiency and recommend data optimization technologies for all phases of data storage from primary through to the cloud.

At a recent Gartner Conference, one of the keynote speakers was adamant that throwing hardware at the problem of rampant data growth will not work. His view was that IT needs to optimize storage capacity consumption with virtualization, data deduplication and bandwidth optimization. I found this to be quite a contrarian view since the platform vendors have dominated the dialogue in IT informatics. Here was a keynote speaker saying hardware is not the answer to managing the data glut...it's a software fix that we need. Later in the event another session, another speaker, and data deduplication was raised as "emerging as a top opportunity to positively impact data growth because of its ability to reduce the amount of data consuming costly storage." Additionally, the discussion also evolved to include the "green impact" of reducing the amount of data which in turn impacts floor space, power and cooling consumption. Seems that deduplication and data optimization is a win-win.

Summary
Disruptive technologies deliver competitive advantage. Data optimization is one of those technologies that can make market leaders by clearly differentiating what they offer versus their competitors. Sometimes it's economic and other times it can be technical leadership. In the case of both economic and technology leadership, a market disruptive technology, such as data optimization, will drive market share growth and enable rapid business growth at the expense of competitors.

In the case of cloud storage, the first storage systems vendor to bring cloud storage products to market with integrated data optimization technology will gain a huge advantage in the rapidly growing cloud service provider space. In addition, their products will become deeply entrenched into the cloud provider infrastructure because they reduce storage costs and increase overall operational efficiency.

More Stories By Wayne Salpietro

Wayne Salpietro is the director of product and social media marketing at data storage and cloud backup services provider Permabit Technology Corp. He has served in this capacity for the past six years, prior to which he held product marketing and managerial roles at CA, HP, and IBM.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today that Juniper Networks (NYSE: JNPR), an industry leader in automated, scalable and secure networks, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Juniper Networks challenges the status quo with products, solutions and services that transform the economics of networking. The company co-innovates with customers and partners to deliver automated, scalable and secure network...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and 21st International Cloud Expo, which will take place in November in Silicon Valley, California.
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Val...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists will examine how DevOps helps to meet th...
SYS-CON Events announced today that Hitachi Data Systems, a wholly owned subsidiary of Hitachi LTD., will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City. Hitachi Data Systems (HDS) will be featuring the Hitachi Content Platform (HCP) portfolio. This is the industry’s only offering that allows organizations to bring together object storage, file sync and share, cloud storage gateways, and sophisticated search an...
SYS-CON Events announced today that Hitachi, the leading provider the Internet of Things and Digital Transformation, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Hitachi Data Systems, a wholly owned subsidiary of Hitachi, Ltd., offers an integrated portfolio of services and solutions that enable digital transformation through enhanced data management, governance, mobility and analytics. We help globa...
@DevOpsSummit has been named the ‘Top DevOps Influencer' by iTrend. iTred processes millions of conversations, tweets, interactions, news articles, press releases, blog posts - and extract meaning form them and analyzes mobile and desktop software platforms used to communicate, various metadata (such as geo location), and automation tools. In overall placement, @DevOpsSummit ranked as the number one ‘DevOps Influencer' followed by @CloudExpo at third, and @MicroservicesE at 24th.
Blockchain is a shared, secure record of exchange that establishes trust, accountability and transparency across supply chain networks. Supported by the Linux Foundation's open source, open-standards based Hyperledger Project, Blockchain has the potential to improve regulatory compliance, reduce cost and time for product recall as well as advance trade. Are you curious about Blockchain and how it can provide you with new opportunities for innovation and growth? In her session at 20th Cloud Exp...
Cloud promises the agility required by today’s digital businesses. As organizations adopt cloud based infrastructures and services, their IT resources become increasingly dynamic and hybrid in nature. Managing these require modern IT operations and tools. In his session at 20th Cloud Expo, Raj Sundaram, Senior Principal Product Manager at CA Technologies, will discuss how to modernize your IT operations in order to proactively manage your hybrid cloud and IT environments. He will be sharing be...
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single threaded, you can effectively identify hot spots in your serverless code. In his session at 20th Cloud Expo, David Martin, Principal Product Owner at CA Technologies, will give a live demonstration and code walkthrough, showing how to o...
The explosion of new web/cloud/IoT-based applications and the data they generate are transforming our world right before our eyes. In this rush to adopt these new technologies, organizations are often ignoring fundamental questions concerning who owns the data and failing to ask for permission to conduct invasive surveillance of their customers. Organizations that are not transparent about how their systems gather data telemetry without offering shared data ownership risk product rejection, regu...
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, discussed the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docker c...
SYS-CON Events announced today that Hitachi, the leading provider the Internet of Things and Digital Transformation, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Hitachi Data Systems, a wholly owned subsidiary of Hitachi, Ltd., offers an integrated portfolio of services and solutions that enable digital transformation through enhanced data management, governance, mobility and analytics. We help globa...
Cloud Expo, Inc. has announced today that Aruna Ravichandran, vice president of DevOps Product and Solutions Marketing at CA Technologies, has been named co-conference chair of DevOps at Cloud Expo 2017. The @DevOpsSummit at Cloud Expo New York will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and @DevOpsSummit at Cloud Expo Silicon Valley will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo 2016 in New York. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place June 6-8, 2017, at the Javits Center in New York City, New York, is co-located with 20th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry p...
SYS-CON Events announced today that Progress, a global leader in application development, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Enterprises today are rapidly adopting the cloud, while continuing to retain business-critical/sensitive data inside the firewall. This is creating two separate data silos – one inside the firewall and the other outside the firewall. Cloud ISVs oft...
Five years ago development was seen as a dead-end career, now it’s anything but – with an explosion in mobile and IoT initiatives increasing the demand for skilled engineers. But apart from having a ready supply of great coders, what constitutes true ‘DevOps Royalty’? It’ll be the ability to craft resilient architectures, supportability, security everywhere across the software lifecycle. In his keynote at @DevOpsSummit at 20th Cloud Expo, Jeffrey Scheaffer, GM and SVP, Continuous Delivery Busine...