Welcome!

SDN Journal Authors: Stefan Bernbo, Michel Courtoy, Amitabh Sinha, Mike Wood, Liz McMillan

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, @BigDataExpo, SDN Journal

@CloudExpo: Article

How Data Integration Is Changing the Enterprise Landscape

Cloud integration is now more important than ever to tackle increasingly complex integration challenges

Two words that are continually brought up in conversations at company meetings are "integration" and "cloud." According to leading analyst firm Gartner, by 2016 the growth of cloud computing will increase to become the bulk of new IT spend. The relative cost of cloud services as compared to handling integration in-house has historically hindered executives' decisions to implement cloud services and brokers. However, the undeniable benefits to cloud-based integration have now come to the forefront of consideration for C-level decision makers looking to relieve their companies of compliance challenges and security risks, while increasing the speed of data being transferred and analyzed. Putting the two words together, cloud integration is now more important than ever to tackle increasingly complex integration challenges.

As such, 2014 will be a disruptive year for integration providers, cloud services, Big Data and C-level executives looking to take full advantage of what data integration has to offer. Below are three trends companies can expect to see and incorporate into their businesses in the next year:

The Marriage of A2A and B2B Integration
By the end of this year, it is very possible the only people still separating Business-to-Business (B2B) and Application-to-Application (A2A) integration will be software vendors. Integration has historically been separated into the two distinct solutions of B2B and A2A, but as the year continues, we will see these two solution groups merge into one category, known simply as integration. No longer viewed as siloed entities, enterprises will be better able to manage and share information both internally and externally. Heavily influencing this holistic convergence is cloud-based integration. Additionally, the growth of cloud-based integration will continue to act as a fusing structure for evolving integration.

The Bifurcation of the Integration Market
Fueled by the increasing complexity of integration where "data-centric" computing has overtaken "application-centric" architectures, the integration market will bifurcate into two categories: "use case specific" and "use case independent" solutions, the latter of which will focus on the integration technology itself. With the demand for cloud services sold through brokerages expected to reach 20 percent, CSBs are becoming the go-to data-centric strategy for companies looking for an application-agnostic approach spanning across various providers to handle complex integration requirements associated with the growing classes of data generated.

For integration cloud brokers who optimize their offerings for specific "use cases," they will typically work within industries with repetitive implementations and low variation between customers. This model drives the complexity to the end points or the cloud applications. In these cases, providers advocate for common data models or "industry canonicals" with "connect once" marketing messages that entice customers with a simple integration story. However, integration complexity can pose some significant challenges in this market as providers try to address varying integration scenarios with over-simplified solutions.

Looking to the future, the more valuable and sustainable approach will focus on integration providers that embrace variations among customers, developing a core competency to deliver tailored solutions that fit each unique use case. This solution will necessarily yield lower margins, but will ultimately prevent customers from feeling forced to settle for less. This model is a foundational principle of mass customization applied to cloud integration services.

In the end, the two newly created markets will boil down to simple and complex frameworks. As Albert Einstein said it best, "things should be made as simple as possible but not simpler." It's important for both customers and providers to recognize that mass customization offerings, as would be proposed in the second market, are neither a technology nor sales technique, but rather a shift in organizational discipline, which may be difficult for many companies to handle.

Emergence of the Chief Data Officer
In recent years, it seems like a new C-level title is created and en vogue to capitalize on just about every emerging business trend. Some of these positions have more staying power than others. One position, in particular, that will continue to gain legitimacy is the CDO - the chief data officer. Over the past year, companies have become more aware of how data is being analyzed and communicated within their business as well as with partners and customers. Additionally, they have begun to embrace the evolution of data integration and data management to govern new analytics including applications, reporting, planning and social media. This growing emphasis on data management will be the catalyst that propels the CDO from early adopter status to mainstream C-level executive.

In essence, the CDO is the evolution of what most people know as the chief information officer. As with any executive position, the CDO will be faced with various challenges, including the increased complexity of data integration. The CDO's role will expand on the historically internal focus of integration to include external data integration. With 85 percent of respondents to IDC's recent study reporting that IT has become a more valuable partner to their businesses than it was three years ago, today's enterprise has more technology that needs to be integrated within the business. Additionally, the rise of cloud services, cloud application and mobile devices within a company is opening the door for more data, but leaving IT teams with more to manage and integrate.

The increasing presence of CSBs and cloud applications across businesses of all sizes and types is another area of focus that will be guided by the vision of the CDO. With expectations like analyst firm IDC's prediction of $100 billion to be spent on cloud and cloud services alone in 2014, CDOs will need to oversee both external customer and internal cloud implementations, solutions and services. Within this cloud framework, CDOs will be responsible for evaluating, designing and implementing cloud security that is compatible with compliance and integration efforts. As mentioned earlier, with the trend of working with CSBs on the rise, the need for more requirements, security and management will be necessary more than ever.

Last, according to IDC, the global Big Data technology and services market is expected to grow at a 31.7 percent compound annual growth rate. By 2016, it will reach $23.8 billion. With Big Data integration projects on the rise, companies will take advantage of opportunities to build out specific Big Data focused teams to complement solutions and address increasingly complex Big Data challenges. Leading these teams as well as overseeing internal Big Data issues and management, CDOs will be able to support their company as well as customers.

In the end, 2014 will be a dynamically shifting year for IT and the business leadership structure. With increased investments in cloud and cloud services, enterprises will be forced to take a serious look at data integration and management in the cloud to leverage the most effective solution that meets the needs and demands of each specific use case. To create and support this growing demand, the emergence of the chief data officer will be viewed as a necessary component to help champion these changes and provide the vision companies need to succeed. Ultimately, CDOs will be among the prominent new generation of leaders and change-makers who will aid in the growth and prosperity of current and prospective businesses.

More Stories By Bob Renner

Bob Renner is the President and CEO of Liaison Technologies. He has been in this role since 2002 and has successfully executed nine corporate acquisitions in the US and Europe. He acted as Liaison’s Chief Technology Officer in the company’s startup phase from 2000 – 2002.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
"We are an IT services solution provider and we sell software to support those solutions. Our focus and key areas are around security, enterprise monitoring, and continuous delivery optimization," noted John Balsavage, President of A&I Solutions, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We want to show that our solution is far less expensive with a much better total cost of ownership so we announced several key features. One is called geo-distributed erasure coding, another is support for KVM and we introduced a new capability called Multi-Part," explained Tim Desai, Senior Product Marketing Manager at Hitachi Data Systems, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
"The Striim platform is a full end-to-end streaming integration and analytics platform that is middleware that covers a lot of different use cases," explained Steve Wilkes, Founder and CTO at Striim, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Calligo, an innovative cloud service provider offering mid-sized companies the highest levels of data privacy and security, has been named "Bronze Sponsor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalised support service from its globally located cloud plat...
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
Kubernetes is an open source system for automating deployment, scaling, and management of containerized applications. Kubernetes was originally built by Google, leveraging years of experience with managing container workloads, and is now a Cloud Native Compute Foundation (CNCF) project. Kubernetes has been widely adopted by the community, supported on all major public and private cloud providers, and is gaining rapid adoption in enterprises. However, Kubernetes may seem intimidating and complex ...
"Outscale was founded in 2010, is based in France, is a strategic partner to Dassault Systémes and has done quite a bit of work with divisions of Dassault," explained Jackie Funk, Digital Marketing exec at Outscale, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We focus on SAP workloads because they are among the most powerful but somewhat challenging workloads out there to take into public cloud," explained Swen Conrad, CEO of Ocean9, Inc., in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"I think DevOps is now a rambunctious teenager – it’s starting to get a mind of its own, wanting to get its own things but it still needs some adult supervision," explained Thomas Hooker, VP of marketing at CollabNet, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We are still a relatively small software house and we are focusing on certain industries like FinTech, med tech, energy and utilities. We help our customers with their digital transformation," noted Piotr Stawinski, Founder and CEO of EARP Integration, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We've been engaging with a lot of customers including Panasonic, we've been involved with Cisco and now we're working with the U.S. government - the Department of Homeland Security," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We're here to tell the world about our cloud-scale infrastructure that we have at Juniper combined with the world-class security that we put into the cloud," explained Lisa Guess, VP of Systems Engineering at Juniper Networks, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...