Welcome!

SDN Journal Authors: Pat Romanski, Liz McMillan, Stefan Bernbo, Elizabeth White, TJ Randall

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, @BigDataExpo, SDN Journal

@CloudExpo: Article

How Data Integration Is Changing the Enterprise Landscape

Cloud integration is now more important than ever to tackle increasingly complex integration challenges

Two words that are continually brought up in conversations at company meetings are "integration" and "cloud." According to leading analyst firm Gartner, by 2016 the growth of cloud computing will increase to become the bulk of new IT spend. The relative cost of cloud services as compared to handling integration in-house has historically hindered executives' decisions to implement cloud services and brokers. However, the undeniable benefits to cloud-based integration have now come to the forefront of consideration for C-level decision makers looking to relieve their companies of compliance challenges and security risks, while increasing the speed of data being transferred and analyzed. Putting the two words together, cloud integration is now more important than ever to tackle increasingly complex integration challenges.

As such, 2014 will be a disruptive year for integration providers, cloud services, Big Data and C-level executives looking to take full advantage of what data integration has to offer. Below are three trends companies can expect to see and incorporate into their businesses in the next year:

The Marriage of A2A and B2B Integration
By the end of this year, it is very possible the only people still separating Business-to-Business (B2B) and Application-to-Application (A2A) integration will be software vendors. Integration has historically been separated into the two distinct solutions of B2B and A2A, but as the year continues, we will see these two solution groups merge into one category, known simply as integration. No longer viewed as siloed entities, enterprises will be better able to manage and share information both internally and externally. Heavily influencing this holistic convergence is cloud-based integration. Additionally, the growth of cloud-based integration will continue to act as a fusing structure for evolving integration.

The Bifurcation of the Integration Market
Fueled by the increasing complexity of integration where "data-centric" computing has overtaken "application-centric" architectures, the integration market will bifurcate into two categories: "use case specific" and "use case independent" solutions, the latter of which will focus on the integration technology itself. With the demand for cloud services sold through brokerages expected to reach 20 percent, CSBs are becoming the go-to data-centric strategy for companies looking for an application-agnostic approach spanning across various providers to handle complex integration requirements associated with the growing classes of data generated.

For integration cloud brokers who optimize their offerings for specific "use cases," they will typically work within industries with repetitive implementations and low variation between customers. This model drives the complexity to the end points or the cloud applications. In these cases, providers advocate for common data models or "industry canonicals" with "connect once" marketing messages that entice customers with a simple integration story. However, integration complexity can pose some significant challenges in this market as providers try to address varying integration scenarios with over-simplified solutions.

Looking to the future, the more valuable and sustainable approach will focus on integration providers that embrace variations among customers, developing a core competency to deliver tailored solutions that fit each unique use case. This solution will necessarily yield lower margins, but will ultimately prevent customers from feeling forced to settle for less. This model is a foundational principle of mass customization applied to cloud integration services.

In the end, the two newly created markets will boil down to simple and complex frameworks. As Albert Einstein said it best, "things should be made as simple as possible but not simpler." It's important for both customers and providers to recognize that mass customization offerings, as would be proposed in the second market, are neither a technology nor sales technique, but rather a shift in organizational discipline, which may be difficult for many companies to handle.

Emergence of the Chief Data Officer
In recent years, it seems like a new C-level title is created and en vogue to capitalize on just about every emerging business trend. Some of these positions have more staying power than others. One position, in particular, that will continue to gain legitimacy is the CDO - the chief data officer. Over the past year, companies have become more aware of how data is being analyzed and communicated within their business as well as with partners and customers. Additionally, they have begun to embrace the evolution of data integration and data management to govern new analytics including applications, reporting, planning and social media. This growing emphasis on data management will be the catalyst that propels the CDO from early adopter status to mainstream C-level executive.

In essence, the CDO is the evolution of what most people know as the chief information officer. As with any executive position, the CDO will be faced with various challenges, including the increased complexity of data integration. The CDO's role will expand on the historically internal focus of integration to include external data integration. With 85 percent of respondents to IDC's recent study reporting that IT has become a more valuable partner to their businesses than it was three years ago, today's enterprise has more technology that needs to be integrated within the business. Additionally, the rise of cloud services, cloud application and mobile devices within a company is opening the door for more data, but leaving IT teams with more to manage and integrate.

The increasing presence of CSBs and cloud applications across businesses of all sizes and types is another area of focus that will be guided by the vision of the CDO. With expectations like analyst firm IDC's prediction of $100 billion to be spent on cloud and cloud services alone in 2014, CDOs will need to oversee both external customer and internal cloud implementations, solutions and services. Within this cloud framework, CDOs will be responsible for evaluating, designing and implementing cloud security that is compatible with compliance and integration efforts. As mentioned earlier, with the trend of working with CSBs on the rise, the need for more requirements, security and management will be necessary more than ever.

Last, according to IDC, the global Big Data technology and services market is expected to grow at a 31.7 percent compound annual growth rate. By 2016, it will reach $23.8 billion. With Big Data integration projects on the rise, companies will take advantage of opportunities to build out specific Big Data focused teams to complement solutions and address increasingly complex Big Data challenges. Leading these teams as well as overseeing internal Big Data issues and management, CDOs will be able to support their company as well as customers.

In the end, 2014 will be a dynamically shifting year for IT and the business leadership structure. With increased investments in cloud and cloud services, enterprises will be forced to take a serious look at data integration and management in the cloud to leverage the most effective solution that meets the needs and demands of each specific use case. To create and support this growing demand, the emergence of the chief data officer will be viewed as a necessary component to help champion these changes and provide the vision companies need to succeed. Ultimately, CDOs will be among the prominent new generation of leaders and change-makers who will aid in the growth and prosperity of current and prospective businesses.

More Stories By Bob Renner

Bob Renner is the President and CEO of Liaison Technologies. He has been in this role since 2002 and has successfully executed nine corporate acquisitions in the US and Europe. He acted as Liaison’s Chief Technology Officer in the company’s startup phase from 2000 – 2002.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
It's easy to assume that your app will run on a fast and reliable network. The reality for your app's users, though, is often a slow, unreliable network with spotty coverage. What happens when the network doesn't work, or when the device is in airplane mode? You get unhappy, frustrated users. An offline-first app is an app that works, without error, when there is no network connection. In his session at 18th Cloud Expo, Bradley Holt, a Developer Advocate with IBM Cloud Data Services, discussed...
Between 2005 and 2020, data volumes will grow by a factor of 300 – enough data to stack CDs from the earth to the moon 162 times. This has come to be known as the ‘big data’ phenomenon. Unfortunately, traditional approaches to handling, storing and analyzing data aren’t adequate at this scale: they’re too costly, slow and physically cumbersome to keep up. Fortunately, in response a new breed of technology has emerged that is cheaper, faster and more scalable. Yet, in meeting these new needs they...
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at 20th Cloud Expo, Ed Featherston, director/senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busin...
According to Forrester Research, every business will become either a digital predator or digital prey by 2020. To avoid demise, organizations must rapidly create new sources of value in their end-to-end customer experiences. True digital predators also must break down information and process silos and extend digital transformation initiatives to empower employees with the digital resources needed to win, serve, and retain customers.
"We are the public cloud providers. We are currently providing 50% of the resources they need for doing e-commerce business in China and we are hosting about 60% of mobile gaming in China," explained Yi Zheng, CPO and VP of Engineering at CDS Global Cloud, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
"Once customers get a year into their IoT deployments, they start to realize that they may have been shortsighted in the ways they built out their deployment and the key thing I see a lot of people looking at is - how can I take equipment data, pull it back in an IoT solution and show it in a dashboard," stated Dave McCarthy, Director of Products at Bsquare Corporation, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
@DevOpsSummit taking place June 6-8, 2017 at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. @DevOpsSummit at Cloud Expo New York Call for Papers is now open.
Predictive analytics tools monitor, report, and troubleshoot in order to make proactive decisions about the health, performance, and utilization of storage. Most enterprises combine cloud and on-premise storage, resulting in blended environments of physical, virtual, cloud, and other platforms, which justifies more sophisticated storage analytics. In his session at 18th Cloud Expo, Peter McCallum, Vice President of Datacenter Solutions at FalconStor, discussed using predictive analytics to mon...
"We are an all-flash array storage provider but our focus has been on VM-aware storage specifically for virtualized applications," stated Dhiraj Sehgal of Tintri in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like “How is my application doing” but no id...
@GonzalezCarmen has been ranked the Number One Influencer and @ThingsExpo has been named the Number One Brand in the “M2M 2016: Top 100 Influencers and Brands” by Onalytica. Onalytica analyzed tweets over the last 6 months mentioning the keywords M2M OR “Machine to Machine.” They then identified the top 100 most influential brands and individuals leading the discussion on Twitter.
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
All clouds are not equal. To succeed in a DevOps context, organizations should plan to develop/deploy apps across a choice of on-premise and public clouds simultaneously depending on the business needs. This is where the concept of the Lean Cloud comes in - resting on the idea that you often need to relocate your app modules over their life cycles for both innovation and operational efficiency in the cloud. In his session at @DevOpsSummit at19th Cloud Expo, Valentin (Val) Bercovici, CTO of Soli...
"We're a cybersecurity firm that specializes in engineering security solutions both at the software and hardware level. Security cannot be an after-the-fact afterthought, which is what it's become," stated Richard Blech, Chief Executive Officer at Secure Channels, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
"IoT is going to be a huge industry with a lot of value for end users, for industries, for consumers, for manufacturers. How can we use cloud to effectively manage IoT applications," stated Ian Khan, Innovation & Marketing Manager at Solgeniakhela, in this SYS-CON.tv interview at @ThingsExpo, held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA.
Information technology is an industry that has always experienced change, and the dramatic change sweeping across the industry today could not be truthfully described as the first time we've seen such widespread change impacting customer investments. However, the rate of the change, and the potential outcomes from today's digital transformation has the distinct potential to separate the industry into two camps: Organizations that see the change coming, embrace it, and successful leverage it; and...
Join Impiger for their featured webinar: ‘Cloud Computing: A Roadmap to Modern Software Delivery’ on November 10, 2016, at 12:00 pm CST. Very few companies have not experienced some impact to their IT delivery due to the evolution of cloud computing. This webinar is not about deciding whether you should entertain moving some or all of your IT to the cloud, but rather, a detailed look under the hood to help IT professionals understand how cloud adoption has evolved and what trends will impact th...