Click here to close now.


SDN Journal Authors: Lori MacVittie, Liz McMillan, Dinko Eror, Pat Romanski, Peter Silva

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, @BigDataExpo, SDN Journal

@CloudExpo: Article

How Data Integration Is Changing the Enterprise Landscape

Cloud integration is now more important than ever to tackle increasingly complex integration challenges

Two words that are continually brought up in conversations at company meetings are "integration" and "cloud." According to leading analyst firm Gartner, by 2016 the growth of cloud computing will increase to become the bulk of new IT spend. The relative cost of cloud services as compared to handling integration in-house has historically hindered executives' decisions to implement cloud services and brokers. However, the undeniable benefits to cloud-based integration have now come to the forefront of consideration for C-level decision makers looking to relieve their companies of compliance challenges and security risks, while increasing the speed of data being transferred and analyzed. Putting the two words together, cloud integration is now more important than ever to tackle increasingly complex integration challenges.

As such, 2014 will be a disruptive year for integration providers, cloud services, Big Data and C-level executives looking to take full advantage of what data integration has to offer. Below are three trends companies can expect to see and incorporate into their businesses in the next year:

The Marriage of A2A and B2B Integration
By the end of this year, it is very possible the only people still separating Business-to-Business (B2B) and Application-to-Application (A2A) integration will be software vendors. Integration has historically been separated into the two distinct solutions of B2B and A2A, but as the year continues, we will see these two solution groups merge into one category, known simply as integration. No longer viewed as siloed entities, enterprises will be better able to manage and share information both internally and externally. Heavily influencing this holistic convergence is cloud-based integration. Additionally, the growth of cloud-based integration will continue to act as a fusing structure for evolving integration.

The Bifurcation of the Integration Market
Fueled by the increasing complexity of integration where "data-centric" computing has overtaken "application-centric" architectures, the integration market will bifurcate into two categories: "use case specific" and "use case independent" solutions, the latter of which will focus on the integration technology itself. With the demand for cloud services sold through brokerages expected to reach 20 percent, CSBs are becoming the go-to data-centric strategy for companies looking for an application-agnostic approach spanning across various providers to handle complex integration requirements associated with the growing classes of data generated.

For integration cloud brokers who optimize their offerings for specific "use cases," they will typically work within industries with repetitive implementations and low variation between customers. This model drives the complexity to the end points or the cloud applications. In these cases, providers advocate for common data models or "industry canonicals" with "connect once" marketing messages that entice customers with a simple integration story. However, integration complexity can pose some significant challenges in this market as providers try to address varying integration scenarios with over-simplified solutions.

Looking to the future, the more valuable and sustainable approach will focus on integration providers that embrace variations among customers, developing a core competency to deliver tailored solutions that fit each unique use case. This solution will necessarily yield lower margins, but will ultimately prevent customers from feeling forced to settle for less. This model is a foundational principle of mass customization applied to cloud integration services.

In the end, the two newly created markets will boil down to simple and complex frameworks. As Albert Einstein said it best, "things should be made as simple as possible but not simpler." It's important for both customers and providers to recognize that mass customization offerings, as would be proposed in the second market, are neither a technology nor sales technique, but rather a shift in organizational discipline, which may be difficult for many companies to handle.

Emergence of the Chief Data Officer
In recent years, it seems like a new C-level title is created and en vogue to capitalize on just about every emerging business trend. Some of these positions have more staying power than others. One position, in particular, that will continue to gain legitimacy is the CDO - the chief data officer. Over the past year, companies have become more aware of how data is being analyzed and communicated within their business as well as with partners and customers. Additionally, they have begun to embrace the evolution of data integration and data management to govern new analytics including applications, reporting, planning and social media. This growing emphasis on data management will be the catalyst that propels the CDO from early adopter status to mainstream C-level executive.

In essence, the CDO is the evolution of what most people know as the chief information officer. As with any executive position, the CDO will be faced with various challenges, including the increased complexity of data integration. The CDO's role will expand on the historically internal focus of integration to include external data integration. With 85 percent of respondents to IDC's recent study reporting that IT has become a more valuable partner to their businesses than it was three years ago, today's enterprise has more technology that needs to be integrated within the business. Additionally, the rise of cloud services, cloud application and mobile devices within a company is opening the door for more data, but leaving IT teams with more to manage and integrate.

The increasing presence of CSBs and cloud applications across businesses of all sizes and types is another area of focus that will be guided by the vision of the CDO. With expectations like analyst firm IDC's prediction of $100 billion to be spent on cloud and cloud services alone in 2014, CDOs will need to oversee both external customer and internal cloud implementations, solutions and services. Within this cloud framework, CDOs will be responsible for evaluating, designing and implementing cloud security that is compatible with compliance and integration efforts. As mentioned earlier, with the trend of working with CSBs on the rise, the need for more requirements, security and management will be necessary more than ever.

Last, according to IDC, the global Big Data technology and services market is expected to grow at a 31.7 percent compound annual growth rate. By 2016, it will reach $23.8 billion. With Big Data integration projects on the rise, companies will take advantage of opportunities to build out specific Big Data focused teams to complement solutions and address increasingly complex Big Data challenges. Leading these teams as well as overseeing internal Big Data issues and management, CDOs will be able to support their company as well as customers.

In the end, 2014 will be a dynamically shifting year for IT and the business leadership structure. With increased investments in cloud and cloud services, enterprises will be forced to take a serious look at data integration and management in the cloud to leverage the most effective solution that meets the needs and demands of each specific use case. To create and support this growing demand, the emergence of the chief data officer will be viewed as a necessary component to help champion these changes and provide the vision companies need to succeed. Ultimately, CDOs will be among the prominent new generation of leaders and change-makers who will aid in the growth and prosperity of current and prospective businesses.

More Stories By Bob Renner

Bob Renner is the President and CEO of Liaison Technologies. He has been in this role since 2002 and has successfully executed nine corporate acquisitions in the US and Europe. He acted as Liaison’s Chief Technology Officer in the company’s startup phase from 2000 – 2002.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@CloudExpo Stories
Interested in leveraging automation technologies and a cloud architecture to make developers more productive? Learn how PaaS can benefit your organization to help you streamline your application development, allow you to use existing infrastructure and improve operational efficiencies. Begin charting your path to PaaS with OpenShift Enterprise.
SYS-CON Events announced today that Luxoft Holding, Inc., a leading provider of software development services and innovative IT solutions, has been named “Bronze Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Luxoft’s software development services consist of core and mission-critical custom software development and support, product engineering and testing, and technology consulting.
Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of at least three separate application components: the software embedded in the device, the backend big-data service, and the mobile application for the end user's controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/...
Data loss happens, even in the cloud. In fact, if your company has adopted a cloud application in the past three years, data loss has probably happened, whether you know it or not. In his session at 17th Cloud Expo, Bryan Forrester, Senior Vice President of Sales at eFolder, will present how common and costly cloud application data loss is and what measures you can take to protect your organization from data loss.
SYS-CON Events announced today that G2G3 will exhibit at SYS-CON's @DevOpsSummit Silicon Valley, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Based on a collective appreciation for user experience, design, and technology, G2G3 is uniquely qualified and motivated to redefine how organizations and people engage in an increasingly digital world.
SYS-CON Events announced today that IBM Cloud Data Services has been named “Bronze Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. IBM Cloud Data Services offers a portfolio of integrated, best-of-breed cloud data services for developers focused on mobile computing and analytics use cases.
In his session at @ThingsExpo, Tony Shan, Chief Architect at CTS, will explore the synergy of Big Data and IoT. First he will take a closer look at the Internet of Things and Big Data individually, in terms of what, which, why, where, when, who, how and how much. Then he will explore the relationship between IoT and Big Data. Specifically, he will drill down to how the 4Vs aspects intersect with IoT: Volume, Variety, Velocity and Value. In turn, Tony will analyze how the key components of IoT ...
When it comes to IoT in the enterprise, namely the commercial building and hospitality markets, a benefit not getting the attention it deserves is energy efficiency, and IoT’s direct impact on a cleaner, greener environment when installed in smart buildings. Until now clean technology was offered piecemeal and led with point solutions that require significant systems integration to orchestrate and deploy. There didn't exist a 'top down' approach that can manage and monitor the way a Smart Buildi...
SYS-CON Events announced today that Cloud Raxak has been named “Media & Session Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Raxak Protect automates security compliance across private and public clouds. Using the SaaS tool or managed service, developers can deploy cloud apps quickly, cost-effectively, and without error.
As-a-service models offer huge opportunities, but also complicate security. It may seem that the easiest way to migrate to a new architectural model is to let others, experts in their field, do the work. This has given rise to many as-a-service models throughout the industry and across the entire technology stack, from software to infrastructure. While this has unlocked huge opportunities to accelerate the deployment of new capabilities or increase economic efficiencies within an organization, i...
“All our customers are looking at the cloud ecosystem as an important part of their overall product strategy. Some see it evolve as a multi-cloud / hybrid cloud strategy, while others are embracing all forms of cloud offerings like PaaS, IaaS and SaaS in their solutions,” noted Suhas Joshi, Vice President – Technology, at Harbinger Group, in this exclusive Q&A with Cloud Expo Conference Chair Roger Strukhoff.
SYS-CON Events announced today that ProfitBricks, the provider of painless cloud infrastructure, will exhibit at SYS-CON's 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. ProfitBricks is the IaaS provider that offers a painless cloud experience for all IT users, with no learning curve. ProfitBricks boasts flexible cloud servers and networking, an integrated Data Center Designer tool for visual control over the...
You have your devices and your data, but what about the rest of your Internet of Things story? Two popular classes of technologies that nicely handle the Big Data analytics for Internet of Things are Apache Hadoop and NoSQL. Hadoop is designed for parallelizing analytical work across many servers and is ideal for the massive data volumes you create with IoT devices. NoSQL databases such as Apache HBase are ideal for storing and retrieving IoT data as “time series data.”
Clearly the way forward is to move to cloud be it bare metal, VMs or containers. One aspect of the current public clouds that is slowing this cloud migration is cloud lock-in. Every cloud vendor is trying to make it very difficult to move out once a customer has chosen their cloud. In his session at 17th Cloud Expo, Naveen Nimmu, CEO of Clouber, Inc., will advocate that making the inter-cloud migration as simple as changing airlines would help the entire industry to quickly adopt the cloud wit...
As the world moves towards more DevOps and microservices, application deployment to the cloud ought to become a lot simpler. The microservices architecture, which is the basis of many new age distributed systems such as OpenStack, NetFlix and so on, is at the heart of Cloud Foundry - a complete developer-oriented Platform as a Service (PaaS) that is IaaS agnostic and supports vCloud, OpenStack and AWS. In his session at 17th Cloud Expo, Raghavan "Rags" Srinivas, an Architect/Developer Evangeli...
Cloud computing delivers on-demand resources that provide businesses with flexibility and cost-savings. The challenge in moving workloads to the cloud has been the cost and complexity of ensuring the initial and ongoing security and regulatory (PCI, HIPAA, FFIEC) compliance across private and public clouds. Manual security compliance is slow, prone to human error, and represents over 50% of the cost of managing cloud applications. Determining how to automate cloud security compliance is critical...
SYS-CON Events announced today that VividCortex, the monitoring solution for the modern data system, will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. The database is the heart of most applications, but it’s also the part that’s hardest to scale, monitor, and optimize even as it’s growing 50% year over year. VividCortex is the first unified suite of database monitoring tools specifically desi...
Organizations already struggle with the simple collection of data resulting from the proliferation of IoT, lacking the right infrastructure to manage it. They can't only rely on the cloud to collect and utilize this data because many applications still require dedicated infrastructure for security, redundancy, performance, etc. In his session at 17th Cloud Expo, Emil Sayegh, CEO of Codero Hosting, will discuss how in order to resolve the inherent issues, companies need to combine dedicated a...
SYS-CON Events announced today that Key Information Systems, Inc. (KeyInfo), a leading cloud and infrastructure provider offering integrated solutions to enterprises, will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Key Information Systems is a leading regional systems integrator with world-class compute, storage and networking solutions and professional services for the most advanced softwa...
Culture is the most important ingredient of DevOps. The challenge for most organizations is defining and communicating a vision of beneficial DevOps culture for their organizations, and then facilitating the changes needed to achieve that. Often this comes down to an ability to provide true leadership. As a CIO, are your direct reports IT managers or are they IT leaders? The hard truth is that many IT managers have risen through the ranks based on their technical skills, not their leadership ab...