Welcome!

SDN Journal Authors: Pat Romanski, Elizabeth White, ManageEngine IT Matters, Liz McMillan, Rishi Bhargava

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Linux Containers, @BigDataExpo, SDN Journal

@CloudExpo: Article

How Data Integration Is Changing the Enterprise Landscape

Cloud integration is now more important than ever to tackle increasingly complex integration challenges

Two words that are continually brought up in conversations at company meetings are "integration" and "cloud." According to leading analyst firm Gartner, by 2016 the growth of cloud computing will increase to become the bulk of new IT spend. The relative cost of cloud services as compared to handling integration in-house has historically hindered executives' decisions to implement cloud services and brokers. However, the undeniable benefits to cloud-based integration have now come to the forefront of consideration for C-level decision makers looking to relieve their companies of compliance challenges and security risks, while increasing the speed of data being transferred and analyzed. Putting the two words together, cloud integration is now more important than ever to tackle increasingly complex integration challenges.

As such, 2014 will be a disruptive year for integration providers, cloud services, Big Data and C-level executives looking to take full advantage of what data integration has to offer. Below are three trends companies can expect to see and incorporate into their businesses in the next year:

The Marriage of A2A and B2B Integration
By the end of this year, it is very possible the only people still separating Business-to-Business (B2B) and Application-to-Application (A2A) integration will be software vendors. Integration has historically been separated into the two distinct solutions of B2B and A2A, but as the year continues, we will see these two solution groups merge into one category, known simply as integration. No longer viewed as siloed entities, enterprises will be better able to manage and share information both internally and externally. Heavily influencing this holistic convergence is cloud-based integration. Additionally, the growth of cloud-based integration will continue to act as a fusing structure for evolving integration.

The Bifurcation of the Integration Market
Fueled by the increasing complexity of integration where "data-centric" computing has overtaken "application-centric" architectures, the integration market will bifurcate into two categories: "use case specific" and "use case independent" solutions, the latter of which will focus on the integration technology itself. With the demand for cloud services sold through brokerages expected to reach 20 percent, CSBs are becoming the go-to data-centric strategy for companies looking for an application-agnostic approach spanning across various providers to handle complex integration requirements associated with the growing classes of data generated.

For integration cloud brokers who optimize their offerings for specific "use cases," they will typically work within industries with repetitive implementations and low variation between customers. This model drives the complexity to the end points or the cloud applications. In these cases, providers advocate for common data models or "industry canonicals" with "connect once" marketing messages that entice customers with a simple integration story. However, integration complexity can pose some significant challenges in this market as providers try to address varying integration scenarios with over-simplified solutions.

Looking to the future, the more valuable and sustainable approach will focus on integration providers that embrace variations among customers, developing a core competency to deliver tailored solutions that fit each unique use case. This solution will necessarily yield lower margins, but will ultimately prevent customers from feeling forced to settle for less. This model is a foundational principle of mass customization applied to cloud integration services.

In the end, the two newly created markets will boil down to simple and complex frameworks. As Albert Einstein said it best, "things should be made as simple as possible but not simpler." It's important for both customers and providers to recognize that mass customization offerings, as would be proposed in the second market, are neither a technology nor sales technique, but rather a shift in organizational discipline, which may be difficult for many companies to handle.

Emergence of the Chief Data Officer
In recent years, it seems like a new C-level title is created and en vogue to capitalize on just about every emerging business trend. Some of these positions have more staying power than others. One position, in particular, that will continue to gain legitimacy is the CDO - the chief data officer. Over the past year, companies have become more aware of how data is being analyzed and communicated within their business as well as with partners and customers. Additionally, they have begun to embrace the evolution of data integration and data management to govern new analytics including applications, reporting, planning and social media. This growing emphasis on data management will be the catalyst that propels the CDO from early adopter status to mainstream C-level executive.

In essence, the CDO is the evolution of what most people know as the chief information officer. As with any executive position, the CDO will be faced with various challenges, including the increased complexity of data integration. The CDO's role will expand on the historically internal focus of integration to include external data integration. With 85 percent of respondents to IDC's recent study reporting that IT has become a more valuable partner to their businesses than it was three years ago, today's enterprise has more technology that needs to be integrated within the business. Additionally, the rise of cloud services, cloud application and mobile devices within a company is opening the door for more data, but leaving IT teams with more to manage and integrate.

The increasing presence of CSBs and cloud applications across businesses of all sizes and types is another area of focus that will be guided by the vision of the CDO. With expectations like analyst firm IDC's prediction of $100 billion to be spent on cloud and cloud services alone in 2014, CDOs will need to oversee both external customer and internal cloud implementations, solutions and services. Within this cloud framework, CDOs will be responsible for evaluating, designing and implementing cloud security that is compatible with compliance and integration efforts. As mentioned earlier, with the trend of working with CSBs on the rise, the need for more requirements, security and management will be necessary more than ever.

Last, according to IDC, the global Big Data technology and services market is expected to grow at a 31.7 percent compound annual growth rate. By 2016, it will reach $23.8 billion. With Big Data integration projects on the rise, companies will take advantage of opportunities to build out specific Big Data focused teams to complement solutions and address increasingly complex Big Data challenges. Leading these teams as well as overseeing internal Big Data issues and management, CDOs will be able to support their company as well as customers.

In the end, 2014 will be a dynamically shifting year for IT and the business leadership structure. With increased investments in cloud and cloud services, enterprises will be forced to take a serious look at data integration and management in the cloud to leverage the most effective solution that meets the needs and demands of each specific use case. To create and support this growing demand, the emergence of the chief data officer will be viewed as a necessary component to help champion these changes and provide the vision companies need to succeed. Ultimately, CDOs will be among the prominent new generation of leaders and change-makers who will aid in the growth and prosperity of current and prospective businesses.

More Stories By Bob Renner

Bob Renner is the President and CEO of Liaison Technologies. He has been in this role since 2002 and has successfully executed nine corporate acquisitions in the US and Europe. He acted as Liaison’s Chief Technology Officer in the company’s startup phase from 2000 – 2002.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He addres...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, ...
It’s 2016: buildings are smart, connected and the IoT is fundamentally altering how control and operating systems work and speak to each other. Platforms across the enterprise are networked via inexpensive sensors to collect massive amounts of data for analytics, information management, and insights that can be used to continuously improve operations. In his session at @ThingsExpo, Brian Chemel, Co-Founder and CTO of Digital Lumens, will explore: The benefits sensor-networked systems bring to ...
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
Much of IT terminology is often misused and misapplied. Modernization and transformation are two such terms. They are often used interchangeably even though they mean different things and have very different connotations. Indeed, it is somewhat safe to assume that in IT any transformative effort is likely to also have a modernizing effect, and thus, we can see these as levels of improvement efforts. However, many businesses are being led to believe if they don’t transform now they risk becoming ...
SYS-CON Events announced today the Enterprise IoT Bootcamp, being held November 1-2, 2016, in conjunction with 19th Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA. Combined with real-world scenarios and use cases, the Enterprise IoT Bootcamp is not just based on presentations but with hands-on demos and detailed walkthroughs. We will introduce you to a variety of real world use cases prototyped using Arduino, Raspberry Pi, BeagleBone, Spark, and Intel Edison. Y...
When building large, cloud-based applications that operate at a high scale, it’s important to maintain a high availability and resilience to failures. In order to do that, you must be tolerant of failures, even in light of failures in other areas of your application. “Fly two mistakes high” is an old adage in the radio control airplane hobby. It means, fly high enough so that if you make a mistake, you can continue flying with room to still make mistakes. In his session at 18th Cloud Expo, Lee...
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
"There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...
"Tintri was started in 2008 with the express purpose of building a storage appliance that is ideal for virtualized environments. We support a lot of different hypervisor platforms from VMware to OpenStack to Hyper-V," explained Dan Florea, Director of Product Management at Tintri, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
"Avere Systems is a hybrid cloud solution provider. We have customers that want to use cloud storage and we have customers that want to take advantage of cloud compute," explained Rebecca Thompson, VP of Marketing at Avere Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
SaaS companies can greatly expand revenue potential by pushing beyond their own borders. The challenge is how to do this without degrading service quality. In his session at 18th Cloud Expo, Adam Rogers, Managing Director at Anexia, discussed how IaaS providers with a global presence and both virtual and dedicated infrastructure can help companies expand their service footprint with low “go-to-market” costs.
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
Ovum, a leading technology analyst firm, has published an in-depth report, Ovum Decision Matrix: Selecting a DevOps Release Management Solution, 2016–17. The report focuses on the automation aspects of DevOps, Release Management and compares solutions from the leading vendors.
"This week we're really focusing on scalability, asset preservation and how do you back up to the cloud and in the cloud with object storage, which is really a new way of attacking dealing with your file, your blocked data, where you put it and how you access it," stated Jeff Greenwald, Senior Director of Market Development at HGST, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busin...
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...