Welcome!

SDN Journal Authors: Elizabeth White, Yeshim Deniz, Liz McMillan, Pat Romanski, TJ Randall

Blog Feed Post

SnapLogic: Because Bulldozers and Buses Don’t Fly

Have you ever wished that enterprise integration were as simple as snapping together LEGO Blocks? That’s the vision of San Mateo, California-based SnapLogic. The brainchild of Informatica co-founder Guarav Dhillon, SnapLogic offers a novel take on Integration-as-a-Service that is both Cloud-friendly as well as user-friendly. SnapLogic works both on-premise and in the Cloud – but don’t let the on-premise option fool you. This is no traditional integration product warmed over for the Cloud. Instead, SnapLogic is architected first and foremost for the Cloud while supporting hybrid as well as behind-the-firewall integration scenarios, making it a modern, enterprise-ready integration solution.

snaplogicWhile Dhillon cut his teeth on Extract-Transform-Load (ETL) approaches to integration at Informatica, SnapLogic moves past both this “bulldozer” approach to integration as well as the centralized, stateful “bus” approach that Enterprise Service Buses represent. Instead, the Cloud requires elasticity, stateless processing, and in Big Data situations, moving the logic to the data (what the industry has taken to calling the Data Gravity problem) – all requirements that SnapLogic addresses. However, while the enterprise-class integration technology under the covers is central to supporting customers’ business agility requirements, it’s the SnapLogic Designer tool that is downright sexy. Even so, this slick, streamlined interface is more than eye-candy, as it opens up previously complex integration tasks to a wider range of users, both simplifying and extending the power of the platform.

Snaplex: At the Heart of Cloud-Centric Architecture

SnapLogic architected its “Integration Cloud” following the model of Software-Defined Networking, which separates message interactions into a control plane and a data plane. SnapLogic hosts its control plane in the Amazon Web Services (AWS) Cloud. This component consists of the Designer, Manager, and Dashboard subcomponents, which manage the data plane. The control plane handles load balancing, security, task scheduling, and metadata management for the Integration Cloud.

At the core of the data plane is the Snaplex (or in reality, multiple Snaplexes). Snaplex is the data processing component of the Integration Cloud, and it comes in two flavors: the on-premise Groundplex and the in-Cloud Cloudplex. The Groundplex provides on-premise connectivity behind the corporate firewall, while SnapLogic preconfigures the Cloudplexes in the Integration Cloud.

Each Snaplex is inherently elastic, and the control plane can automatically scale the Snaplexes out or in as needed. As each Snaplex is a stateless processor, such scaling takes advantage of the partition tolerant nature of Cloud environments. This architectural choice on the part of SnapLogic is central to their product differentiation, as traditional middleware products do not cleanly separate the control and data planes, and thus have no way to perform elastic, stateless processing in the Cloud. You can’t simply take a traditional integration tool, stick it in the Cloud, and expect it to take advantage of the unique benefits that the Cloud provides. Instead, Integration-as-a-Service capabilities require a ground-up rethink of integration. SnapLogic has been down this road, and as a result, their product offers this advanced set of capabilities.

SnapLogic Designer: Integration as Simple as LEGO Blocks

Many of today’s integration tools have slick user interfaces, but SnapLogic took extra care to make theirs user-friendly for both deeply technical and casually technical audiences alike. Each element is a Snap, and the Snaps snap together with a pleasant click sound. The connector symbols on the end of each Snap refer to other Snaps it can connect to (document or binary). Configuring each Snap is a simple matter of clicking on it and entering basic configuration information. SnapLogic Designer appears in the figure below.

SnapLogic Screenshot

SnapLogic Designer (Source: SnapLogic)

SnapLogic ships with over 160 pre-built Snaps (and an SDK to build new ones), making integration a snap (pun intended).

The Intellyx Take

SnapLogic Designer doesn’t simply present a seamless user interface; it offers a powerful abstraction. Abstractions are intentional simplifications that hide underlying capabilities, and in the case of SnapLogic, the capabilities under the covers are where the real power lies. Remember, SnapLogic integrates on-premise and Cloud-based resources while supporting the full elasticity of the Cloud environment – a complicated challenge for any application. Don’t let the simplicity and friendliness of the user interface fool you. This is a powerful, enterprise-class tool.

Abstractions are also at the core of the Bloomberg Agile Architecture™ (BAA) Technique, which recommends that application creators (and integrators) work at the abstract model level. The role of the abstract model in the BAA Technique is both to present a simplified modeling capability to users while abstracting real-time resolution of API contracts and data formats. For tools that are able to implement this capability, the result is inherently flexible integration that responds to changes in APIs dynamically in real time.

SnapLogic clearly has the simplified modeling capability that facilitates the BAA Technique. Furthermore, SnapLogic does not require a fixed schema for an API interaction (except where the API requires it to be fixed), and SnapLogic allows the schema to be flexible so that integrations don’t break when any changes in the API requests and responses take place. When critical changes occur, SnapLogic handles them as a graceful degradation. If any references are made to schema fields which may no longer exist in the data flow, SnapLogic ensures that failures don’t cause unforeseen errors.

In most circumstances, SnapLogic’s approach to API change won’t present much of a limitation, as the platform separates the design time aspects of creating and configuring integrations in the Designer from the run time aspects that the Snaplexes handle. Far more important is SnapLogic’s ability to elastically scale out and in, thus supporting changing capacity requirements – an essential enabler of business agility for any enterprise moving to the Cloud.

Intellyx has no business relationship with SnapLogic at the time of writing.

Read the original blog entry...

More Stories By Jason Bloomberg

Jason Bloomberg is a leading IT industry analyst, Forbes contributor, keynote speaker, and globally recognized expert on multiple disruptive trends in enterprise technology and digital transformation. He is ranked #5 on Onalytica’s list of top Digital Transformation influencers for 2018 and #15 on Jax’s list of top DevOps influencers for 2017, the only person to appear on both lists.

As founder and president of Agile Digital Transformation analyst firm Intellyx, he advises, writes, and speaks on a diverse set of topics, including digital transformation, artificial intelligence, cloud computing, devops, big data/analytics, cybersecurity, blockchain/bitcoin/cryptocurrency, no-code/low-code platforms and tools, organizational transformation, internet of things, enterprise architecture, SD-WAN/SDX, mainframes, hybrid IT, and legacy transformation, among other topics.

Mr. Bloomberg’s articles in Forbes are often viewed by more than 100,000 readers. During his career, he has published over 1,200 articles (over 200 for Forbes alone), spoken at over 400 conferences and webinars, and he has been quoted in the press and blogosphere over 2,000 times.

Mr. Bloomberg is the author or coauthor of four books: The Agile Architecture Revolution (Wiley, 2013), Service Orient or Be Doomed! How Service Orientation Will Change Your Business (Wiley, 2006), XML and Web Services Unleashed (SAMS Publishing, 2002), and Web Page Scripting Techniques (Hayden Books, 1996). His next book, Agile Digital Transformation, is due within the next year.

At SOA-focused industry analyst firm ZapThink from 2001 to 2013, Mr. Bloomberg created and delivered the Licensed ZapThink Architect (LZA) Service-Oriented Architecture (SOA) course and associated credential, certifying over 1,700 professionals worldwide. He is one of the original Managing Partners of ZapThink LLC, which was acquired by Dovel Technologies in 2011.

Prior to ZapThink, Mr. Bloomberg built a diverse background in eBusiness technology management and industry analysis, including serving as a senior analyst in IDC’s eBusiness Advisory group, as well as holding eBusiness management positions at USWeb/CKS (later marchFIRST) and WaveBend Solutions (now Hitachi Consulting), and several software and web development positions.

@CloudExpo Stories
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smart...
DXWorldEXPO LLC announced today that ICC-USA, a computer systems integrator and server manufacturing company focused on developing products and product appliances, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City. ICC is a computer systems integrator and server manufacturing company focused on developing products and product appliances to meet a wide range of ...
We all know that end users experience the Internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices – not doing so will be a path to eventual b...
Major trends and emerging technologies – from virtual reality and IoT, to Big Data and algorithms – are helping organizations innovate in the digital era. However, to create real business value, IT must think beyond the ‘what’ of digital transformation to the ‘how’ to harness emerging trends, innovation and disruption. Architecture is the key that underpins and ties all these efforts together. In the digital age, it’s important to invest in architecture, extend the enterprise footprint to the cl...
Sanjeev Sharma Joins November 11-13, 2018 @DevOpsSummit at @CloudEXPO New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
As Cybric's Chief Technology Officer, Mike D. Kail is responsible for the strategic vision and technical direction of the platform. Prior to founding Cybric, Mike was Yahoo's CIO and SVP of Infrastructure, where he led the IT and Data Center functions for the company. He has more than 24 years of IT Operations experience with a focus on highly-scalable architectures.
Headquartered in Plainsboro, NJ, Synametrics Technologies has provided IT professionals and computer systems developers since 1997. Based on the success of their initial product offerings (WinSQL and DeltaCopy), the company continues to create and hone innovative products that help its customers get more from their computer applications, databases and infrastructure. To date, over one million users around the world have chosen Synametrics solutions to help power their accelerated business or per...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and ...
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT staff augmentation services for software technology providers. By providing clients with unparalleled niche technology expertise and industry experience, Chetu has become the premiere long-term, back-end software development partner for start-ups, SMBs, and Fortune 500 companies. Chetu is headquartered in Plantation, Florida, with thirteen offices throughout the U.S. and abroad.
DXWorldEXPO LLC announced today that Dez Blanchfield joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Dez is a strategic leader in business and digital transformation with 25 years of experience in the IT and telecommunications industries developing strategies and implementing business initiatives. He has a breadth of expertise spanning technologies such as cloud computing, big data and analytics, cognitive computing, m...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
HyperConvergence came to market with the objective of being simple, flexible and to help drive down operating expenses. It reduced the footprint by bundling the compute/storage/network into one box. This brought a new set of challenges as the HyperConverged vendors are very focused on their own proprietary building blocks. If you want to scale in a certain way, let's say you identified a need for more storage and want to add a device that is not sold by the HyperConverged vendor, forget about it...
Historically, some banking activities such as trading have been relying heavily on analytics and cutting edge algorithmic tools. The coming of age of powerful data analytics solutions combined with the development of intelligent algorithms have created new opportunities for financial institutions. In his session at 20th Cloud Expo, Sebastien Meunier, Head of Digital for North America at Chappuis Halder & Co., discussed how these tools can be leveraged to develop a lasting competitive advantage ...
In his session at 21st Cloud Expo, James Henry, Co-CEO/CTO of Calgary Scientific Inc., introduced you to the challenges, solutions and benefits of training AI systems to solve visual problems with an emphasis on improving AIs with continuous training in the field. He explored applications in several industries and discussed technologies that allow the deployment of advanced visualization solutions to the cloud.