Welcome!

SDN Journal Authors: Elizabeth White, Destiny Bertucci, Liz McMillan, Jignesh Solanki, Daniel Gordon

Related Topics: Recurring Revenue, Microservices Expo, @CloudExpo, @DXWorldExpo, @ThingsExpo, @DevOpsSummit

Recurring Revenue: Article

Data Lake and APIs | @CloudExpo #API #AI #ML #DX #CloudNative #DataLake

In this article we take you through the connected world of APIs and how you can reap maximum value

The Omnipresent World of APIs

These days, APIs have become an integral part of the digital transformation journey for all enterprises. Every digital innovation story is connected to APIs . But have you ever pondered over to know what are the source of these APIs?

Let me explain - APIs sources can be varied, internal or external, solving different purposes, but mostly categorized into the following two categories:

  • Data lakes is a term used to represent disconnected but relevant data that are used by various business units within an enterprise.  APIs are created as the easy access points for these siloed data lakes.
  • These days, organizations put in  conscious efforts in designing meaningful and pragmatic APIs for all the apps that get developed internally.  API-First or API Driven Development, where APIs are the first app artifacts to be generated, are adapted by enterprises as a part of their app development efforts.  In modern app development, as much as the apps share APIs generated internally, they also have to deal with a plethora of external APIs.  These external API are fed from SaaS services (eg. Google Calendar), API marketplaces (mashape) and integration clouds(e.g. Zapier).

With new technologies like IoT gaining traction,  there is going to be a proliferation of  APIs very soon.

API Management tools
How do enterprises manage these flurry of APIs that get generated?  How do they leverage these APIs to make them as easily accessible touch points for both internal and external stake holders, complete with security, subscription, plans, API rate limiting etc?  The answer is enterprises use API Management platforms/tools for the said purpose.

API management platforms help enterprises manage all aspects of APIs as defined above, ease the process of API access to all stakeholders and in general address all the management aspects of the entire API lifecycle.

Typical API sharing and consumption process
API Management tools typically take as input, all the APIs at its disposable and attaches multiple attributes like security, rate limiting, subscription plans etc. to each of those APIs.  These tools also provide something called as an API or a Developer portal.  This portal is a one point portal for searching and subscribing to APIs.

The typical process looks like as is shown in the following set of images for a fictitious company called Movi.  We have also used screens from WaveMaker low code platform for some illustrations.

This is a templatized approach followed by organizations who try to share their APIs with external (as well as internal) stakeholders.  But is this  process as shown in step 4, effective? Do organizations get the RoI from their investment on APIs quickly?

Loopholes with the current API management setup - Low RoI
The fact is that APIs, at the end of the day, are entities consumed inside an app.  With that in mind, consider some of the glaring issues with the current API consumption model, as listed below:

  • There exists competitive barriers for rapid proliferation of these APIs by enabling a much larger audience to build apps using those APIs.  Competitive barriers are because of  of a big super set of users with great ideas but no app coding skills than there are users with app coding skills.
  • Turnaround time from when APIs are published to when the API is really consumed in an app is longer due to the complexities surrounding the API documentation and consumption related technical intricacies.

What we need is to :

  • Remove the technical friction for anyone wanting to start building apps
  • Make it easier and faster for anyone to build apps to your APIs to increase the RoI faster

Let's fix it.  Remove the friction between app building and API access

The issues seem to have a very easy solution but probably needs the enterprise move up in the value chain of becoming a "Digital Enterprise".  The answer lies in adopting a low code development platform that can work out wonders in solving these issues.  Let me explain these in simple visual steps below:

1) Let's start with a simple change to the existing process as shown in figure-1, by adding an app creation step.  This will help in users to not just subscribe to an API plan but also start working on app instantly.  More details in the next steps will make this simple addition work wonders.

2) Start the developer portal registration exercise as always...

3) However during the registration process, we make sure to add an instant app creation step to facilitate users.  The button click will lead the users to a low code platform for visual app creation.  It's all in the mind!  This simple change in the registration workflow allows the user to instantly start creating an app and the exercise is not just limited to API access.

4) Once the users clicks the button, they get logged into a low code platform.  Note we have used screen mocks from WaveMaker low code platform.  But the user is not left in lurch.  He is not left to the mercy of documentation and forums to start integrating the APIs into the app.  A templatized app pre exists inside the platform with all the relevant artifacts for consuming the APIs and this  can help users to significantly speed up app creation.

5)  Inside the Movi app, pre-integrate with the most commonly used APIs in the application.  This will take away all the complexities associated with the API, like documentation, parameters, headers etc. and lets the user focus on just app business logic and end user experience

6) A well defined templated app inside a low code platform would also provide pre-existing drag-n-drop components like search widgets that have pre-built integrations to the search APIs.  This is value addition beyond just simple API integration.  Now we are talking about UI components that will let you build the customer user experience in front of your eyes using in-built WYSIWYG screens.  This is powerful, since you are not focussing on technology anymore, but business imperatives.

7) Low code platforms doesn't stop there.  It will not just let you build your app easily, but also test them take them to delivery fast.  It covers the entire app delivery life cycle.  Check out the 1-click testing and deploy features highlighted in the below figure.

If you noticed in the above article, it was the low code platform which is the unsung hero solving the bigger problem of API RoI.  Low code platforms in one swoop through its easy drag and drop based visual coding and app template based approach put a clean facade over technical complexities associated with APIs and coding and app.  Low code platforms lets you make an app from an idea in a matter of days instead of weeks, months and in some cases more than a year to create an app.

Benefits of the new API consumption model

The below picture captures all the benefits of the new model succinctly.

Conclusion
In the modern digital world, it's imperative for organizations to move up in the digital value chain.  Investing in a low code platform is one good way to do that.  What we discussed today is one such value proposition for companies with existing investment in API infrastructure.  But low code platform based solution can be successfully  applied for various other scenarios like faster response to the needs of the customer, enabling 3rd party digital channel stakeholders, and even empowering employees within a company.

More Stories By Karthick Viswanathan

Karthick heads the Products, Marketing and Evangelism efforts for WaveMaker. As one of the original product managers at WaveMaker, he led the technology and design for WaveMakerOnline, WaveMaker's PaaS offering. He also established the Customer Success practice for WaveMakerOnline. Prior to WaveMaker, Karthick occupied various roles in engineering and product management at PegaSystems, IBM and Oracle. He can discuss in-depth, code-level details and just as easily shift focus to business and go-to-market strategies. He was one of the seeders for the product management teams for PegaSystems in India and also a key technology contributor behind Oracle Warehouse Builder features. He writes and blogs about modern app development methodologies, including Rapid Application Development, digital transformation, and the API economy.

@CloudExpo Stories
"Storpool does only block-level storage so we do one thing extremely well. The growth in data is what drives the move to software-defined technologies in general and software-defined storage," explained Boyan Ivanov, CEO and co-founder at StorPool, in this SYS-CON.tv interview at 16th Cloud Expo, held June 9-11, 2015, at the Javits Center in New York City.
Sometimes I write a blog just to formulate and organize a point of view, and I think it’s time that I pull together the bounty of excellent information about Machine Learning. This is a topic with which business leaders must become comfortable, especially tomorrow’s business leaders (tip for my next semester University of San Francisco business students!). Machine learning is a key capability that will help organizations drive optimization and monetization opportunities, and there have been some...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
The question before companies today is not whether to become intelligent, it’s a question of how and how fast. The key is to adopt and deploy an intelligent application strategy while simultaneously preparing to scale that intelligence. In her session at 21st Cloud Expo, Sangeeta Chakraborty, Chief Customer Officer at Ayasdi, provided a tactical framework to become a truly intelligent enterprise, including how to identify the right applications for AI, how to build a Center of Excellence to oper...
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, discussed how data centers of the future will be managed, how the p...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory? In her Day 2 Keynote at @DevOpsSummit at 21st Cloud Expo, Aruna Ravichandran, VP, DevOps Solutions Marketing, CA Technologies, was jo...
As Marc Andreessen says software is eating the world. Everything is rapidly moving toward being software-defined – from our phones and cars through our washing machines to the datacenter. However, there are larger challenges when implementing software defined on a larger scale - when building software defined infrastructure. In his session at 16th Cloud Expo, Boyan Ivanov, CEO of StorPool, provided some practical insights on what, how and why when implementing "software-defined" in the datacent...
Blockchain. A day doesn’t seem to go by without seeing articles and discussions about the technology. According to PwC executive Seamus Cushley, approximately $1.4B has been invested in blockchain just last year. In Gartner’s recent hype cycle for emerging technologies, blockchain is approaching the peak. It is considered by Gartner as one of the ‘Key platform-enabling technologies to track.’ While there is a lot of ‘hype vs reality’ discussions going on, there is no arguing that blockchain is b...
Blockchain is a shared, secure record of exchange that establishes trust, accountability and transparency across business networks. Supported by the Linux Foundation's open source, open-standards based Hyperledger Project, Blockchain has the potential to improve regulatory compliance, reduce cost as well as advance trade. Are you curious about how Blockchain is built for business? In her session at 21st Cloud Expo, René Bostic, Technical VP of the IBM Cloud Unit in North America, discussed the b...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
Is advanced scheduling in Kubernetes achievable?Yes, however, how do you properly accommodate every real-life scenario that a Kubernetes user might encounter? How do you leverage advanced scheduling techniques to shape and describe each scenario in easy-to-use rules and configurations? In his session at @DevOpsSummit at 21st Cloud Expo, Oleg Chunikhin, CTO at Kublr, answered these questions and demonstrated techniques for implementing advanced scheduling. For example, using spot instances and co...
The use of containers by developers -- and now increasingly IT operators -- has grown from infatuation to deep and abiding love. But as with any long-term affair, the honeymoon soon leads to needing to live well together ... and maybe even getting some relationship help along the way. And so it goes with container orchestration and automation solutions, which are rapidly emerging as the means to maintain the bliss between rapid container adoption and broad container use among multiple cloud host...
The cloud era has reached the stage where it is no longer a question of whether a company should migrate, but when. Enterprises have embraced the outsourcing of where their various applications are stored and who manages them, saving significant investment along the way. Plus, the cloud has become a defining competitive edge. Companies that fail to successfully adapt risk failure. The media, of course, continues to extol the virtues of the cloud, including how easy it is to get there. Migrating...
Imagine if you will, a retail floor so densely packed with sensors that they can pick up the movements of insects scurrying across a store aisle. Or a component of a piece of factory equipment so well-instrumented that its digital twin provides resolution down to the micrometer.
The need for greater agility and scalability necessitated the digital transformation in the form of following equation: monolithic to microservices to serverless architecture (FaaS). To keep up with the cut-throat competition, the organisations need to update their technology stack to make software development their differentiating factor. Thus microservices architecture emerged as a potential method to provide development teams with greater flexibility and other advantages, such as the abili...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settle...
Product connectivity goes hand and hand these days with increased use of personal data. New IoT devices are becoming more personalized than ever before. In his session at 22nd Cloud Expo | DXWorld Expo, Nicolas Fierro, CEO of MIMIR Blockchain Solutions, will discuss how in order to protect your data and privacy, IoT applications need to embrace Blockchain technology for a new level of product security never before seen - or needed.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...