Welcome!

SDN Journal Authors: Pat Romanski, Elizabeth White, Gil Allouche, Lori MacVittie, Dana Gardner

Related Topics: Big Data Journal, Java, SOA & WOA, Virtualization, Cloud Expo, SDN Journal

Big Data Journal: Article

Apigee Mixes Big Data & Broad Data Analytics

It's supposed to leverage Big Data in a new way so a computer can draw sophisticated conclusions from weak unstructured data

Big Data analytics doesn't go far enough according to Anant Jhingran, who was the brains behind IBM's cunningly clever Watson computer as CTO of IBM's lab in Silicon Valley.

"The information an enterprise typically collects - point of sales, procurement, even web site data - is not enough anymore," he says. "In the new world of apps and APIs, the real value of data - the interaction with customers - has moved one or two tiers away from the enterprise and the more you know about the data in your app ecosystem, your ‘broad' data, the better you'll understand your business."

This thinking has been distilled in Apigee Insights, the latest product from the increasingly promising Apigee, where Jhingran is now product chief.

Apigee Insights is supposed to leverage Big Data in a new way so a computer can draw sophisticated conclusions from weak unstructured data and produce business insights beyond what is currently possible.

Apigee, which has already got a signature API platform, thinks Big Data analytics has to focus more on "broad data" defined as all the information that can be culled from noisy APIs, apps, social networks and the mobile ecosystem. It says Insights can do it in context using other data sources.

It basically connects the structured, unstructured and semi-structured dots and forms a readable picture.

Users are supposed to be able to get full visibility into customer, developer and partner behavior by integrating and analyzing all points of customer interaction - from both inside and outside the enterprise.

"In the app economy, where business is often conducted through mobile and social channels, organizations no longer own - much less control - all the data they need to make accurate business decisions," said Apigee CEO Chet Kapoor. "Every enterprise needs to rethink their data platform for this new world. Those that can capture, add context and analyze new broad data sources outside of the enterprise will succeed."

That's what Insights together with Apigee's flagship API platform are supposed to do. It calls APIs "the nervous system of the app economy," "dictating how we get information, shop and communicate with people - and even our cars."

As a for instance, Apigee says that "when a company exposes its services through an open API, important customer interactions can happen in third-party apps across millions of mobile devices. Traditional data solutions are not designed for this dynamic new world, where the data can change continuously in volume, shape and size - creating new requirements for accurate analytics."

Insights is a highly distributed platform that stitches together data from a customer's API programs with data from internal systems and online data sources. It delivers in-depth analysis and performance with a multi-channel data aggregator, distributed processing engine, intelligent data storage, analytic accelerators and expert services. It can deal with the changing number, volume, size and sources of app economy data, and it's supposed to give customers a near real-time feedback loop to test, experiment and rollout changes immediately. Enterprises can gain insights through the entire app value chain or focus specifically on the context of the app user, app developer or information analytics.

The widgetry is supposed to be designed specifically for the big, continuously changing and less structured broad data in the app economy. It can work as both a standalone analytics solution or a complement to existing legacy data warehousing or ETL systems.

There's an e-book explaining Insights and how's it's most operational to people who can mix strong signals from internal data with the weak, ephemeral signals from the contextual data at http://pages.apigee.com/apigee-insights-ebook.html.

It's available for an introductory price of $5,000 a month. It comes with "Analytic Accelerators" that include pre-defined data models and sample user interfaces to help customers quickly gain insights into their developer adoption, customer behavior and data usage.

The company, founded in 2004, used the opportunity created by the Insights launch to do some bragging about how it's been growing at 200% year-over-year and about how 30% of its new customers last year were Fortune 500s or Global 500s including Walgreens, Bechtel and eBay. Shucks, 20% of the Fortune 100 and six of the top 12 US retailers use Apigee.

It's got mobile and supports Software Defined Networking and raised $72 million in venture capital from Focus Ventures, Bay Partners, Norwest Venture Partners, SAP Ventures and Third Point Ventures.

More Stories By Maureen O'Gara

Maureen O'Gara the most read technology reporter for the past 20 years, is the Cloud Computing and Virtualization News Desk editor of SYS-CON Media. She is the publisher of famous "Billygrams" and the editor-in-chief of "Client/Server News" for more than a decade. One of the most respected technology reporters in the business, Maureen can be reached by email at maureen(at)sys-con.com or paperboy(at)g2news.com, and by phone at 516 759-7025. Twitter: @MaureenOGara

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Connected devices and the Internet of Things are getting significant momentum in 2014. In his session at Internet of @ThingsExpo, Jim Hunter, Chief Scientist & Technology Evangelist at Greenwave Systems, examined three key elements that together will drive mass adoption of the IoT before the end of 2015. The first element is the recent advent of robust open source protocols (like AllJoyn and WebRTC) that facilitate M2M communication. The second is broad availability of flexible, cost-effective ...
The Internet of Things will put IT to its ultimate test by creating infinite new opportunities to digitize products and services, generate and analyze new data to improve customer satisfaction, and discover new ways to gain a competitive advantage across nearly every industry. In order to help corporate business units to capitalize on the rapidly evolving IoT opportunities, IT must stand up to a new set of challenges. In his session at @ThingsExpo, Jeff Kaplan, Managing Director of THINKstrateg...
How do APIs and IoT relate? The answer is not as simple as merely adding an API on top of a dumb device, but rather about understanding the architectural patterns for implementing an IoT fabric. There are typically two or three trends: Exposing the device to a management framework Exposing that management framework to a business centric logic Exposing that business layer and data to end users. This last trend is the IoT stack, which involves a new shift in the separation of what stuff happe...
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water,...
"Matrix is an ambitious open standard and implementation that's set up to break down the fragmentation problems that exist in IP messaging and VoIP communication," explained John Woolf, Technical Evangelist at Matrix, in this SYS-CON.tv interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Want to enable self-service provisioning of application environments in minutes that mirror production? Can you automatically provide rich data with code-level detail back to the developers when issues occur in production? In his session at DevOps Summit, David Tesar, Microsoft Technical Evangelist on Microsoft Azure and DevOps, will discuss how to accomplish this and more utilizing technologies such as Microsoft Azure, Visual Studio online, and Application Insights in this demo-heavy session.
When an enterprise builds a hybrid IaaS cloud connecting its data center to one or more public clouds, security is often a major topic along with the other challenges involved. Security is closely intertwined with the networking choices made for the hybrid cloud. Traditional networking approaches for building a hybrid cloud try to kludge together the enterprise infrastructure with the public cloud. Consequently this approach requires risky, deep "surgery" including changes to firewalls, subnets...
DevOps is all about agility. However, you don't want to be on a high-speed bus to nowhere. The right DevOps approach controls velocity with a tight feedback loop that not only consists of operational data but also incorporates business context. With a business context in the decision making, the right business priorities are incorporated, which results in a higher value creation. In his session at DevOps Summit, Todd Rader, Solutions Architect at AppDynamics, discussed key monitoring techniques...
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
One of the biggest challenges when developing connected devices is identifying user value and delivering it through successful user experiences. In his session at Internet of @ThingsExpo, Mike Kuniavsky, Principal Scientist, Innovation Services at PARC, described an IoT-specific approach to user experience design that combines approaches from interaction design, industrial design and service design to create experiences that go beyond simple connected gadgets to create lasting, multi-device exp...
P2P RTC will impact the landscape of communications, shifting from traditional telephony style communications models to OTT (Over-The-Top) cloud assisted & PaaS (Platform as a Service) communication services. The P2P shift will impact many areas of our lives, from mobile communication, human interactive web services, RTC and telephony infrastructure, user federation, security and privacy implications, business costs, and scalability. In his session at @ThingsExpo, Robin Raymond, Chief Architect...
High-performing enterprise Software Quality Assurance (SQA) teams validate systems that are ready for use - getting most actively involved as components integrate and form complete systems. These teams catch and report on defects, making sure the customer gets the best software possible. SQA teams have leveraged automation and virtualization to execute more thorough testing in less time - bringing Dev and Ops together, ensuring production readiness. Does the emergence of DevOps mean the end of E...
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using ...
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series dat...
"Verizon offers public cloud, virtual private cloud as well as private cloud on-premises - many different alternatives. Verizon's deep knowledge in applications and the fact that we are responsible for applications that make call outs to other systems. Those systems and those resources may not be in Verizon Cloud, we understand at the end of the day it's going to be federated," explained Anne Plese, Senior Consultant, Cloud Product Marketing at Verizon Enterprise, in this SYS-CON.tv interview at...
"For the past 4 years we have been working mainly to export. For the last 3 or 4 years the main market was Russia. In the past year we have been working to expand our footprint in Europe and the United States," explained Andris Gailitis, CEO of DEAC, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
The Domain Name Service (DNS) is one of the most important components in networking infrastructure, enabling users and services to access applications by translating URLs (names) into IP addresses (numbers). Because every icon and URL and all embedded content on a website requires a DNS lookup loading complex sites necessitates hundreds of DNS queries. In addition, as more internet-enabled ‘Things' get connected, people will rely on DNS to name and find their fridges, toasters and toilets. Acco...
The term culture has had a polarizing effect among DevOps supporters. Some propose that culture change is critical for success with DevOps, but are remiss to define culture. Some talk about a DevOps culture but then reference activities that could lead to culture change and there are those that talk about culture change as a set of behaviors that need to be adopted by those in IT. There is no question that businesses successful in adopting a DevOps mindset have seen departmental culture change, ...
"Cloud consumption is something we envision at Solgenia. That is trying to let the cloud spread to the user as a consumption, as utility computing. We want to allow the people to just pay for what they use, not a subscription model," explained Ermanno Bonifazi, CEO & Founder of Solgenia, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Enthusiasm for the Internet of Things has reached an all-time high. In 2013 alone, venture capitalists spent more than $1 billion dollars investing in the IoT space. With "smart" appliances and devices, IoT covers wearable smart devices, cloud services to hardware companies. Nest, a Google company, detects temperatures inside homes and automatically adjusts it by tracking its user's habit. These technologies are quickly developing and with it come challenges such as bridging infrastructure gaps,...