Welcome!

SDN Journal Authors: Nicole Bryan, Liz McMillan, Elizabeth White, Pat Romanski, Greg Schulz

Related Topics: @BigDataExpo, Java IoT, Containers Expo Blog, @CloudExpo, SDN Journal

@BigDataExpo: Article

What Will It Really Take to Provide an Agile Big Data Infrastructure?

Meet CodeFutures Corporation at Cloud Expo

"An agile approach to data is really a requirement of just about any application, but even more so with Big Data," stated Cory Isaacson, CEO/CTO of CodeFutures Corporation, in this exclusive Q&A with @ThingsExpo conference chair Roger Strukhoff. "What the enterprise needs is a data platform that can adapt to changing requirements in a flexible and rapid manner. This has not been the case with existing databases."

Cloud Computing Journal: With the MapDB announcement, it sounds like to some degree you're bringing the Java Programming Language into the 21st century modern enterprise. To what degree do you agree with that statement?

Cory Isaacson: This is a very good assessment, while Java has always been a capable language there have been many barriers when it comes to delivering full-featured database technology. For example, APIs like JDBC have worked for many years, but fast performance, convenience and tight integration in Java applications with the database were not there. With MapDB Java developers now have the convenience and agility of the native Java Collections API, with the power of a very fast database engine.

Cloud Computing Journal: You emphasize a lightweight, agile approach. To what degree is this simply a requirement of Big Data applications and to what degree do you think agility is required in general for the modern enterprise? Does the real-time (or almost real-time) nature of a lot of Big Data also drive a need for agility?

Isaacson: An agile approach to data is really a requirement of just about any application, but even more so with Big Data. What the enterprise needs is a data platform that can adapt to changing requirements in a flexible and rapid manner. This has not been the case with existing databases. For example, the NoSQL engines move toward this direction, but with a Big Data store it is really tough to gain agility.

Added to this need are the burgeoning real-time data requirements. With a real-time data flow, it is critical to know what is happening now; it is not enough to get results from a typical historical time window (such as days or weeks after something has occurred). The reason an agile approach is so critical is because the results needed from real-time requirements are also likely to change at a rapid pace, more than with traditional enterprise or Big Data applications.

Cloud Computing Journal: What benefits will your customers and your product receive from the open-source approach?

Isaacson: MapDB is freely available under the Apache 2.0 license, this allows customers (or anyone) to use the product as they see fit. Because it is open source also means that we receive major feedback from users, enabling extremely fast support and stability in the product. We often hear in days or hours if there is an issue with a pre-release version, then it can be addressed before it makes its way into a final release. The support of the community is vital.

Cloud Computing Journal: You mention support of databases up to 100GB in size - are there "typical" databases of this size that you encounter? In other words, what sorts of applications and initiatives are driving databases of this size?

Isaacson: We have seen users of MapDB use it for everything from pure in-memory to large disk-based databases. So I would not say there is a "typical" size, but the good news is that a developer can comfortably scale their database as needed, from small to very large without needing to be concerned with the details.

Cloud Computing Journal: What sort of increased interest in Big Data have you seen over the past year or so, and what sort of questions do you anticipate from customers at Cloud Expo?

Isaacson: The interest in Big Data is explosive right now, especially given the new real-time element, and new data generators such as the Internet of Things.

Virtually every customer we are working with has some sort of Big Data initiative or requirement; it is becoming tightly integrated into business strategies and planning. Big Data will be a vital commodity in the economy from here on out and it will affect almost every business from large to small.

The types of questions we anticipate at Cloud Expo are:

  • What will it really take to provide an agile Big Data infrastructure?
  • How can real-time data flows be leveraged for real-time strategic advantage?
  • What capabilities will enable application developers to respond faster to business requirements, without the restrictive nature of current database technologies? In other words, how can we make the job for developers easier, while enabling far more powerful Big Data access?

In addition to all of these questions, we expect to get quite a few regarding our upcoming technology releases - we'll have many things to discuss with technologists and managers while at the event.

More Stories By Elizabeth White

News Desk compiles and publishes breaking news stories, press releases and latest news articles as they happen.

Comments (1)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
What does it look like when you have access to cloud infrastructure and platform under the same roof? Let’s talk about the different layers of Technology as a Service: who cares, what runs where, and how does it all fit together. In his session at 18th Cloud Expo, Phil Jackson, Lead Technology Evangelist at SoftLayer, an IBM company, spoke about the picture being painted by IBM Cloud and how the tools being crafted can help fill the gaps in your IT infrastructure.
SaaS companies can greatly expand revenue potential by pushing beyond their own borders. The challenge is how to do this without degrading service quality. In his session at 18th Cloud Expo, Adam Rogers, Managing Director at Anexia, discussed how IaaS providers with a global presence and both virtual and dedicated infrastructure can help companies expand their service footprint with low “go-to-market” costs.
"delaPlex is a software development company. We do team-based outsourcing development," explained Mark Rivers, COO and Co-founder of delaPlex Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
The U.S. Army Intelligence and Security Command (INSCOM) has awarded BAE Systems a five-year contract worth as much as $75 million to provide enhanced geospatial intelligence technical and analytical support. The award was issued under the INSCOM Global Intelligence indefinite delivery, indefinite quantity contract.
IoT is rapidly changing the way enterprises are using data to improve business decision-making. In order to derive business value, organizations must unlock insights from the data gathered and then act on these. In their session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, and Peter Shashkin, Head of Development Department at EastBanc Technologies, discussed how one organization leveraged IoT, cloud technology and data analysis to improve customer experiences and effi...
The IoT is changing the way enterprises conduct business. In his session at @ThingsExpo, Eric Hoffman, Vice President at EastBanc Technologies, discussed how businesses can gain an edge over competitors by empowering consumers to take control through IoT. He cited examples such as a Washington, D.C.-based sports club that leveraged IoT and the cloud to develop a comprehensive booking system. He also highlighted how IoT can revitalize and restore outdated business models, making them profitable ...
There are several IoTs: the Industrial Internet, Consumer Wearables, Wearables and Healthcare, Supply Chains, and the movement toward Smart Grids, Cities, Regions, and Nations. There are competing communications standards every step of the way, a bewildering array of sensors and devices, and an entire world of competing data analytics platforms. To some this appears to be chaos. In this power panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, Bradley Holt, Developer Advocate a...
Predictive analytics tools monitor, report, and troubleshoot in order to make proactive decisions about the health, performance, and utilization of storage. Most enterprises combine cloud and on-premise storage, resulting in blended environments of physical, virtual, cloud, and other platforms, which justifies more sophisticated storage analytics. In his session at 18th Cloud Expo, Peter McCallum, Vice President of Datacenter Solutions at FalconStor, discussed using predictive analytics to mon...
Dialogic has announced that ZVRS chose Dialogic® PowerMedia™ XMS software media server as part of its latest video relay and translation service offering. ZVRS uses Dialogic’s PowerMedia XMS technology to provide a robust solution that supports a broad range of legacy devices and any-to-any video capabilities with its flagship Z70 videophone. ZVRS selected Dialogic’s solution to facilitate a release of Z70 that met its stringent requirements for legacy device support (H.263 and H.264) with high...
"SpeedyCloud's specialty lies in providing cloud services - we provide IaaS for Internet and enterprises companies," explained Hao Yu, CEO and co-founder of SpeedyCloud, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Your business relies on your applications and your employees to stay in business. Whether you develop apps or manage business critical apps that help fuel your business, what happens when users experience sluggish performance? You and all technical teams across the organization – application, network, operations, among others, as well as, those outside the organization, like ISPs and third-party providers – are called in to solve the problem.
More and more companies are looking to microservices as an architectural pattern for breaking apart applications into more manageable pieces so that agile teams can deliver new features quicker and more effectively. What this pattern has done more than anything to date is spark organizational transformations, setting the foundation for future application development. In practice, however, there are a number of considerations to make that go beyond simply “build, ship, and run,” which changes ho...
"Avere Systems is a hybrid cloud solution provider. We have customers that want to use cloud storage and we have customers that want to take advantage of cloud compute," explained Rebecca Thompson, VP of Marketing at Avere Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, wh...
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
Creating replica copies to tolerate a certain number of failures is easy, but very expensive at cloud-scale. Conventional RAID has lower overhead, but it is limited in the number of failures it can tolerate. And the management is like herding cats (overseeing capacity, rebuilds, migrations, and degraded performance). Download Slide Deck: ▸ Here In his general session at 18th Cloud Expo, Scott Cleland, Senior Director of Product Marketing for the HGST Cloud Infrastructure Business Unit, discusse...
It's easy to assume that your app will run on a fast and reliable network. The reality for your app's users, though, is often a slow, unreliable network with spotty coverage. What happens when the network doesn't work, or when the device is in airplane mode? You get unhappy, frustrated users. An offline-first app is an app that works, without error, when there is no network connection. In his session at 18th Cloud Expo, Bradley Holt, a Developer Advocate with IBM Cloud Data Services, discussed...
Connected devices and the industrial internet are growing exponentially every year with Cisco expecting 50 billion devices to be in operation by 2020. In this period of growth, location-based insights are becoming invaluable to many businesses as they adopt new connected technologies. Knowing when and where these devices connect from is critical for a number of scenarios in supply chain management, disaster management, emergency response, M2M, location marketing and more. In his session at @Th...
The pace of innovation, vendor lock-in, production sustainability, cost-effectiveness, and managing risk… In his session at 18th Cloud Expo, Dan Choquette, Founder of RackN, discussed how CIOs are challenged finding the balance of finding the right tools, technology and operational model that serves the business the best. He also discussed how clouds, open source software and infrastructure solutions have benefits but also drawbacks and how workload and operational portability between vendors ...