Welcome!

SDN Journal Authors: Patrick Hubbard, Elizabeth White, Sven Olav Lund, Liz McMillan, Amitabh Sinha

Related Topics: SDN Journal, Java IoT, Linux Containers, Containers Expo Blog, @CloudExpo

SDN Journal: Blog Feed Post

Controller Federations: Cluster by Proximity or Service?

Most people understand that typical large-scale deployments are likely to utilize a multi-controller architecture

As SDN moves closer to large-scale deployments, the issue of controller scaling is becoming a hotter topic. The consensus seems to favor some form of distributed cluster environment, likely in the form of federated clusters. But how should these federations be formed?

The first thing to think about is the blast radius for controllers. Even if a controller could scale to manage every node in the network, it is unlikely that you would want that to be the design. It simply creates too large a maintenance and failure domain. Even with a redundant controller, the issues with expansive failure domains are prohibitively scary.

So most people understand that typical large-scale deployments are likely to utilize a multi-controller architecture. But how do you decide how many controllers you need?

The easiest way to think about the problem is by geography. You can take a number of switches or routers that are in relative close proximity and manage them under a single controller. This is particularly easy to do when the selected geography spans a reasonably manageable size of similar devices. A typical example might be a set of top-of-rack switches all managed under a single controller. To reduce the likelihood of a catastrophic failure, you might double up on the controller and provide multiple management connections back to the network.

But are there other ways to think about controller attachment beyond just proximity?

Imagine a case where you select a controller not because it is a natural upward extension of the physical devices but because it provides useful abstractions derived from the applications or services. Fundamentally, this would suggest a controller choice that is top-down rather than bottom-up.

It could be that a particular controller is especially good at content serving. You want to use this controller because it uses protocols like ALTO and OpenFlow to do intelligent content routing. The point of the controller is to deploy an application, so this controller might not be terribly useful in managing individual device configuration. Additionally, the network over which the content must ultimately flow might consist of a bunch of disparate devices from a handful of vendors.

In this case, the controller is more concerned with the overarching service than with managing the individual devices. The blast radius here changes. If the controller fails, the meaningful way to think about what is impacted is from a service perspective rather than a straight box perspective. It could very well be that the network is still functional for other services, but if this controller goes down, anything related to the content request routing service is impacted.

In this type of environment, there is actually a gap in the service controller; it is incapable of performing all of the management (provisioning, monitoring, and troubleshooting) capabilities that might be required for the specific devices under management. The controller is oriented to perform the specific service exceedingly well, but it lacks the individual configuration hooks to be used as a general provisioning and management device.

This is important. The controller is not necessarily an adequate network management device. It is instead a service controller (or maybe an over-the-top controller). And for architects who want to maintain management control, they might need to augment the service controller with other controllers that provide more specific device support.

In this type of architecture, it is possible to have multiple controllers managing the same set of devices. One controller can provide general support, while others are more service-oriented.

A hybrid architecture like this changes the notion of blast radius for sure. Failures and maintenance events are bounded by the edge of the service. But this also changes the notion of a federated controller cluster. Controller domains need not necessarily be non-overlapping sets of boxes that are separated primarily by their proximity to each other (or the controller).

In part, this is how Plexxi views the controller space. We have been actively working to push our notion of application abstractions into the open source community. If we do that, the question people ask is: will OpenDaylight become the controller of record for Plexxi?

This question is far more subtle than people might imagine. Will we ever use OpenDaylight as the primary controller for Plexxi? Well, first, what does that really mean? Is OpenDaylight ever going to be able to serve as a single point of administration for the entirety of a Plexxi deployment? Probably not. OpenDaylight doesn’t want to be in the business of device management. Trying to keep up with configuration options for all the devices that ODP supports would be nauseatingly difficult.

But does that mean that Plexxi doesn’t expect to use OpenDaylight? We absolutely believe that ODP will be successful. We want people using ODP in heterogeneous environments to be able to interface with ODP as a primary controller. Services provisioned (or actions taken) from ODP ought to extend into the Plexxi devices and yield meaningful results. In this case, Plexxi Control acts as a point of integration, and it creates an instance of a cluster federation. Plexxi Control would be subordinate to ODP in the general case here, allowing users to perform overarching tasks from ODP and manage more specific details of the Plexxi deployment from Plexxi Control.

What we end up with is a hybrid controller environment where customers are potentially using two (or more) controllers to manage the same set of devices. What is the distinction for those controllers? It is likely to be more task or service-oriented rather than proximity – use the right controller for the right job. Is this the future of federated control for SDN? It is certainly one possibility.

To see Plexxi’s integration with OpenDaylight, tune into the March 14 live demonstration on SDNCentral. For full details, check out the event registration page.

[Today’s fun fact: The microwave was invented after a researcher walked by a radar tube and a chocolate bar melted in his pocket. I wonder how spray paint was invented.]

The post Controller federations: Cluster by proximity or service? appeared first on Plexxi.

Read the original blog entry...

More Stories By Michael Bushong

The best marketing efforts leverage deep technology understanding with a highly-approachable means of communicating. Plexxi's Vice President of Marketing Michael Bushong has acquired these skills having spent 12 years at Juniper Networks where he led product management, product strategy and product marketing organizations for Juniper's flagship operating system, Junos. Michael spent the last several years at Juniper leading their SDN efforts across both service provider and enterprise markets. Prior to Juniper, Michael spent time at database supplier Sybase, and ASIC design tool companies Synopsis and Magma Design Automation. Michael's undergraduate work at the University of California Berkeley in advanced fluid mechanics and heat transfer lend new meaning to the marketing phrase "This isn't rocket science."

@CloudExpo Stories
SYS-CON Events announced today that Cedexis will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Cedexis is the leader in data-driven enterprise global traffic management. Whether optimizing traffic through datacenters, clouds, CDNs, or any combination, Cedexis solutions drive quality and cost-effectiveness.
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
SYS-CON Events announced today that Enroute Lab will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enroute Lab is an industrial design, research and development company of unmanned robotic vehicle system. For more information, please visit http://elab.co.jp/.
SYS-CON Events announced today that Suzuki Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Suzuki Inc. is a semiconductor-related business, including sales of consuming parts, parts repair, and maintenance for semiconductor manufacturing machines, etc. It is also a health care business providing experimental research for...
IBM helps FinTechs and financial services companies build and monetize cognitive-enabled financial services apps quickly and at scale. Hosted on IBM Bluemix, IBM’s platform builds in customer insights, regulatory compliance analytics and security to help reduce development time and testing. In his session at 21st Cloud Expo, Lennart Frantzell, a Developer Advocate with IBM, will discuss how these tools simplify the time-consuming tasks of selection, mapping and data integration, allowing devel...
Cloud-based disaster recovery is critical to any production environment and is a high priority for many enterprise organizations today. Nearly 40% of organizations have had to execute their BCDR plan due to a service disruption in the past two years. Zerto on IBM Cloud offer VMware and Microsoft customers simple, automated recovery of on-premise VMware and Microsoft workloads to IBM Cloud data centers.
Why Federal cloud? What is in Federal Clouds and integrations? This session will identify the process and the FedRAMP initiative. But is it sufficient? What is the remedy for keeping abreast of cutting-edge technology? In his session at 21st Cloud Expo, Rasananda Behera will examine the proposed solutions: Private or public or hybrid cloud Responsible governing bodies How can we accomplish?
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
Many companies start their journey to the cloud in the DevOps environment, where software engineers want self-service access to the custom tools and frameworks they need. Machine learning technology can help IT departments keep up with these demands. In his session at 21st Cloud Expo, Ajay Gulati, Co-Founder, CTO and Board Member at ZeroStack, will discuss the use of machine learning for automating provisioning of DevOps resources, taking the burden off IT teams.
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
In his session at @ThingsExpo, Greg Gorman is the Director, IoT Developer Ecosystem, Watson IoT, will provide a short tutorial on Node-RED, a Node.js-based programming tool for wiring together hardware devices, APIs and online services in new and interesting ways. It provides a browser-based editor that makes it easy to wire together flows using a wide range of nodes in the palette that can be deployed to its runtime in a single-click. There is a large library of contributed nodes that help so...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
SYS-CON Events announced today that SIGMA Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. uLaser flow inspection device from the Japanese top share to Global Standard! Then, make the best use of data to flip to next page. For more information, visit http://www.sigma-k.co.jp/en/.
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...
Today traditional IT approaches leverage well-architected compute/networking domains to control what applications can access what data, and how. DevOps includes rapid application development/deployment leveraging concepts like containerization, third-party sourced applications and databases. Such applications need access to production data for its test and iteration cycles. Data Security? That sounds like a roadblock to DevOps vs. protecting the crown jewels to those in IT.
SYS-CON Events announced today that B2Cloud will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. B2Cloud specializes in IoT devices for preventive and predictive maintenance in any kind of equipment retrieving data like Energy consumption, working time, temperature, humidity, pressure, etc.
Automation is enabling enterprises to design, deploy, and manage more complex, hybrid cloud environments. Yet the people who manage these environments must be trained in and understanding these environments better than ever before. A new era of analytics and cognitive computing is adding intelligence, but also more complexity, to these cloud environments. How smart is your cloud? How smart should it be? In this power panel at 20th Cloud Expo, moderated by Conference Chair Roger Strukhoff, paneli...
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp em...
Most of the time there is a lot of work involved to move to the cloud, and most of that isn't really related to AWS or Azure or Google Cloud. Before we talk about public cloud vendors and DevOps tools, there are usually several technical and non-technical challenges that are connected to it and that every company needs to solve to move to the cloud. In his session at 21st Cloud Expo, Stefano Bellasio, CEO and founder of Cloud Academy Inc., will discuss what the tools, disciplines, and cultural...