Welcome!

SDN Journal Authors: Pat Romanski, Elizabeth White, Liz McMillan, Greg Schulz, Jerome McFarland

Related Topics: Containers Expo Blog, Java IoT, Linux Containers, @CloudExpo, Cloud Security, SDN Journal

Containers Expo Blog: Blog Post

Network Autonomy – Feedback Defined Networking

Once a network has a sense of its expected state, anything that alters that state can be reacted to

About 8 years ago at my previous employer we started a project related to Autonomic Networking. Autonomic Networking is modeled after Autonomic Computing, an IBM initiative from the early 2000s, targeted at creating self managing computing elements. The network version intends to create a framework by which network elements become largely self managed. It does so by defining discovery, awareness and analytics that build some sense of state. Once a network has a sense of its expected state, anything that alters that state can be reacted to following a set of defined or even learned rules.

Autonomic Networking can be as simple as reacting to threshold alarms. In many of our network switches today, there are basic reactions to error conditions. Loop detection mechanisms shut off ports when a loop is detected. Specific error conditions may lead to pre-emptive switchover to alternate links or paths. Many of the protocols we use that govern connectivity and patching have autonomic capabilities, they react to error conditions and link failures and attempt to keep the disruption to the network to an absolute minimum.

True Autonomic Networking takes this many levels further, it tries to define the network as inputs, outputs and expected behaviors, almost something you would want to describe using process algebra (which was my favorite Computer Science class way back). But it’s the moment you actually start to automatically modify the state of the network based on a derived model of “normal” that people start to freak. It’s human nature to not like to relinquish control. And that is extremely visible in networking. Even the most simple threshold alarm based actions are met with a reaction from customers that sounds like “I only want you to tell me what has happened and what I should do about it, but I do not want you to automatically do it”.

Get Over It
And it is that attitude that we need to collectively get over. Large portions of the systems we use each and every day are more autonomic than the network we cuddle and cherish. When you land in SFO, the monorail has no driver but no one hesitates getting in to pick up their rental car. Technology advanced as we believe we are, that simple monorail has more autonomy than most networks today.

The good news is that we are slowly started to get used to more autonomy for our network. The folks at network heresy.com a while ago wrote about automatic ways to detect elephant flows and adjusting the network behavior as a result. Purist may say they only changed the priority of these packets, but in the end, the entire network system behaved different before and after. Without operator intervention.

Whether you like the actual methodology or not, the lossless capabilities added to ethernet create a sense of autonomy. Switches monitor a state of “normal” by looking at queue utilization, and react autonomously when needed by telling neighbors to stop sending traffic, and telling high volume users to slow down.

Most vendors have tools that monitor VMWare’s vCenter, looking for moving VMs and ensure that network and policy configuration specific to that VM is applied to the switch and port this VM happens to be moving to.

The larger web companies, the ones with their own networking stuff, have embraced some of this methodology for a while now. It is pretty common knowledge that Google uses analytics and utilization feedback to adjust its use of wide area network capacity by moving traffic around.

Feedback Defined Networking
If nothing else, SDN in whatever definition you like, is giving us the concept of a programmable network. And what use is programming a network if all you use it for is to automate basic configuration information? A huge portion of the value of SDN is the ability to create autonomy for the network. We can now actually take feedback from the network and use it to change its behavior. Or change the behavior of those that use the network. Having a programmable interface to the network allows us to get beyond manual interventions.

I call it Feedback Defined Networking. I know that term will stick for about an hour at best, but that’s ok. The point is that we have only scratched the surface of what we can do with the network, its users and the surrounding systems once we collectively get over our desire to manually control the network.

[Today's fun fact: The average American will eat 35,000 cookies in his/her lifetime. Can someone please adjust my quota?]

The post Network Autonomy – Feedback Defined Networking appeared first on Plexxi.

Read the original blog entry...

More Stories By Marten Terpstra

Marten Terpstra is a Product Management Director at Plexxi Inc. Marten has extensive knowledge of the architecture, design, deployment and management of enterprise and carrier networks.

@CloudExpo Stories
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
SYS-CON Events announced today TMCnet has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Technology Marketing Corporation (TMC) is the world's leading business-to-business and integrated marketing media company, servicing niche markets within the com...
Between the mockups and specs produced by analysts, and resulting applications built by developers, there exists a gulf where projects fail, costs spiral, and applications disappoint. Methodologies like Agile attempt to address this with intensified communication, with partial success but many limitations. In his session at 18th Cloud Expo, Charles Kendrick, CTO & Chief Architect at Isomorphic Software, will present a revolutionary model enabled by new technologies. Learn how business and devel...
If there is anything we have learned by now, is that every business paves their own unique path for releasing software- every pipeline, implementation and practices are a bit different, and DevOps comes in all shapes and sizes. Software delivery practices are often comprised of set of several complementing (or even competing) methodologies – such as leveraging Agile, DevOps and even a mix of ITIL, to create the combination that’s most suitable for your organization and that maximize your busines...
Struggling to keep up with increasing application demand? Learn how Platform as a Service (PaaS) can streamline application development processes and make resource management easy.
New Relic, Inc. has announced a set of new features across the New Relic Software Analytics Cloud that offer IT operations teams increased visibility, and the ability to diagnose and resolve performance problems quickly. The new features further IT operations teams’ ability to leverage data and analytics, as well as drive collaboration and a common, shared understanding between teams. Software teams are under pressure to resolve performance issues quickly and improve availability, as the comple...
The IoT has the potential to create a renaissance of manufacturing in the US and elsewhere. In his session at 18th Cloud Expo, Florent Solt, CTO and chief architect of Netvibes, will discuss how the expected exponential increase in the amount of data that will be processed, transported, stored, and accessed means there will be a huge demand for smart technologies to deliver it. Florent Solt is the CTO and chief architect of Netvibes. Prior to joining Netvibes in 2007, he co-founded Rift Technol...
SYS-CON Events announced today that Enzu, a leading provider of cloud hosting solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to foc...
Many private cloud projects were built to deliver self-service access to development and test resources. While those clouds delivered faster access to resources, they lacked visibility, control and security needed for production deployments. In their session at 18th Cloud Expo, Steve Anderson, Product Manager at BMC Software, and Rick Lefort, Principal Technical Marketing Consultant at BMC Software, will discuss how a cloud designed for production operations not only helps accelerate developer...
Join IBM June 8 at 18th Cloud Expo at the Javits Center in New York City, NY, and learn how to innovate like a startup and scale for the enterprise. You need to deliver quality applications faster and cheaper, attract and retain customers with an engaging experience across devices, and seamlessly integrate your enterprise systems. And you can't take 12 months to do it.
This is not a small hotel event. It is also not a big vendor party where politicians and entertainers are more important than real content. This is Cloud Expo, the world's longest-running conference and exhibition focused on Cloud Computing and all that it entails. If you want serious presentations and valuable insight about Cloud Computing for three straight days, then register now for Cloud Expo.
Based on the open source Cloud Foundry technology, IBM Bluemix is an open-standard, cloud-based platform for building, managing, and running applications of all types such as web, mobile, Big Data, and new smart devices. Bluemix abstracts and hides most of the complexities that are associated with hosting and managing cloud-based applications. As an application developer, you can focus on developing your application without having to manage the infrastructure that is required to host it. For mob...
The proper isolation of resources is essential for multi-tenant environments. The traditional approach to isolate resources is, however, rather heavyweight. In his session at 18th Cloud Expo, Igor Drobiazko, co-founder of elastic.io, will draw upon their own experience with operating a Docker container-based infrastructure on a large scale and present a lightweight solution for resource isolation using microservices. He will also discuss the implementation of microservices in data and applicat...
As you respond to increasing requests for new analytics, you need fast and flexible technology in your arsenal so that you can deploy the right workload to the right platform for the need at hand. Do you need self-service and fast time to value? Do you have data and application control and privacy needs, along with strict SLAs to meet? IBM dashDB™ is data warehouse technology powered by in-memory computing and in-database analytics that are designed for fast results, scalability and more.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, will discuss how research has demonstrated the value of Machine Learning in delivering next generation analytics to im...
Peak 10, Inc., has announced the implementation of IT service management, a business process alignment initiative based on the widely adopted Information Technology Infrastructure Library (ITIL) framework. The implementation of IT service management enhances Peak 10’s current service-minded approach to IT delivery by propelling the company to deliver higher levels of personalized and prompt service. The majority of Peak 10’s operations employees have been trained and certified in the ITIL frame...
The paradigm has shifted. A Gartner survey shows that 43% of organizations are using or plan to implement the Internet of Things in 2016. However, not just a handful of companies are still using the old-style ad-hoc trial-and-error ways, unaware of the critical barriers, paint points, traps, and hidden roadblocks. How can you become a winner? In his session at @ThingsExpo, Tony Shan will present a methodical approach to guide the holistic adoption and enablement of IoT implementations. This ov...
SYS-CON Events announced today that Stratoscale, the software company developing the next generation data center operating system, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Stratoscale is revolutionizing the data center with a zero-to-cloud-in-minutes solution. With Stratoscale’s hardware-agnostic, Software Defined Data Center (SDDC) solution to store everything, run anything and scale everywhere...
Angular 2 is a complete re-write of the popular framework AngularJS. Programming in Angular 2 is greatly simplified – now it's a component-based well-performing framework. This immersive one-day workshop at 18th Cloud Expo, led by Yakov Fain, a Java Champion and a co-founder of the IT consultancy Farata Systems and the product company SuranceBay, will provide you with everything you wanted to know about Angular 2.
Redis is not only the fastest database, but it has become the most popular among the new wave of applications running in containers. Redis speeds up just about every data interaction between your users or operational systems. In his session at 18th Cloud Expo, Dave Nielsen, Developer Relations at Redis Labs, will shares the functions and data structures used to solve everyday use cases that are driving Redis' popularity.