Welcome!

SDN Journal Authors: Elizabeth White, Pat Romanski, TJ Randall, Yeshim Deniz, Liz McMillan

Related Topics: SDN Journal, Containers Expo Blog, @CloudExpo

SDN Journal: Blog Post

Scaling with Distributed Pollers By @MJannery | @CloudExpo [#SDN #Cloud]

Not all network management solutions are alike, even though they may sound that way sometimes

Enterprise in Disguise - Scaling with Distributed Pollers

Not all network management solutions are alike, even though they may sound that way sometimes. A sure sign of a network management tool trying to pass itself off as an enterprise solution is when it implements distributed polling as a way to scale.

These systems scale server capacity by adding distributed pollers, each sharing a portion of the overall CPU load. But any network monitoring architect can tell you that the bottleneck in infrastructure management is I/O to the database. Having multiple pollers simultaneously send data back to a single data store does not solve the issue but can exacerbate it.

This is why network management systems that claim to scale using distributed polling engines can only achieve small increases for each engine—typically only 7,000 to 10,000 additional objects each versus up to 70,000 of an intelligently architected enterprise-capable system. Metaphorically speaking, distributed pollers do allow a network management application to pour more water in the top of the funnel, but the neck of the funnel is the problem.

Other risks include:

  • Single point of failure—If the central database fails, the ability of polling servers to collect data will be impacted.
  • WAN link failure—A failure of a WAN link between remote pollers and the central data store will cause loss of data.
  • Expensive WAN links—If data is sent to the central server over expensive and/or low capacity WAN links then pricy upgrades to these links may be needed.
  • Lack of real-time data—If the remote pollers simply gather data and forward it without real-time analysis, the benefits of immediate notification of anomalies are lost.

A true enterprise class solution distributes not only the polling but also the data storage. These multi-server solutions allow each server the visibility to the data stores of the other servers and therefore can scale infinitely. This is an architecture designed from its inception for enterprise computing.

More Stories By Michael Jannery

Michael Jannery is CEO of Entuity. He is responsible for setting the overall corporate strategy, vision, and direction for the company. He brings more than 30 years of experience to Entuity with 25 years in executive management.

Prior to Entuity, he was Vice President of Marketing for Proficiency, where he established the company as the thought, technology, and market leader in a new product lifecycle management (PLM) sub-market. Earlier, Michael held VP of Marketing positions at Gradient Technologies, where he established them as a market leader in the Internet security sector, and Cayenne Software, a leader in the software and database modeling market. He began his career in engineering.

CloudEXPO Stories
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected path for IoT innovators to scale globally, and the smartest path to cross-device synergy in an instrumented, connected world.
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
ScaleMP is presenting at CloudEXPO 2019, held June 24-26 in Santa Clara, and we’d love to see you there. At the conference, we’ll demonstrate how ScaleMP is solving one of the most vexing challenges for cloud — memory cost and limit of scale — and how our innovative vSMP MemoryONE solution provides affordable larger server memory for the private and public cloud. Please visit us at Booth No. 519 to connect with our experts and learn more about vSMP MemoryONE and how it is already serving some of the world’s largest data centers. Click here to schedule a meeting with our experts and executives.
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understanding as the environment changes.
Codete accelerates their clients growth through technological expertise and experience. Codite team works with organizations to meet the challenges that digitalization presents. Their clients include digital start-ups as well as established enterprises in the IT industry. To stay competitive in a highly innovative IT industry, strong R&D departments and bold spin-off initiatives is a must. Codete Data Science and Software Architects teams help corporate clients to stay up to date with the modern business digitalization solutions. Achieve up to 50% early-stage technological process development cost cutdown with science and R&D-driven investment strategy with Codete's support.