Welcome!

SDN Journal Authors: Liz McMillan, Yeshim Deniz, Elizabeth White, Pat Romanski, TJ Randall

Related Topics: SDN Journal, Containers Expo Blog, @CloudExpo

SDN Journal: Blog Post

Scaling with Distributed Pollers By @MJannery | @CloudExpo [#SDN #Cloud]

Not all network management solutions are alike, even though they may sound that way sometimes

Enterprise in Disguise - Scaling with Distributed Pollers

Not all network management solutions are alike, even though they may sound that way sometimes. A sure sign of a network management tool trying to pass itself off as an enterprise solution is when it implements distributed polling as a way to scale.

These systems scale server capacity by adding distributed pollers, each sharing a portion of the overall CPU load. But any network monitoring architect can tell you that the bottleneck in infrastructure management is I/O to the database. Having multiple pollers simultaneously send data back to a single data store does not solve the issue but can exacerbate it.

This is why network management systems that claim to scale using distributed polling engines can only achieve small increases for each engine—typically only 7,000 to 10,000 additional objects each versus up to 70,000 of an intelligently architected enterprise-capable system. Metaphorically speaking, distributed pollers do allow a network management application to pour more water in the top of the funnel, but the neck of the funnel is the problem.

Other risks include:

  • Single point of failure—If the central database fails, the ability of polling servers to collect data will be impacted.
  • WAN link failure—A failure of a WAN link between remote pollers and the central data store will cause loss of data.
  • Expensive WAN links—If data is sent to the central server over expensive and/or low capacity WAN links then pricy upgrades to these links may be needed.
  • Lack of real-time data—If the remote pollers simply gather data and forward it without real-time analysis, the benefits of immediate notification of anomalies are lost.

A true enterprise class solution distributes not only the polling but also the data storage. These multi-server solutions allow each server the visibility to the data stores of the other servers and therefore can scale infinitely. This is an architecture designed from its inception for enterprise computing.

More Stories By Michael Jannery

Michael Jannery is CEO of Entuity. He is responsible for setting the overall corporate strategy, vision, and direction for the company. He brings more than 30 years of experience to Entuity with 25 years in executive management.

Prior to Entuity, he was Vice President of Marketing for Proficiency, where he established the company as the thought, technology, and market leader in a new product lifecycle management (PLM) sub-market. Earlier, Michael held VP of Marketing positions at Gradient Technologies, where he established them as a market leader in the Internet security sector, and Cayenne Software, a leader in the software and database modeling market. He began his career in engineering.

CloudEXPO Stories
Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throughout enterprises of all sizes. We are offering early bird savings on all ticket types where you can save significant amount of money by purchasing your conference tickets today.
Daniel Jones is CTO of EngineerBetter, helping enterprises deliver value faster. Previously he was an IT consultant, indie video games developer, head of web development in the finance sector, and an award-winning martial artist. Continuous Delivery makes it possible to exploit findings of cognitive psychology and neuroscience to increase the productivity and happiness of our teams.
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO Silicon Valley 2019 will cover all of these tools, with the most comprehensive program and with 222 rockstar speakers throughout our industry presenting 22 Keynotes and General Sessions, 250 Breakout Sessions along 10 Tracks, as well as our signature Power Panels. Our Expo Floor will bring together the leading global 200 companies throughout the world of Cloud Computing, DevOps, IoT, Smart Cities, FinTech, Digital Transformation, and all they entail.
Eric Taylor, a former hacker, reveals what he's learned about cybersecurity. Taylor's life as a hacker began when he was just 12 years old and playing video games at home. Russian hackers are notorious for their hacking skills, but one American says he hacked a Russian cyber gang at just 15 years old. The government eventually caught up with Taylor and he pleaded guilty to posting the personal information on the internet, among other charges. Eric Taylor, who went by the nickname Cosmo the God, also posted personal information of celebrities and government officials, including Michelle Obama, former CIA director John Brennan, Kim Kardashian and Tiger Woods. Taylor recently became an advisor to cybersecurity start-up Path which helps companies make sure their websites are properly loading around the globe.
ClaySys Technologies is one of the leading application platform products in the ‘No-code' or ‘Metadata Driven' software business application development space. The company was founded to create a modern technology platform that addressed the core pain points related to the traditional software application development architecture. The founding team of ClaySys Technologies come from a legacy of creating and developing line of business software applications for large enterprise clients around the world.