Welcome!

SDN Journal Authors: Pat Romanski, Patrick Hubbard, Elizabeth White, Sven Olav Lund, Liz McMillan

Related Topics: Microservices Expo, Java IoT, Containers Expo Blog, Machine Learning , @CloudExpo, SDN Journal

Microservices Expo: Article

Welcome to the Show of Content Delivery Networks

Act 1 – The What and Why

"Step right in. You will witness a show of magic and wonders, passion and trust, speed and misunderstandings." a (slightly altered) catch phrase that keeps popping in my head when talking to companies in regards to managing Content Delivery Networks (CDN). Apart from the misconception that a CDN will solve all performance problems one of the great unknowns seems to be how to actually monitor CDNs the right way. And as we all know: you can't manage what you don't understand! So in three "Acts" I will walk you through the main purpose of CDNs, how such systems have to be monitored and what dirty unknowns the right strategy can bring to the surface.

Years ago I was a member in an Off-Theatre group in Berlin. Why that would have any relevance to the CDN topic, you may ask. Part of our maturity journey resembles what almost all companies go through when they end up paying for a CDN service. We were a passionate group, lots of talent (of course), lots of energy and had a dedicated fan group. However we had the same challenge as all off-theatre groups have: no budget, hence no real publicity from a marketing perspective. We started printing flyers and postcards to promote the show. First small numbers and then more and more putting them in pubs, restaurants, book shops, etc. While happy with the result the whole thing stole a lot of our time. So we began to delegate: friends and fans would distribute and in return get free tickets. After a while we realized that we needed to get into better locations like Hotel lobbies and other flyer stands, which however were controlled by marketing agencies.

So we decided to look for one which would help us out and a whole cascade of questions had to be answered:

  • Which one has the best offer?
  • Where and how should they distribute our content?
  • Can they help us with the decision and if so do/can we trust their judgment?
  • How soon do we need to make our decision and how quickly can they react to our needs?
  • How can we be sure they deliver what they promised?
  • Will the money we spent be worth it?

And these are questions which certainly should look familiar if you've ever had to deal with a CDN.

What is a CDN?
In a nutshell CDNs are helping IT teams either by taking on a large bulk of the traffic or by decreasing the latency. They typically have a large network server or points-of-presences (PoPs) spread across the globe. Historically these PoPs were basically used as caching tiers which are much closer to the end user then the origin servers of your own data center. Today of course the CDNs have become much more advanced handling complex route optimization, content compressions, etc., but for the purpose of explaining the right monitoring strategy the simplified explanation of a widely distributed network of servers instead of just 1 centralized data center is enough - also it's the core aspect everyone thinks of when they hear CDN. The most important thing though is that they should speed up things for the end user with less investment then trying to do it in house.

Why use a CDN?
15 years after my theater adventures, I now realize that the services the marketing agencies offer, are exactly the same in the "real world" as the CDNs offer in our digital world today. They help getting the content closer to the customer, making it very convenient to access it. Used the right way they can have a very positive business impact - even when the initial investment seems to burn a big hole in the IT budget. And their service can grow with your business starting locally to simply ensure the scalability of your venture all the way to reaching far away locations across the globe.

Reducing Latency
Looking at a typical, internationally operating B2B manufacturing company or an international financial institution the main CDN benefit is getting the content much closer to the users spread across the globe and thus minimizing the latency and increasing the performance. Factors like decreased DNS, connection and first byte times are their main motivators.

Externalizing Load Balancing
Another scenario of a heavy traffic site like the popular German magazine Spiegel.de where most of the traffic is coming from within Germany on the other hand would benefit by outsourcing the handling of the load and thus minimizing the number of requests hitting their own infrastructure. So the hit/miss ratio is an important factor judging the efficiency of the CDN. Hit in this case meaning the content was served straight from a CDN PoP and miss meaning the content had to be fetched by the CDN from the origin before it could serve it to the end user thus still creating an impact in the data center. Such a traffic reduction on the origin can of course also be used cleverly to minimize the impact of denial of service attacks.

Primary CDN use cases: load balancing and latency reduction

And of course mixes of these 2 main benefits like high traffic sites with international reach or outsourcing relatively few but large file downloads are relevant as well.

So the two main things to look for when it comes to CDN investments are:

Does the CDN help to achieve the overall goal of performance improvement for the end user by:

  • Decreasing latency (dns resolution, connection speed, 1st byte time)
  • Decreasing load on own infrastructure (hit/miss ratio)

and by how much?

Scarily enough over the years I have realized that many companies in the end base their decision on which CDN to choose on gut feeling and guesswork. Many do run an evaluation project, however in most cases the methodology of these projects is questionable.

What to look at when choosing a CDN?
While many aspects like pricing or relationship and trust are of course important in choosing the right vendor I want to focus on the main purpose of the CDN - fast delivery to the end user.

And to be able to make informed decisions and not just guessing about the current situation you need to be confident in answering the following questions. Click here to learn what questions you need to be asking - and what answers you need to be looking for regarding a CDN.

The old way of monitoring doesn't work and not having control over the situation can be disastrous!

More Stories By Kristian Skoeld

Kristian Skoeld is a Performance Analyst at Compuware APM Center of Excellence. He coaches and supports teams across Europe as a Performance Analyst and Product Specialist in Web Performance Management. He is an expert in optimizing IT processes, develop web strategies and putting them into action, and a subject matter expert on Web Performance and Web Monitoring within the Compuware APM business unit.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today that Daiya Industry will exhibit at the Japanese Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ruby Development Inc. builds new services in short period of time and provides a continuous support of those services based on Ruby on Rails. For more information, please visit https://github.com/RubyDevInc.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busine...
As businesses evolve, they need technology that is simple to help them succeed today and flexible enough to help them build for tomorrow. Chrome is fit for the workplace of the future — providing a secure, consistent user experience across a range of devices that can be used anywhere. In her session at 21st Cloud Expo, Vidya Nagarajan, a Senior Product Manager at Google, will take a look at various options as to how ChromeOS can be leveraged to interact with people on the devices, and formats th...
First generation hyperconverged solutions have taken the data center by storm, rapidly proliferating in pockets everywhere to provide further consolidation of floor space and workloads. These first generation solutions are not without challenges, however. In his session at 21st Cloud Expo, Wes Talbert, a Principal Architect and results-driven enterprise sales leader at NetApp, will discuss how the HCI solution of tomorrow will integrate with the public cloud to deliver a quality hybrid cloud e...
Is advanced scheduling in Kubernetes achievable? Yes, however, how do you properly accommodate every real-life scenario that a Kubernetes user might encounter? How do you leverage advanced scheduling techniques to shape and describe each scenario in easy-to-use rules and configurations? In his session at @DevOpsSummit at 21st Cloud Expo, Oleg Chunikhin, CTO at Kublr, will answer these questions and demonstrate techniques for implementing advanced scheduling. For example, using spot instances ...
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous ar...
SYS-CON Events announced today that Yuasa System will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Yuasa System is introducing a multi-purpose endurance testing system for flexible displays, OLED devices, flexible substrates, flat cables, and films in smartphones, wearables, automobiles, and healthcare.
Companies are harnessing data in ways we once associated with science fiction. Analysts have access to a plethora of visualization and reporting tools, but considering the vast amount of data businesses collect and limitations of CPUs, end users are forced to design their structures and systems with limitations. Until now. As the cloud toolkit to analyze data has evolved, GPUs have stepped in to massively parallel SQL, visualization and machine learning.
The session is centered around the tracing of systems on cloud using technologies like ebpf. The goal is to talk about what this technology is all about and what purpose it serves. In his session at 21st Cloud Expo, Shashank Jain, Development Architect at SAP, will touch upon concepts of observability in the cloud and also some of the challenges we have. Generally most cloud-based monitoring tools capture details at a very granular level. To troubleshoot problems this might not be good enough.
Organizations do not need a Big Data strategy; they need a business strategy that incorporates Big Data. Most organizations lack a road map for using Big Data to optimize key business processes, deliver a differentiated customer experience, or uncover new business opportunities. They do not understand what’s possible with respect to integrating Big Data into the business model.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busine...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities – ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups. As a result, many firms employ new business models that place enormous impor...
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Taica manufacturers Alpha-GEL brand silicone components and materials, which maintain outstanding performance over a wide temperature range -40C to +200C. For more information, visit http://www.taica.co.jp/english/.
SYS-CON Events announced today that Dasher Technologies will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Dasher Technologies, Inc. ® is a premier IT solution provider that delivers expert technical resources along with trusted account executives to architect and deliver complete IT solutions and services to help our clients execute their goals, plans and objectives. Since 1999, we'v...
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, will discuss how they b...
We all know that end users experience the Internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices – not doing so will be a path to eventual b...
SYS-CON Events announced today that TidalScale, a leading provider of systems and services, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale has been involved in shaping the computing landscape. They've designed, developed and deployed some of the most important and successful systems and services in the history of the computing industry - internet, Ethernet, operating s...
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant tha...