SDN Journal Authors: Elizabeth White, Yeshim Deniz, Liz McMillan, Pat Romanski, TJ Randall

Related Topics: @DevOpsSummit, Java IoT, Microservices Expo, Linux Containers, SDN Journal

@DevOpsSummit: Blog Post

Rock Shows and DevOps By @Datical | @DevOpsSummit [#DevOps]

The individual musicians all work in their IDEs, also known as living rooms, perfecting their code

Software Deployments, Rock Shows, and DevOps

I’m going to see my favorite band ever tonight.

In honor of this rare delight, I’ve decided to torture you readers by making an analogy between a rock show and a software release…

Register For DevOps Summit "FREE" (by Friday) ▸ Here

A little bit of background – this band was my first concert.  I was 16, and went to the show with the guys I had just started a garage band with.  I had been a band nerd for a long time by that point, and the list of instruments I could play poorly was as long as my forearm.  In this particular band, I played the part of mediocre drummer.

When I found out I was moving to Austin, The Live Music Capital of the World (“Screw you, Nashville!”), I thought, “Wow!  I should start a band, and this time… instead of being a mediocre drummer, I should work really hard to become a mediocre guitar player and singer!”  With stars in my eyes I made the long drive from Washington to Texas.

Let me tell you, it was all worth it.  There is little in this world that compares to the feeling of performing live in a downtown bar in Austin, where the eyes and ears of all 12 people are fixed in rabid appreciation for your mediocrity…

It all begins with development. The individual musicians all work in their IDEs, also known as “living rooms,” perfecting their code.  Each song is like a feature requirement designed to bring joy to your users.  When you get together to rehearse, often a few times a week, it’s an exercise in build and continuous integration, as you work to make sure each code module passes its integration tests and performs well with other code.  It’s never perfect, and you end up making small tweaks to get things just right – “Hey, you need to wait a half-a-beat before coming in so I can finish this phrase,” or, “No, no, it goes two bars in 6/4 time, then it goes back to 4/4 for the chorus.”

You start with a core setlist – the main trunk – which has performed well with users in the past.  New songs are experimented with in branches.  Those that fit with the band and can be learned by the scheduled maintenance window are merged back into the main branch.  Some don’t make it because they turn out to be too difficult, don’t integrate well, or there’s just not enough time to get them perfected before the release.  These latter branches are saved in the backlog for the next release.

Once you get the release, or setlist, perfected in development, it’s time to move the whole show into the test environment.  This happens 1-2 weeks before the show, and involves packaging the release and moving from the lead guitar player’s garage into a practice studio, a completely different environment.    This is where work begins on perfecting the release – you figure out what configuration the band is going to perform in, program breaks into the setlist, and decide which mediocre jokes you want to tell.  The stress starts to build, knowing that the maintenance window is fast approaching.  Copious amounts of cheap beer are imbibed, immediately making everything sound better.  Confidence picks up – “We can do this!”

Before you know it, the maintenance window hits.  You arrive early to the bar, lug in all your gear, and if you’re lucky, you get to spend a little bit of time making adjustments in the production environment – also known as sound check, before going live.  As in development and test, a lot of tweaks are required to get the mix to sound just right on stage.  Amps, effects pedals, and the PA system all require a lot of knob turning, and at least one guitar string broke during the migration.

This is where DevOps comes in.  For bands who can attract more than 12 listeners, sound engineers, lighting technicians, and roadies are hired to work with the band in development and test.  Collaboration happens to ensure they are prepared to support the live performance.  During the maintenance window, they make sure the environment is set up correctly, checking lighting and the house mix during sound check.  Once the show goes live, they monitor the production environment to make sure performance meets expectations, and that the users are receiving the experience you intended.  This is difficult in large venues, and little tricks are used to make sure all the sound is captured.  Mics are placed just so in front of guitar amps.  Sometimes bands put their drummer in a plastic cage so the drum mics won’t pick up extraneous sound and introduce feedback into the mix.  Personally, I’m against caging your drummer.  It’s my belief that drummers should be allowed to roam free, sleeping on couches wherever they can be found.  But I digress…

Now it’s release time – the maintenance window is upon us.  You throw down 5-6 Jager-bombs to settle your nerves and hope really hard that you don’t need a bathroom break during the show.  You always get started at least 15 minutes late – usually because someone already needs a bathroom break.  Not a good omen…  You walk up on stage, grab your instrument for some last minute tuning, and step up to the mic.

Then all hell breaks loose.

Putting on a rock show is like piloting the Millenium Falcon – it’s simultaneously the fastest ship in the galaxy while being a “piece of junk.”  The stage lights are so hot you start to sweat immediately, hoping those Jager-bombs are escaping through your pores and delaying the impending requirement for that bathroom break.  Things are loud and confusing – you can never factor in the ambient noise from the crowd during sound check.  The monitors aren’t as loud as you needed them to be, and you only hope that you’re singing in a recognizable key.  The sound drowns out your drummer, the heartbeat of the band, and you hope that muscle memory has set in so everyone remembers the proper timing.  You realize while singing a verse that you, in fact, don’t remember any of the words to said verse – you invent some nifty humming on the fly.  The bass player imbibed too much, and is swaying wildly next to you – you pray that your guitar necks don’t “cross streams” and bring the show to a grinding halt.  You’re exhausted after only three songs, knowing there’s at least another hour of performance to go.

It’s intense.  It’s scary.  And it’s a complete rush.

More Stories By Rex Morrow

Rex is the Marketing Director at Datical, a venture-backed software company whose solution, Datical DB, manages and simplifies database schema change management in support of high velocity application releases. Prior to Datical, Rex co-founded Texas Venture Labs, a startup accelerator at the University of Texas, and received his MBA from the McCombs School of Business. Before graduate school, Rex served as a Captain in the U.S. Army, and was awarded two bronze stars during combat deployments in Iraq.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

CloudEXPO Stories
DXWorldEXPO LLC announced today that Nutanix has been named "Platinum Sponsor" of CloudEXPO | DevOpsSUMMIT | DXWorldEXPO New York, which will take place November 12-13, 2018 in New York City. Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that power their business. The Nutanix Enterprise Cloud Platform blends web-scale engineering and consumer-grade design to natively converge server, storage, virtualization and networking into a resilient, software-defined solution with rich machine intelligence.
Lori MacVittie is a subject matter expert on emerging technology responsible for outbound evangelism across F5's entire product suite. MacVittie has extensive development and technical architecture experience in both high-tech and enterprise organizations, in addition to network and systems administration expertise. Prior to joining F5, MacVittie was an award-winning technology editor at Network Computing Magazine where she evaluated and tested application-focused technologies including app security and encryption-related solutions. She holds a B.S. in Information and Computing Science from the University of Wisconsin at Green Bay, and an M.S. in Computer Science from Nova Southeastern University, and is an O'Reilly author.
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed by some of the world's largest financial institutions. The company develops and applies innovative machine-learning technologies to big data to predict financial, economic, and world events. The team is a group of passionate technologists, mathematicians, data scientists and programmers in Silicon Valley with over 100 patents to their names. Big Data Federation was incorporated in 2015 and is ...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like "How is my application doing" but no idea how to get a proper answer.
Having been in the web hosting industry since 2002, dhosting has gained a great deal of experience while working on a wide range of projects. This experience has enabled the company to develop our amazing new product, which they are now excited to present! Among dHosting's greatest achievements, they can include the development of their own hosting panel, the building of their fully redundant server system, and the creation of dhHosting's unique product, Dynamic Edge.