|By Joel York||
|April 23, 2014 09:00 AM EDT||
Over the past few years, the SaaS community has gained a solid understanding of SaaS financial metrics, as well as many of the operational principles required to achieve them. However, there has always been an obvious gap between what happens on the top line and what happens on the ground. It’s one thing to claim that a 50% reduction in churn will result in a 2X increase in recurring revenue, but it’s quite another thing to make it happen. Achieving that 50% reduction in churn is usually a tedious and unreliable process of trial and error. This is about to change. As the SaaS industry matures, we are witnessing the evolution of SaaS metrics beyond simple, historical financial measures toward sophisticated operational measures in the form of new SaaS customer success metrics and predictive analytics.
We are witnessing the evolution of SaaS metrics beyond simple, historical financial measures
toward sophisticated SaaS customer success metrics and predictive analytics.
This is the second post in a series inspired by my ongoing collaboration with Bluenose Analytics that explores the new Metrics-driven SaaS Business and its foundation of emerging best practices in customer success metrics. [Attention SaaS CFO's and VP's of Customer Success! Please see the exclusive invitation at the end of this post if you like this series and would like to explore more in person.] The first post discussed the unique qualities of SaaS that enable the Metrics-driven SaaS business to apply a more analytic approach to management than traditional licensed software. This second post drills down on the promise of customer success metrics to bring greater rigor to the processes of churn reduction, upselling and customer success management for increased recurring revenue and decreased recurring costs of service.
An Ocean of Customer Success Data
The promise of customer success metrics is immense. Unfortunately, so is the challenge of developing them. From the initial capture of a prospect’s email address to the final cancellation of a churning customer account, the Metrics-driven SaaS Business collects and analyzes customer data. At the very beginning of a SaaS customer’s lifetime, a cookie is dropped and the usage clock starts ticking as web visits turn into trial accounts. That initial email is complemented with profile information captured on sign-up forms and augmented by third-party databases. Sales and marketing kick in and engagement activities are recorded in CRMs and marketing automation systems. Finally, a purchase is made and the ecommerce engine captures the transaction and forwards it to the financial systems for future billing. Then, the real action starts. Customers log in to the product again and again. Every important click is recorded and every customer success activity is logged.
The SaaS customer success metrics challenge is a big data problem,
requiring powerful data collection engines and sophisticated statistical models.
Collecting the data, unfortunately, is not even half of the battle. The Metrics-driven SaaS Business must make good use of it, turning data into information and information into action. Compared to the SaaS metrics challenge of previous years where all we had to do was master a relatively short list of SaaS financial metrics, the SaaS customer success metrics challenge is truly daunting–a bona fide big data problem. There is just no way to make sense of these volumes of data without powerful data collection engines and sophisticated descriptive and predictive statistical models. Simply defining the relevant customer success metrics is a difficult problem onto itself. But for the very first time, we have the law of large numbers tilting in our favor and the benefit it offers for reducing churn and accelerating customer acquisition far outweigh the costs.
Driving SaaS Customer Success with Metrics
The SaaS profit equation from the previous post and repeated below shows the five key financial levers of SaaS businesses, the two volume drivers: current customers and new customers, and the three units of value: recurring revenue per customer, recurring service cost per customer, and acquisition cost per customer.
SaaS profit =
current customers x ( avg recurring revenue – avg recurring cost )
– new customers x avg acquisition cost
[ Note: For the accountants in the audience,
this should look a lot like activity-based costing. Because it is. ]
As SaaS executives, our financial goals are very simple: make business decisions that push these financial levers in the right directions to increase revenue and reduce costs. The challenge of maximizing SaaS profit is easily divided between the ‘current customer’ half of the calculation and the ‘new customer, half. SaaS business organizations and operating plans are often similarly divided into servicing current customers and acquiring new customers.
This second post in The Metrics-driven SaaS Business series focuses on the ‘current customers’ half. The next post in the series will focus on the ‘new customer’ half. As mentioned earlier though, pushing these financial levers is much easier said than done. Planning to increase revenue by increasing current customers with a 30% reduction in churn is easy. Reducing churn by 30% is hard. The following sections take a look at the first three financial levers: current customers (churn), average cost of service (customer success efficiency) and average recurring revenue per customer (upsells) and the principal role of SaaS customer success metrics in creating and executing operating plans that actually push them.
Leveraging Root Cause Analysis to Reduce SaaS Churn
By far the lowest hanging fruit of SaaS customer success metrics is their use in SaaS churn reduction. For a SaaS business of any reasonable size, churn uniformly represents the largest financial drain on SaaS growth and profit. Its simple math, ‘current customers’ is almost always the largest number in our SaaS profit equation above. SaaS churn is also a great place to start our exploration of SaaS customer success metrics, because at its heart, SaaS churn is a statistical concept, so modeling it operationally is fundamentally a statistical problem.
[Note: If you tweeted the quote above, CONGRATULATIONS!
Welcome to the club of true SaaS metrics geeks! ]
SaaS churn represents the probability that a customer will cancel in a given period. That probability is determined by a number of factors: the value the customer sees in your SaaS product, the customer’s reliance on your SaaS product, the potential value of competitor offerings, and the internal priorities and politics within the customer’s organization. The Metrics-driven SaaS Business gathers and analyzes information on all of these predictors. Customer profiles in CRMs and accounting systems combined with direct product usage data go a very long way in describing the first two, whereas the less visible ones can be tackled through customer success surveys and expert ratings by executives, sales reps, support reps, and customer success reps.
With an ocean of customer success data and the law of large numbers on our side,
we can apply well known statistical methods to identify the root causes of churn
Once we have collected the relevant information, we can apply well known statistical methods to identify the root causes of churn. There are a number of descriptive statistical methods that apply from simple cross tabulation of churn cohorts to more advanced methods like logistic regression and survival analysis. Statistics aside, we expect to find insights, such as customers in healthcare are more likely to churn than customers in financial services. If a customer has not logged in in the last 30 days, it is at severe risk of churn. Customers that use our reporting module frequently are our best advocates, and so forth. With the right data and the right analytics, root causes of churn can consistently be identified and addressed, a significant improvement over simply reducing churn from 15% to 10% in our financial forecast without having a clue as to how it will be achieved.
Predictive Analytics with SaaS Customer Success Metrics
Once we have a better understanding of why past customers churn, we can create models that predict the risk that a specific current customer will churn in the future. With sound predictions, the customer success organization can take action to prevent SaaS churn before it happens. At their heart, most of these statistical methods are simply scoring systems that estimate the probability of a given event, in the case of churn it is the probability that a customer will cancel. The predictors in our models and the models themselves can therefore be used to create key performance indicators (KPIs) for customer success that are tracked on a regular basis for each and every customer. For example, we may find that customers that stop using our product for a two week period are at a higher risk of churn, and that the risk increases the longer they do not use the system. This metric and the regression that produced it can both be used to create KPIs.
SaaS Customer Success Metrics and Product Use
Customer success metrics based on product usage data is the secret sauce within the Metrics-driven SaaS Business. In a sense, churn is simply the opposite of use. The more a customer uses your SaaS product, the less likely the customer is to churn. Not only does use indicate how much the customer values your product, prolonged use correlates strongly with switching costs. Customer success metrics that track inadequate use are key indicators of churn, while those that track deep and frequent use are strong indicators of customer advocacy. One of the smartest applications of customer success metrics based on product use is driving product use itself. By identifying customers that are struggling with your product, you can uncover opportunities to improve the user experience, offer help and education, and of course reduce churn.
Product usage data is the secret sauce within the Metrics-driven SaaS Business.
In a sense, churn is simply the opposite of use.
Improving SaaS Customer Success Efficiency through Metrics
The same KPIs that we use for churn reduction can be applied to improve the efficiency of the customer success organization and thereby lower cost of service. They key is to go beyond simply monitoring and modeling customer success metrics to embedding them in the daily workflow of customer success reps. From the preceding example, if we know that customers that have stop using our product for two weeks are in need of immediate attention, then we can use this information to create dashboards and alerts for customer success reps. The primary goal is to direct the attention of customer success reps to customers where the reps can have the greatest impact on financial results. Conversely, the secondary goal is to not waste time on customer success activities that have no influence on the success of a customer.
The beauty of SaaS customer success metrics over SaaS financial metrics is that they apply at the individual customer level. Moreover, they can be rolled up along any dimension, such as time, customer type, product module, customer success rep, etc. to create a detailed picture of our customer success operation. At the individual account level, they can be used to create a scorecard or health index for every single account to help customer success reps monitor and manage their territories. At the aggregate level, they can be used to design the customer success territories themselves, so that customer success reps are deployed to customer accounts in the right numbers and with the right mix of skills. Customer success managers are usually familiar with a straightforward small, medium and large account approach to territory design, however, it might just be that your large accounts have the least risk of churn and the least potential for upsell! SaaS customer success metrics provide much stronger guidance and many more dimensions from which to choose for territory design.
Driving Upsells with SaaS Customer Success Metrics
SaaS customer Success metrics can also improve upselling to increase average recurring revenue per customer, the next financial lever in our SaaS profit equation. By applying the same types of statistical models we used in churn reduction to analyze past upsell purchases across customer demographics, product usage data, and so forth, we can develop predictive models and scores for upselling. Again, we can embed these models and KPIs into the daily activities of customer success reps or account managers to direct them to the accounts with the greatest upsell potential at any given time. Finally, we can use the predictive models within the product itself to automatically trigger communications with high potential customers and facilitate purchase.
Attention SaaS CFOs and VPs of Customer Success!
I will be speaking at an exclusive CFO only dinner sponsored by Bluenose Analytics this coming Tuesday, April 29 in San Francisco. Please email me directly at joelyork [at] chaotic-flow.com if you are interested in attending. This event is part of a larger, ongoing series designed to create an intimate setting for SaaS industry leaders (10-15 at a time at a nice restaurant) where they can discuss and evolve SaaS business best practices for finance and customer success. There are only a few spots left for next Tuesday, however, if there is sufficient demand, we will likely repeat it. There are also upcoming dinners focused on Customer Success operational best practices for VP’s Customer Success. If you are interested in these, please email me and I will send you the agenda. Bluenose is also considering expanding these dinners to multiple cities, so let me know even if you are not in the Bay Area.
Thanks again for following Chaotic Flow!
PS Dinner is free!
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, ...
Jul. 23, 2016 08:30 AM EDT Reads: 627
It’s 2016: buildings are smart, connected and the IoT is fundamentally altering how control and operating systems work and speak to each other. Platforms across the enterprise are networked via inexpensive sensors to collect massive amounts of data for analytics, information management, and insights that can be used to continuously improve operations. In his session at @ThingsExpo, Brian Chemel, Co-Founder and CTO of Digital Lumens, will explore: The benefits sensor-networked systems bring to ...
Jul. 23, 2016 08:15 AM EDT Reads: 1,421
Much of IT terminology is often misused and misapplied. Modernization and transformation are two such terms. They are often used interchangeably even though they mean different things and have very different connotations. Indeed, it is somewhat safe to assume that in IT any transformative effort is likely to also have a modernizing effect, and thus, we can see these as levels of improvement efforts. However, many businesses are being led to believe if they don’t transform now they risk becoming ...
Jul. 23, 2016 08:00 AM EDT Reads: 1,026
Introducing Enterprise IoT Bootcamp at @ThingsExpo Silicon Valley | #IoT #M2M #API #DigitalTransformation
SYS-CON Events announced today the Enterprise IoT Bootcamp, being held November 1-2, 2016, in conjunction with 19th Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA. Combined with real-world scenarios and use cases, the Enterprise IoT Bootcamp is not just based on presentations but with hands-on demos and detailed walkthroughs. We will introduce you to a variety of real world use cases prototyped using Arduino, Raspberry Pi, BeagleBone, Spark, and Intel Edison. Y...
Jul. 23, 2016 08:00 AM EDT Reads: 1,212
When building large, cloud-based applications that operate at a high scale, it’s important to maintain a high availability and resilience to failures. In order to do that, you must be tolerant of failures, even in light of failures in other areas of your application. “Fly two mistakes high” is an old adage in the radio control airplane hobby. It means, fly high enough so that if you make a mistake, you can continue flying with room to still make mistakes. In his session at 18th Cloud Expo, Lee...
Jul. 23, 2016 08:00 AM EDT Reads: 1,211
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
Jul. 23, 2016 08:00 AM EDT Reads: 1,379
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
Jul. 23, 2016 07:45 AM EDT Reads: 1,038
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
Jul. 23, 2016 07:45 AM EDT Reads: 938
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
Jul. 23, 2016 07:30 AM EDT Reads: 2,006
"There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...
Jul. 23, 2016 07:15 AM EDT Reads: 1,829
"Tintri was started in 2008 with the express purpose of building a storage appliance that is ideal for virtualized environments. We support a lot of different hypervisor platforms from VMware to OpenStack to Hyper-V," explained Dan Florea, Director of Product Management at Tintri, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Jul. 23, 2016 07:15 AM EDT Reads: 1,766
"Avere Systems is a hybrid cloud solution provider. We have customers that want to use cloud storage and we have customers that want to take advantage of cloud compute," explained Rebecca Thompson, VP of Marketing at Avere Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Jul. 23, 2016 07:00 AM EDT Reads: 1,874
SaaS companies can greatly expand revenue potential by pushing beyond their own borders. The challenge is how to do this without degrading service quality. In his session at 18th Cloud Expo, Adam Rogers, Managing Director at Anexia, discussed how IaaS providers with a global presence and both virtual and dedicated infrastructure can help companies expand their service footprint with low “go-to-market” costs.
Jul. 23, 2016 07:00 AM EDT Reads: 2,237
IoT generates lots of temporal data. But how do you unlock its value? You need to discover patterns that are repeatable in vast quantities of data, understand their meaning, and implement scalable monitoring across multiple data streams in order to monetize the discoveries and insights. Motif discovery and deep learning platforms are emerging to visualize sensor data, to search for patterns and to build application that can monitor real time streams efficiently. In his session at @ThingsExpo, ...
Jul. 23, 2016 06:30 AM EDT Reads: 617
Ovum, a leading technology analyst firm, has published an in-depth report, Ovum Decision Matrix: Selecting a DevOps Release Management Solution, 2016–17. The report focuses on the automation aspects of DevOps, Release Management and compares solutions from the leading vendors.
Jul. 23, 2016 06:00 AM EDT Reads: 1,565
"This week we're really focusing on scalability, asset preservation and how do you back up to the cloud and in the cloud with object storage, which is really a new way of attacking dealing with your file, your blocked data, where you put it and how you access it," stated Jeff Greenwald, Senior Director of Market Development at HGST, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Jul. 23, 2016 05:30 AM EDT Reads: 1,331
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busin...
Jul. 23, 2016 05:30 AM EDT Reads: 1,709
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...
Jul. 23, 2016 05:15 AM EDT Reads: 1,162
Continuous testing helps bridge the gap between developing quickly and maintaining high quality products. But to implement continuous testing, CTOs must take a strategic approach to building a testing infrastructure and toolset that empowers their team to move fast. Download our guide to laying the groundwork for a scalable continuous testing strategy.
Jul. 23, 2016 05:00 AM EDT Reads: 1,779
As companies gain momentum, the need to maintain high quality products can outstrip their development team’s bandwidth for QA. Building out a large QA team (whether in-house or outsourced) can slow down development and significantly increases costs. This eBook takes QA profiles from 5 companies who successfully scaled up production without building a large QA team and includes: What to consider when choosing CI/CD tools How culture and communication can make or break implementation
Jul. 23, 2016 05:00 AM EDT Reads: 1,474