Bugsnag Announces First App Stability Index Report, Reveals Mobile & Web Apps Not Achieving “Five Nines” Stability

Results illustrate the need for superior application stability for improved customer experience and retention

SAN FRANCISCO – Bugsnag Inc., a pioneer in application stability management, today announced the results of its Application Stability Index: Are Your Applications Healthy? The report analyzed the performance of approximately 2,500 top mobile and web applications (by session volume) within its customer base. The report found that the median stability of mobile applications is 99.63%, while the median stability of web applications is 99.39%. These results indicate that nearly four in 1,000 customers might have a completely disrupted experience with a mobile app. Similar to the “five nines” (99.999%) that infrastructure and operations teams use to measure uptime and availability, this benchmark will help development teams decide when to build features rather than fix bugs in the process. depending on the current stability of the application.

“With more and more consumers using online applications, providing an error-free experience is of the utmost importance in boosting consumer engagement and retention,” said James Smith, CEO of Bugsnag. “To help engineering teams understand the stability and reliability of their applications, we have compiled session-based stability data from leading mobile and web applications across all market segments to set a benchmark. health of applications. Engineering teams are always striving to innovate, and we are committed to helping them achieve excellence in application stability to deliver a better customer experience, drive loyalty and grow the business.

Measure and improve application stability for mobile engineering organizations

Compared to the industry target of 99.999% for most IT infrastructure groups, also known as ‘five nines’, a median stability of 99.63% presents a significant opportunity for engineering organizations. invest in measuring and improving the stability of applications and the customer experience.

STABILITY SCORE BY TYPE OF MOBILE DEVELOPMENT PLATFORM
Platform Android ios React
Native
Unity
75th percentile 99.97% 99.94% 99.88% 100%
Median 99.69% 99.72% 99.40% 99.96%
25th percentile 98.87% 98.94% 97.83% 99.43%

The report includes app data from multiple mobile development platforms including Android, iOS, React Native, and Unity, as well as multiple front-end development platforms including Angular, Backbone, Ember, React, and Vue. The main findings include:

  • Android and iOS Native apps tend to have a higher median stability, because specialist developers working on those apps have the expertise to effectively understand and resolve stability issues.
  • Android applications tend to have a slightly lower median stability than ios applications. As Android presents a much less constrained development environment due to the increasing fragmentation of devices compared to iOS, it is inherently more difficult for Android development teams to test their apps.
  • React native has a slightly lower median stability than other mobile development platforms. While this allows engineering teams to develop together for iOS and Android, expertise on these platforms is needed to effectively investigate and fix bugs in native layers of code.
  • Unity applications have the highest median stability score. The isolated test environment for Unity applications makes it less likely that a bug will crash the entire application.
  • web applications have a lower median stability than mobile apps, indicating that modern web development frameworks can provide more resources to handle errors.
  • There is a correlation between engineering team size and median stability scores. the The smaller the engineering team, the lower the median stability. This is true in teams of up to 50 engineers, because achieving product-to-market fit is more important than application stability. However, large teams of over 100 engineers working on more mature applications face challenges like legacy code, worsening technical debt, and complex team structure that lead to lower scores. stability.

“While stability is typically a KPI held by engineering organizations, it has a significant impact on the overall performance and growth of the company,” Smith said. “Engineering organizations can no longer separate business metrics from the stability of their applications – they need to standardize error monitoring and stability solutions across the stack and across teams. “

Bugsnag addresses this challenge head-on and enables teams to measure and improve application stability, so organizations can increase their competitive advantage and drive business growth.

About the Bugsnag Stability Index Report:

The Bugsnag Stability Index report is based on actual customer sessions and 30-day stability assessment models that were analyzed and rated by the application stability management platform Bugsnag in 2020. For more information, please visit: www.bugsnag.com/research/2020- Application Stability Index Report

About Bugsnag

Bugsnag is a pioneer in application stability management. We make error monitoring actionable and help businesses and small businesses stabilize, prioritize, and fix bugs. As a complete solution, we are known for our best support for mobile applications. Bugsnag enables software development, customer observability, and release management teams to make data-driven decisions about when to build features rather than fixing bugs.

Organizations benefit from a significant return on investment due to faster innovation through developer efficiency and improved customer experience. We handle over a billion error reports from apps worldwide every day, and over 5,000 industry-leading brands, including Airbnb, Slack, Pinterest, Lyft, Yelp, and Pandora, use Bugsnag as their dashboard. daily edge. Based in San Francisco, Bugsnag is backed by GV (Google Ventures), Benchmark Capital and Matrix Partners. For more information, visit www.bugsnag.com.

Comments are closed.