As companies adopt API‑first design practices to build modern applications, measuring the operational performance and value of those APIs becomes a top priority. Establishing a framework that clearly defines and connects API metrics with key performance indicators (KPIs) is one of the most important steps to ensure a successful API strategy.
Typically, KPIs are tied to specific goals. They have a defined time frame and are aligned to the outcomes that your API strategy needs to deliver. API metrics, in contrast, are significant data points. Not every metric is a KPI, but every KPI begins as a metric.
So, how do you start? First, you need to be clear – at the outset – about the goal of your API strategy and then choose the metrics that align with that goal. Remember that each team needs to measure and track different metrics depending on what is important to it and what is essential for the business.
Broadly, there are three overarching types of API metrics that companies can track, and each type answers a different question:
Imagine these overarching metrics as a pyramid. At the bottom, operational metrics measure the tactical performance of individual APIs and the infrastructure supporting them. At the top, product metrics measure the business value created by your APIs. The two are connected by adoption metrics, which track the growth of the API program with end users (developers). Generally, product metrics and adoption metrics align to the business outcomes you need to measure, while operational metrics align with the technical standards you need to maintain.
In this post we break down 12 specific metrics that are critical to measure, discuss how they enable infrastructure and application teams, and explain the ways the metrics relate to KPIs.
When you are just getting started, operational metrics are usually the first thing to measure. They are tactical and provide insights into how APIs are functioning. Operational metrics are not usually KPIs themselves. Instead, they help you measure the quality and performance of the software your teams are building. They can provide early indicators of emerging problems, or help you drill down and discover issues that might be impacting your critical KPIs.
The operational metrics you track will vary by team and responsibility.
Platform Ops is the team responsible for maintaining, connecting, and securing the collection of infrastructure and technologies used by different teams to deliver applications. For API programs, this often includes API gateways and API developer portals.
Key metrics for infrastructure teams like Platform Ops include:
200
) status codes helps you understand how error‑prone your APIs may be. This aggregate measure provides information to help judge the overall quality of the APIs your teams are putting into production.Application teams, made up of API developers and service owners, are responsible for building and operating individual services or applications. These could be used as part of a larger product, to integrate with a partner, or when delivering APIs as a service to developers.
The following metrics are important for application teams to measure:
Dig into API operations and learn which KPIs and metrics are critical from a business perspective in chapters 3–5 of the eBook Mastering API Architecture from O’Reilly, compliments of NGINX.
For an API‑first business, it’s essential to look beyond engineering metrics and understand how developers are interacting with your APIs. You also need to measure and monitor the API developer experience to ensure developers are adopting and getting value from your APIs.
A few examples of adoption metrics include:
Note: We recommend that at least one of your KPIs seeks to measure API adoption. This helps calculate the overall growth of your API program. For example, you might set a KPI to increase the number of developers who have created an ongoing integration or app using your API.
API product metrics play a major role in understanding the value of an API. Although only a small subset of APIs may directly contribute to revenue, every API needs to provide value to the business.
Key product metrics to measure include:
Note: These product metrics align closely with business impact, and you might choose to turn some into KPIs depending on your business goals. For example, if the business goal of your API strategy is to reach more customers through third‑party providers, you want to track both the number of partners using your APIs and the indirect revenue generated through those integrations.
Explore the API product lifecycle – including business and operational KPIs – in more depth in chapters 3–5 of Mastering API Architecture.
Aligning API metrics and business KPIs is one of the principal ways to make data‑driven decisions and ensure your API strategy delivers the value your organization requires. And not only that – gaining visibility into your APIs can also empower infrastructure and application teams to measure the operational metrics that matter most to them.
At NGINX, we provide visibility into dozens of important API metrics. You can view real‑time and historical metrics, and easily export them to your preferred application performance monitoring (APM) or data analytics solution.
Get started today with a 30‑day free trial of NGINX Management Suite, which includes access to API Connectivity Manager, NGINX Plus as an API gateway, and NGINX App Protect to secure your APIs.
"This blog post may reference products that are no longer available and/or no longer supported. For the most current information about available F5 NGINX products and solutions, explore our NGINX product family. NGINX is now part of F5. All previous NGINX.com links will redirect to similar NGINX content on F5.com."