View Monitoring Dashboards
- Capella AI Services
- concept
Couchbase Capella provides metrics for Workflows and the Model Service for you to discover and trend model performance, identify performance issues, and more.
You can use the metrics from the Monitoring dashboards for troubleshooting your AI Services. Use the dashboards to investigate intermittent issues with multi-metric views and adjustable timeframes.
Capella AI Services has the following real-time monitoring dashboards for:
These monitoring dashboards show metric charts with the following elements:
| Element | Description |
|---|---|
Metrics |
Each monitoring dashboard has metric charts for every available metric. |
Time Range |
The timeframe filters allow you to switch between preselected timeframes moving backward from the current time or a custom timeframe. |
Metric tile |
The Monitoring dashboards show each metric as a tile. A tile includes a title, a graph with labeled X and Y axis, and data lines. |
View Workflow Metrics
The workflow dashboards include metrics for Unstructured Data Workflows and Structured Data Workflows.
View Unstructured Data Metrics
The Unstructured Data dashboard presents a general summary of the metrics, health status, and active alerts for your Unstructured Data Workflows. It presents metrics such as:
-
KV operations, to identify patterns in data retrieval.
-
Pages processed, to identify workload size and processing throughput.
-
Documents processed, to identify ingestion volume.
To see your Unstructured Data workflow’s status and metrics:
-
Go to .
-
Select Unstructured Data.
-
In the workflow list, select the Workflow you want to view metrics for.
You can adjust the metric charts by timeframe. For more information, see Adjust Metrics.
For more information about Workflows, see Process Your Data For Capella AI Services.
View Structured Data Metrics
The Structured Data dashboard presents a general summary of the metrics, health status, and active alerts for your Structured Data Workflows. It presents metrics such as:
-
Number of tokens processed, to identify processing volume.
-
Number of requests, to identify workload.
-
Average embedding response latency, to identify model performance and responsiveness.
To see your Structured Data Workflow’s status and metrics:
-
Go to .
-
Click Structured Data.
-
In the workflow list, select the Workflow you want to view metrics for.
You can adjust the metric charts by timeframe. For more information, see Adjust Metrics.
For more information about Workflows, see Process Your Data For Capella AI Services.
View Model Metrics
The Model dashboard presents a general summary of your model’s metrics, health status, and active alerts. It presents metrics such as:
-
CPU usage, to identify how much processing power the model is consuming.
-
Guardrail violations, to identify when the model generates unsafe or undesired outputs.
-
Cache completion tokens, to identify how often the model returns results from cache instead of generating new ones.
To see your model’s status and metrics:
-
Go to .
-
Click Model.
-
In the Model list, select the model you want to view metrics for.
You can adjust the metric charts by timeframe. For more information, see Adjust Metrics.
For more information about models on Capella AI Services, see Deploy Models with the Capella Model Service.
Adjust Metrics
Each metric tile in any of the Monitoring dashboards shows you a chart representing data from the chosen timeframe.
Choose Time Range
By default, the Monitoring dashboards display metrics from the past hour. Using the time range buttons, you can choose from the following preselected time ranges:
-
30 minutes
-
1 hour
-
2 hour
-
1 day
-
2 days
-
7 days
-
30 days
You can also choose to show data from a timeframe you specify. Specifying a timeframe is most helpful when examining metrics over an event.
To specify a timeframe:
-
Click the clock icon ().
-
Select the From date and time picker and choose a date and time from when you want to start showing activity.
The dashboard automatically refreshes in the background for the new date.
-
Use the To date and time picker to update the end date and time.
By default, the To date is the current date and time.
-
With a timeframe chosen, select a blank area of the Monitoring dashboard to close the open date and time picker.
For Monitoring dashboards, you can return to the default timeframe by selecting the 1hr option.
Chart Resolution
Capella draws metrics charts down to 60-second (1-minute) resolution. This resolution is available for graphs using the 30m, 1h, and 2h timeframes.
When you select a longer timeframe, Capella automatically adjusts the chart data resolution. These chart data resolutions are:
-
1d - 360 seconds (6 minutes)
-
2d - 720 seconds (12 minutes)
-
7d - 2520 seconds (42 minutes)
-
30d - 10800 seconds (3 hours)