XDCR Metrics

      +
      A list of the metrics provided by XDCR.

      The following XDCR metrics can be queried by means of the REST APIs described in Statistics.

      See XDCR Metrics Cross Reference if you are looking for a metric name you know from an alternative supported or legacy tool.

      Tip
      • The x.y.z badge shows the Couchbase Server version the metric was added in.

      • The type / unit badge shows shows the Prometheus type and unit (if present).

      xdcr_atr_txn_docs_filtered_total     7.6.0counter

      Total number of documents filtered and not replicated because the documents were ATR documents

      xdcr_binary_filtered_total     7.6.0counter

      Number of documents filtered that were binary documents

      xdcr_changes_left_total     7.0.0gauge

      Given the vBuckets of this node, the number of sequence numbers that need to be processed (either replicated or handled) before catching up to the high sequence numbers for the vBuckets

      xdcr_client_txn_docs_filtered_total     7.6.0counter

      Total number of documents filtered and not replicated because the documents were transaction client records

      xdcr_clog_crd_docs_written_total     8.0.0counter

      Number of CRDs written to the conflict bucket.

      xdcr_clog_docs_filtered_total     8.0.0counter

      Number of conflict records filtered.

      xdcr_clog_docs_written_total     8.0.0counter

      Total number of conflict docs written. This counter includes all three types of conflict doc - source doc, target doc and CRD for the conflict detected.

      xdcr_clog_eaccesses_total     8.0.0counter

      Number of EACCESS errors encountered while writing the conflict records to the conflict bucket. It is likely that something has gone wrong with the previliges of the user used for conflict writing

      xdcr_clog_fatal_resps_total     8.0.0counter

      Number of fatal errors encountered while writing the conflict records to the conflict bucket. It includes EINVAL and XATTR_EINVAL.

      xdcr_clog_guardrail_hits_total     8.0.0counter

      Number of guardrail hit errors encountered while writing the conflict records to the conflict bucket. It includes resident ratio, data size and disk space guardrail errors.

      xdcr_clog_hibernated_count_total     8.0.0counter

      Number of docs which were identified as conflicts, but could not be logged because the conflict logger was hibernated.

      xdcr_clog_impossible_resps_total     8.0.0counter

      Number of errors which by design should not have been returned, encountered while writing the conflict records to the conflict bucket. It includes EEXISTS, ENOENT and LOCKED errors.

      xdcr_clog_not_my_vbs_total     8.0.0counter

      Number of NOT_MY_VBUCKET errors encountered while writing the conflict records to the conflict bucket. It mostly is an indicator of topology changes.

      xdcr_clog_nw_errors_total     8.0.0counter

      Number of network errors encountered while writing the conflict records to the conflict bucket.

      xdcr_clog_other_errors_total     8.0.0counter

      Number of unidentified errors encountered while writing the conflict records to the conflict bucket. One should turn on debug logging for the replication to catch the unknown response.

      xdcr_clog_pool_get_timedout_total     8.0.0counter

      Number of conflict records for which the conflict logger had trouble getting a connection to the conflict bucket.

      xdcr_clog_queue_full_total     8.0.0counter

      Number of docs which were identified as conflicts, but could not be logged because the logging queue was full.

      xdcr_clog_src_docs_written_total     8.0.0counter

      Number of source conflict docs written to the conflict bucket.

      xdcr_clog_status     8.0.0gauge

      Indicates if the conflict logger of the replication is running or hibernated or if it does not exist.

      xdcr_clog_tgt_docs_written_total     8.0.0counter

      Number of target conflict docs written to the conflict bucket.

      xdcr_clog_throttled_total     8.0.0counter

      Number of conflict records which were throttled due to resource management and hence not written to conflict bucket.

      xdcr_clog_tmpfails_total     8.0.0counter

      Number of TMPFAIL errors encountered while writing the conflict records to the conflict bucket. It indicates that the data service was temporarily busy and could not process the incoming write.

      xdcr_clog_unknown_collections_total     8.0.0counter

      Number of UNKNOWN_COLLECTION errors encountered while writing the conflict records to the conflict bucket. It indicates that where was a change to the collections setup which affected the conflict writes.

      xdcr_clog_unknown_resps_total     8.0.0counter

      Number of unknown responses returned by the source KV while writing the conflict records to the conflict bucket. One should turn on debug logging for the replication to catch the unknown response.

      xdcr_clog_write_timedout_total     8.0.0counter

      Number of conflict records for which the write to conflict bucket was timed out.

      xdcr_data_replicated_bytes     7.0.0counter / bytes

      Amount of data replicated for a Replication

      xdcr_data_replicated_uncompress_bytes     7.0.0counter / bytes

      Theoretical amount of data replicated for a Replication if compression were not used

      xdcr_datapool_failed_gets_total     7.0.0counter

      The total number of failed GET() operation on a reusable datapool within XDCR for the purpose of avoiding garbage generation

      xdcr_dcp_datach_length_total     7.0.0gauge

      The number of items sent by the Data Service waiting for the XDCR Source Nozzle to ingest and process

      xdcr_dcp_dispatch_time_seconds     7.0.0gauge / seconds

      The rolling average amount of time it takes for a document to be received by XDCR from the Data Service, to the time it is queued up in the Target Nozzle ready to be sent

      xdcr_deletion_cloned_total     7.2.1counter

      The number of times a Source Deletion or Expiration is cloned to be written to multiple Target Namespaces

      xdcr_deletion_docs_written_total     7.0.0counter

      Number of Deletions written to Target

      xdcr_deletion_failed_cr_source_total     7.0.0counter

      Number of Deletions that failed Source-side Conflict Resolution

      xdcr_deletion_failed_cr_target_total     7.1.0counter

      Number of Deletions that failed Conflict Resolution at the Target

      xdcr_deletion_filtered_total     7.0.0counter

      Number of Deletions that were filtered Source-side

      xdcr_deletion_received_from_dcp_total     7.0.0counter

      Number of Deletions received from the Data Service

      xdcr_docs_cas_poisoned_total     8.0.0counter

      Total number of documents not replicated because cas is beyond acceptable drift threshold

      xdcr_docs_checked_total     7.0.0gauge

      Across vBuckets for this node, the sum of all sequence numbers that have been considered to be checkpointed

      xdcr_docs_cloned_total     7.0.0counter

      Number of Source Document Mutation cloned to be written to different Target Namespaces

      xdcr_docs_compression_skipped_total     8.0.0counter

      Total number of documents whose compression was skipped before replication, due to a larger snappy-compressed size

      xdcr_docs_failed_cr_source_total     7.0.0counter

      Number of documents (or tombstones) that were not replicated to the Target due to Conflict Resolution evaluated on the Source

      xdcr_docs_failed_cr_target_total     7.1.0counter

      Number of documents failed Conflict Resolution at the Target

      xdcr_docs_filtered_on_txn_xattr_total     7.6.0counter

      Total number of documents filtered and not replicated due to the presence of transaction related xattrs in it

      xdcr_docs_filtered_on_user_defined_filter_total     7.6.0counter

      Total number of documents filtered and not replicated because of user defined filter expressions

      xdcr_docs_filtered_total     7.0.0gauge

      Total number of documents filtered and not replicated due to any type of filtering

      xdcr_docs_opt_repd_total     7.0.0counter

      Number of Documents Optimistically Replicated to the Target Cluster

      xdcr_docs_processed_total     7.0.0gauge

      Number of Documents processed for a Replication

      xdcr_docs_received_from_dcp_total     7.0.0counter

      Number of Document Mutations received from the Data Service

      xdcr_docs_sent_with_poisonedCas_errorMode_total     8.0.0counter

      The total number of documents that failed the set_with_meta operation due to the set CAS exceeding the acceptable threshold on the target data service.

      xdcr_docs_sent_with_poisonedCas_replaceMode_total     8.0.0counter

      The total number of documents replicated to the target, where the target data service regenerated CAS values because the set CAS exceeded the acceptable threshold on the target's data service.

      xdcr_docs_sent_with_subdoc_delete_total     7.6.6counter

      The number of deletes issued using subdoc command instead of delete_with_meta to avoid cas rollback on target

      xdcr_docs_sent_with_subdoc_set_total     7.6.6counter

      The number of sets issued using subdoc command instead of set_with_meta to avoid cas rollback on target

      xdcr_docs_unable_to_filter_total     7.0.0gauge

      Number of Document Mutations that couldn't be filtered due to inability to parse the document through Advanced Filtering engine and were not replicated

      xdcr_docs_written_total     7.0.0counter

      Number of docs Document Mutations written/sent to the Target

      xdcr_expiry_docs_written_total     7.0.0counter

      Number of Expirations written to the Target

      xdcr_expiry_failed_cr_source_total     7.0.0counter

      Number of Expirations that failed Source-side Conflict Resolution

      xdcr_expiry_failed_cr_target_total     7.1.0counter

      Number of Expirations that failed Conflict Resolution at the Target

      xdcr_expiry_filtered_total     7.0.0counter

      Number of Expirations filtered Source-side

      xdcr_expiry_received_from_dcp_total     7.0.0counter

      Number of Expirations or documents with TTL received from the Data Service

      xdcr_expiry_stripped_total     7.0.0counter

      Number of Document Mutations replicated that had the TTL changed to 0 before writing to Target (Source is unmodified)

      xdcr_guardrail_data_size_total     7.6.0counter

      The number of writes that target rejected because each target data node is holding too much data

      xdcr_guardrail_disk_space_total     7.6.0counter

      The number of writes that target rejected because a data node is running out of disk space

      xdcr_guardrail_resident_ratio_total     7.6.0counter

      The number of writes that target rejected due to the target bucket being under the resident ratio threshold

      xdcr_hlv_pruned_at_merge_total     7.6.6counter

      Number of mutations with HLV pruned when it is merged with target document

      xdcr_hlv_pruned_total     7.6.6counter

      Number of mutations with HLV pruned

      xdcr_hlv_updated_total     7.6.6counter

      Number of mutations with HLV updated

      xdcr_import_docs_failed_cr_source_total     7.6.6counter

      Number of mobile import mutations failed Source side Conflict Resolution. This is only counted in LWW buckets when enableCrossClusterVersioning is true

      xdcr_import_docs_written_total     7.6.6counter

      Number of import mutations sent

      xdcr_mobile_docs_filtered_total     7.6.0counter

      Total number of documents filtered and not replicated because the documents were mobile records

      xdcr_num_checkpoints_total     7.0.0counter

      The number of times checkpoint operation has completed successfully since this XDCR process instance is made aware of this replication

      xdcr_num_failedckpts_total     7.0.0counter

      The number of times checkpoint operation has encountered an error since this XDCR process instance is made aware of this replication

      xdcr_number_of_replications_total     8.0.0gauge

      The total number of replications that exists to replicate to a particular target cluster

      xdcr_number_of_source_nodes_total     8.0gauge

      For a given source cluster, the number of data service nodes that it contains

      xdcr_number_of_source_replications_total     8.0gauge

      For a given source cluster, the total number of outbound replications to this cluster

      xdcr_pipeline_errors     7.6.0gauge

      The number of currently present errors for a specific Replication Pipeline

      xdcr_pipeline_status     7.6.0gauge

      The pipeline status for a specific pipeline, where it could be paused, running or, error

      xdcr_resp_wait_time_seconds     7.0.0gauge / seconds

      The rolling average amount of time it takes from when a MemcachedRequest is created to be ready to route to an outnozzle to the time that the response has been heard back from the target node after a successful write

      xdcr_seqno_adv_received_from_dcp_total     7.6.0counter

      The number of seqno advance events received from source data service

      xdcr_set_docs_written_total     7.0.0counter

      Number of Set operations successfully written to the Target

      xdcr_set_failed_cr_target_total     7.1.0counter

      Number of Set operations that failed Conflict Resolution at the Target

      xdcr_set_filtered_total     7.0.0counter

      Number of documents filtered that was of a DCP mutation

      xdcr_set_received_from_dcp_total     7.0.0counter

      Number of Sets received from the Data Service

      xdcr_size_rep_queue_bytes     7.0.0gauge / bytes

      Amount of data being queued to be sent in a Target Nozzle

      xdcr_source_sync_xattr_removed_total     7.6.6counter

      Number of mutations with source mobile extended attributes removed

      xdcr_system_events_received_from_dcp_total     7.6.0counter

      The number of system events received from source data service

      xdcr_target_eaccess_total     7.6.0counter

      The total number of EACCESS errors returned from the target node.

      xdcr_target_sync_xattr_preserved_total     7.6.6counter

      Number of mutations with target mobile extended attributes preserved

      xdcr_target_tmpfail_total     7.6.0counter

      The total number of TMPFAIL errors returned from the target node.

      xdcr_target_unknown_status_total     7.6.0counter

      The total number of writes to target data service that returned with a status code that XDCR cannot comprehend

      xdcr_throttle_latency_seconds     7.0.0gauge / seconds

      The rolling average of the latency time introduced due to bandwith throttler

      xdcr_throughput_throttle_latency_seconds     7.0.0gauge / seconds

      The rolling average of the latency time introduced due to throughput throttler

      xdcr_time_committing_seconds     7.0.0gauge / seconds

      The rolling average amount of time it takes for a checkpoint operation to complete

      xdcr_true_conflicts_detected_total     8.0.0counter

      Number of true conflicts detected when the conflict logging feature is turned on. Logging of all these conflicts to a conflict bucket is best-effort, based on the system's state.

      xdcr_wtavg_docs_latency_seconds     7.0.0gauge / seconds

      The rolling average amount of time it takes for the source cluster to receive the acknowledgement of a SET_WITH_META response after the Memcached request has been composed to be processed by the XDCR Target Nozzle

      xdcr_wtavg_meta_latency_seconds     7.0.0gauge / seconds

      The rolling average amount of time it takes once a getMeta command is composed to be sent to the time the request is handled once the target node has responded