数据传输服务监控指标

最近更新时间:2024-05-16 17:14:01

我的收藏

命名空间

Namespace = QCE/DTS

监控指标

指标英文名
指标中文名
说明
单位
维度
统计规则 [period, statType]
DtsReplicationLag
数据同步延迟时间
数据同步延迟时间
s
replicationjobid
[ 60s, last ] [ 300s, last ]
DtsReplicationLagData
数据同步延迟数据量
数据同步延迟数据量
MBytes
replicationjobid
[ 60s, last ] [ 300s, last ]
MigrateCaptureRps
源实例数据抽取RPS
源实例数据抽取RPS
Count/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migratedumperbps
源实例全量导出BPS
源实例全量导出BPS
MBytes/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migratedumpernetworklag
DTS全量导出时与源实例网络延迟
DTS全量导出时与源实例网络延迟
ms
migratejob_id
[ 60s, last ] [ 300s, last ]
Migratedumperrps
源实例全量导出RPS
源实例全量导出RPS
Count/s
migratejob_id
[ 60s, max ] [ 300s, max ]
MigrateLag
数据迁移延迟时间
数据迁移延迟时间
s
migratejob_id
[ 60s, last ] [ 300s, last ]
MigrateLagData
数据迁移延迟数据量
数据迁移延迟数据量
MBytes
migratejob_id
[ 60s, last ] [ 300s, last ]
Migrateloaderbps
目标实例全量导入BPS
目标实例全量导入BPS
MBytes/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migrateloadernetworklag
DTS全量导入时与目标实例网络延迟
DTS全量导入时与目标实例网络延迟
ms
migratejob_id
[ 60s, last ] [ 300s, last ]
Migrateloaderrps
目标实例全量导入RPS
目标实例全量导入RPS
Count/s
migratejob_id
[ 60s, max ] [ 300s, max ]
MigrateLoadRps
目标数据装载RPS
目标数据装载RPS
Count/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migrateriverbps
源实例增量导出BPS
源实例增量导出BPS
MBytes/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migraterivernetworklag
DTS增量导出时与源实例网络延迟
DTS增量导出时与源实例网络延迟
ms
migratejob_id
[ 60s, last ] [ 300s, last ]
Migrateriverrps
源实例增量导出RPS
源实例增量导出RPS
Count/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migratesinkerbps
目标实例增量导入BPS
目标实例增量导入BPS
MBytes/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migratesinkernetworklag
DTS增量导入时与目标实例网络延迟
DTS增量导入时与目标实例网络延迟
ms
migratejob_id
[ 60s, last ] [ 300s, last ]
Migratesinkerrps
目标实例增量导入RPS
目标实例增量导入RPS
Count/s
migratejob_id
[ 60s, max ] [ 300s, max ]
Migratesinkerrpsusage
目标实例增量导入RPS使用率
RPS 使用率 = 实时RPS/RPS上限 当链路配置为最大规格时,RPS无上限限制,所以 RPS 使用率可能超过100%
%
migratejob_id
[ 60s, last ] [ 300s, max ]
ProducerLag
订阅服务与源库的GTID差距个数
订阅服务当前正在解析的binlog与源库最新产生的binlog之间的gtid差距个数
Count
SubscribeId
[ 60s, last ] [ 300s, last ]
ProducerLsnLag
订阅服务与源库的LSN差距
订阅服务与源库的LSN差距
MBytes
SubscribeId
[ 60s, last ] [ 300s, last ]
ProducerTps
订阅服务每秒解析事务数
订阅服务每秒解析事务数
Count/s
SubscribeId
[ 60s, last ] [ 300s, last ]
ReplicationCaptureRps
源实例数据抽取RPS
源实例数据抽取RPS
Count/s
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationdumperbps
源实例全量导出BPS
源实例全量导出BPS
MBytes/s
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationdumpernetworklag
DTS全量导出时与源实例网络延迟
DTS全量导出时与源实例网络延迟
ms
replicationjobid
[ 60s, last ] [ 300s, last ]
Replicationdumperrps
源实例全量导出RPS
源实例全量导出RPS
Count
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationloaderbps
目标实例全量导入BPS
目标实例全量导入BPS
MBytes/s
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationloadernetworklag
DTS全量导入时与目标实例网络延迟
DTS全量导入时与目标实例网络延迟
ms
replicationjobid
[ 60s, last ] [ 300s, last ]
Replicationloaderrps
目标实例全量导入RPS
目标实例全量导入RPS
Count
replicationjobid
[ 60s, max ] [ 300s, max ]
ReplicationLoadRps
目标数据装载RPS
目标数据装载RPS
Count/s
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationriverbps
源实例增量导出BPS
源实例增量导出BPS
MBytes/s
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationrivernetworklag
DTS增量导出时与源实例网络延迟
DTS增量导出时与源实例网络延迟
ms
replicationjobid
[ 60s, last ] [ 300s, last ]
Replicationriverrps
源实例增量导出RPS
源实例增量导出RPS
Count
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationsinkerbps
目标实例增量导入BPS
目标实例增量导入BPS
MBytes/s
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationsinkernetworklag
DTS增量导入时与目标实例网络延迟
DTS增量导入时与目标实例网络延迟
ms
replicationjobid
[ 60s, last ] [ 300s, last ]
Replicationsinkerrps
目标实例增量导入RPS
目标实例增量导入RPS
Count
replicationjobid
[ 60s, max ] [ 300s, max ]
Replicationsinkerrpsusage
目标实例增量导入RPS使用率
RPS 使用率 = 实时RPS/RPS上限 当链路配置为最大规格时,RPS无上限限制,所以 RPS 使用率可能超过100%
%
replicationjobid
[ 60s, max ] [ 300s, max ]
Subscribeconsumepartitionlatency
订阅消费分区消费延迟时间
订阅消费分区消费延迟时间
s
ConsumerGroup PartitionNo SubscribeId TopicName
[ 60s, last ] [ 300s, max ]
Subscribeconsumepartitionunconsume
订阅消费分区未消费记录数
订阅消费分区未消费记录数
Count
ConsumerGroup PartitionNo SubscribeId TopicName
[ 60s, last ] [ 300s, max ]
Subscriberiverbps
源实例增量导出BPS
源实例增量导出BPS
MBytes/s
SubscribeId
[ 60s, max ] [ 300s, max ]
Subscribesinkerbps
Kafka增量导入BPS
Kafka增量导入BPS
MBytes/s
SubscribeId
[ 60s, max ] [ 300s, max ]

各维度对应参数总览

参数名称
维度名称
维度解释
格式
Instances.N.Dimensions.0.Name
replicationjobid
数据同步实例 ID 的维度名称
输入 String 类型维度名称:replicationjobid
Instances.N.Dimensions.0.Value
replicationjobid
数据同步实例 ID
输入数据同步实例 ID,为 DescribeSyncJobs 接口中返回值的 JobId 字段
Instances.N.Dimensions.0.Name
migratejob_id
迁移任务 ID 的维度名称
输入 String 类型维度名称:migratejob_id
Instances.N.Dimensions.0.Value
migratejob_id
迁移任务 ID
输入数据同步实例 ID,为 DescribeMigrationJobs 接口中返回值的 JobId 字段
Instances.N.Dimensions.0.Name
Subscribeid
订阅实例 ID 的维度名称
输入 String 类型维度名称:Subscribeid
Instances.N.Dimensions.0.Value
Subscribeid
订阅实例 ID
输入数据同步实例 ID,为 DescribeSubscribes 接口中返回值的 SubscribeId 字段
Instances.N.Dimensions.0.Name
ConsumerGroup
订阅任务 Kafka 消费组维度
String 类型维度名称:ConsumerGroup
Instances.N.Dimensions.0.Value
ConsumerGroup
订阅任务 Kafka 消费组
具体消费组名称:如 consumer-grp-subs-xxx
Instances.N.Dimensions.0.Name
PartitionNo
订阅任务 Kafka 分区维度
String 类型维度名称:PartitionNo
Instances.N.Dimensions.0.Value
PartitionNo
订阅任务 Kafka 分区号
具体单个分区编码:如 1
Instances.N.Dimensions.0.Name
TopicName
订阅任务 Kafka Topic 维度
String 类型维度名称:TopicName
Instances.N.Dimensions.0.Value
TopicName
订阅任务 Kafka Topic
具体的 Topic 名称:如 topic-subs-f8z0bviylm-xxx

入参说明

查询数据同步监控数据,入参取值如下: &Namespace=QCE/DTS &Instances.N.Dimensions.0.Name=replicationjobid &Instances.N.Dimensions.0.Value=数据同步实例 ID
查询数据订阅监控数据,入参取值如下: &Namespace=QCE/DTS &Instances.N.Dimensions.0.Name=Subscribeid &Instances.N.Dimensions.0.Value=订阅实例 ID
查询数据迁移监控数据,入参取值如下: &Namespace=QCE/DTS &Instances.N.Dimensions.0.Name=migratejob_id &Instances.N.Dimensions.0.Value=迁移任务 ID