故障报告
1. 问题(故障)描述
[LV0] LOAD THD[1] send to kafka, topic[17410.dbo.rrt_sale_record_pt.r.etl_ticket_w2.16640], tag[0-17410], length[395358]…
[LV2] Message delivered (395358 bytes, partition 0)
[LV0] LOAD THD[1] process etl rule[543] ok —-> INSERT[320] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[545]…
[LV0] LOAD THD[1] process etl rule[545] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[547]…
[LV0] LOAD THD[1] process etl rule[547] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[549]…
[LV0] LOAD THD[1] process etl rule[549] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[551]…
[LV0] LOAD THD[1] process etl rule[551] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[553]…
[LV0] LOAD THD[1] process etl rule[553] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[555]…
[LV0] LOAD THD[1] process etl rule[555] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[557]…
[LV0] LOAD THD[1] process etl rule[557] ok —-> INSERT[0] UPDATE[0] DELETE[0] DDL[0]
[LV0] LOAD THD[1] process etl rule[559]…
[LV0] LOAD THD[1] send to kafka, topic[17410.dbo.rrt_sale_record_pt.r.etl_ticket_qx.16640], tag[0-17410], length[204091]…
* rdkafka_topic.c:96:rd_kafka_topic_destroy_app: assert: rkt->rkt_app_refcnt > 0 *
2. 问题(故障)原因
etl加工策略过多,造成topic切换超过32个,释放不及时造成core
3. 解决
升级版本到
Linux interface 3.10.0-1160.6.1.el7.x86_64 #1 SMP Tue Nov 17 13:59:11 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
zcbus_service: Release 7.6-12 64 bit (QA) - Production on 2022-03-05 22:46:29
版本即可
注:TOPIC切换最多支持256个,统计这边,单表的etl规则,最多统计64个