1.报错信息（Not Supported: Datatype DecimalV3 with precision 65）

[ERR] exec sql: CREATE TABLE IF NOT EXISTS `test`.`wb_psn_work`  (`pk_psn_work` CHAR (20) NOT NULL ,`psn_uid` VARCHAR (256) ,`pk_psn_msg` CHAR (20) ,`busicorp` CHAR (20) ,`busidept` CHAR (20) ,`pk_om_job` CHAR (20) ,`jobname` VARCHAR (200) ,`begindate` CHAR (10) ,`pk_corp` CHAR (20) ,`jobtype` CHAR (20) ,`enddate` CHAR (10) ,`qualiname` CHAR (20) ,`qualilevel` CHAR (20) ,`psn_status` DECIMAL (65,10) ,`psn_type` DECIMAL (65,10) ,`remark` VARCHAR (800) ,`pk_ct` CHAR (20) ,`orgremark` VARCHAR (800) ,`ts` CHAR (19) ,`dr` DECIMAL (65,10) ,`def_str1` VARCHAR (400) ,`def_str2` VARCHAR (400) ,`def_str3` VARCHAR (400) ,`def_str4` VARCHAR (400) ,`def_str5` VARCHAR (400) ,`def_num1` DECIMAL (20,8) ,`def_num2` DECIMAL (20,8) ,`def_num3` DECIMAL (20,8) ,`def_num4` DECIMAL (20,8) ,`def_num5` DECIMAL (20,8) ,`recordnum` DECIMAL (10,0) ,`issceo` CHAR (1) ,`wbbegindate` CHAR (10) ,`wbenddate` CHAR (10) ,`pk_hcmpsn_work` CHAR (20) ,`datasources` VARCHAR (40) ,`global_recordnum` VARCHAR (4) ,`creator` VARCHAR (40) ,`creation_time` CHAR (19) ,`modifier` VARCHAR (40) ,`modify_time` CHAR (19) ,`quit_type` VARCHAR (40) ,`sys_mgr_code` VARCHAR (100) )ENGINE=OLAP UNIQUE KEY(`pk_psn_work`) COMMENT "" DISTRIBUTED BY HASH(`pk_psn_work`) BUCKETS 10 PROPERTIES ( "replication_allocation" = "tag.location.default: 1")

error at file[ddl_process.c] line[175], ZCBUS-20001: mysql_real_query failed: Not Supported: Datatype DecimalV3 with precision 65, which is greater than 38 is disabled by default. set enable_decimal256 = true to enable it.
error at file[msg_load_db.c] line[1690], ZCBUS-20001: mysql_real_query failed: Not Supported: Datatype DecimalV3 with precision 65, which is greater than 38 is disabled by default. set enable_decimal256 = true to enable it.
error at file[msg_load_db.c] line[1828], ZCBUS-20001: mysql_real_query failed: Not Supported: Datatype DecimalV3 with precision 65, which is greater than 38 is disabled by default. set enable_decimal256 = true to enable it.

解决办法

遇建表语句中有 decimal(65,0) 需要在建表之前执行以下命令即可，现升级后台服务即可（zcbus-aarch64-8.1-16-20240608.tar.gz 及以后版本）
set enable_decimal256 = true;
Query OK, 0 rows affected (0.00 sec)

2.报错信息（the length of input string is too long than vec schema）

_delimiter:<zcbus>\n" http://10.141.129.200:8030/api/testdb/bd_psndoc/_stream_load                                                           
{
    "TxnId": 21163,
    "Label": "cae29771-94d5-462d-a506-2bd6eacd2643",
    "Comment": "",
    "TwoPhaseCommit": "false",
    "Status": "Fail",
    "Message": "[DATA_QUALITY_ERROR]too many filtered rows",
    "NumberTotalRows": 1,
    "NumberLoadedRows": 0,
    "NumberFilteredRows": 1,
    "NumberUnselectedRows": 0,
    "LoadBytes": 8290539,
    "LoadTimeMs": 88,
    "BeginTxnTimeMs": 1,
    "StreamLoadPutTimeMs": 5,
    "ReadDataTimeMs": 1,
    "WriteDataTimeMs": 80,
    "CommitAndPublishTimeMs": 0,
    "ErrorURL": "http://10.141.129.200:8040/api/_load_error_log?file=__shard_18/error_log_insert_stmt_51436dbb94ccc41d-62673d8273db90bc_51436dbb94ccc41d_62673d8273db90bc"
}
[root@d5fdca907fd6 log]# curl http://10.141.129.200:8040/api/_load_error_log?file=__shard_18/error_log_insert_stmt_51436dbb94ccc41d-62673d8273db90bc_51436dbb94ccc41d_62673d8273db90bc
Reason: column_name[photo], the length of input string is too long than vec schema. first 32 bytes of input str: [89504e470d0a1a0a0000000d49484452] schema length: 2147483643; limit length: 1048576; actual length: 8247464; . src line [];

解决办法

修改be.conf文件即可
string_type_length_soft_limit_bytes=2147483643
重启be

3.报错信息（mysql_real_query failed: errCode = 2, detailMessage = Unknown column）

[LV0] load affect rows: 113
[STAT] 2024-06-06 17:28:24: LOAD THD[1] load FULL message 13 ok, length[4843442] time[1 s]
     TABLE[testdb.bd_psndoc] INSERT[113] DDL[0]
[STAT] 2024-06-06 17:28:24: LOAD THD[1] loading FULL message 14, table[testdb.bd_psndoc] topic[10002.29.s.3] offset[24 ~ 25] length[5483840]...
[LV0] LOAD THD[1]: multi-insert mode.
[LV0] LOAD THD[1]: 2024-06-06 17:28:24: table[testdb.bd_psndoc] bsd data time[2024-06-05 14:36:44], delay 96700 s.
error at file[mysql/mysql.c] line[294], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = Unknown column '0xaced0005757200025b42acf317f8060854e002000078700053954989504e470d0a1a0a0000000d494844520000064e000008e0080600000076e6d4a7000000017352474200aece1ce90000000467414d410000b18f0bfc61050000ffba49444154785e7cbdd9965dcb75a6974022133dce21299272c996c8126bf825fc00bef55d95a4aa31fc26e7b1fc46e56a249e064022139de7f73711b1410eefc36422f75e7bad8819b3f96713331efd1fffe7fff3f56a5e8ff4ff57578ff3fbd1fcfbebd7af578fbe7cd5ef2ff3c6a3478fae1e3f7eacebbef0de972ffa5bef5ffbfb575f3eebfaaf5fb9c3

解决办法

报错原因是没有正确处理16进制字符， 升级zcbus后台服务（ zcbus-aarch64-8.1-16-20240608.tar.gz 及以后版本）

4.报错信息（testdb.bd_psndoc ADD UNIQUE INDEX i_psndoc_code1）

ALTER TABLE `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ( `code` )  ;;
SKIP_DDL;;
[LV0] 2024-06-07 09:34:02: LOAD THD[1] convert ddl ok, ddl count:1
[LV0] LOAD THD[1]: ddl[1]:
ALTER TABLE `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ( `code` )
[LV0] LOAD THD[1]: exec ddl[1] ALTER TABLE `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ( `code` )  ...
error at file[mysql/mysql.c] line[294], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = Syntax error in line 1:
... `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ...
                             ^
Encountered: UNIQUE
Expected

[ERR] exec sql: ALTER TABLE `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ( `code` )
error at file[ddl_process.c] line[175], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = Syntax error in line 1:
... `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ...


Database changed
mysql> show tables;
+------------------+
| Tables_in_testdb |
+------------------+
| bd_psndoc        |
+------------------+
1 row in set (0.00 sec)

mysql> ALTER TABLE `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ( `code` );
ERROR 1105 (HY000): errCode = 2, detailMessage = Syntax error in line 1:
... `testdb`.`bd_psndoc` ADD UNIQUE INDEX i_psndoc_code1 ...
                             ^
Encountered: UNIQUE
Expected

解决办法

升级DDL包，DORIS 不支持创建唯一索引，过滤掉该创建索引操作即可。

5.报错信息（convert buffer too small）

     TABLE[testdb.bd_psndoc] INSERT[31] DDL[0]
[STAT] 2024-06-07 09:41:06: LOAD THD[1] loading FULL message 1, table[testdb.bd_psndoc] topic[10002.29.s.3] offset[27 ~ 28] length[6361167]...
[LV0] LOAD THD[1]: load mode.
[LV0] LOAD THD[1]: 2024-06-07 09:41:06: table[testdb.bd_psndoc] bsd data time[2024-06-05 14:36:44], delay 155062 s.
error at file[bsdata_format.c] line[425], ZCBUS-120: convert buffer too small
error at file[load_process.c] line[20], ZCBUS-120: convert buffer too small
[INF] LOAD THD[1] error data output to file /usr/local/zcbus/log/dmp20240607/10004_1_1_20240607094106.log, please check!
error at file[load_process.c] line[253], ZCBUS-120: convert buffer too small
error at file[msg_load_db.c] line[1773], ZCBUS-120: convert buffer too small
error at file[msg_load_db.c] line[1827], ZCBUS-120: convert buffer too small
[ERR] LOAD THD[1], ZCBUS-120: convert buffer too small, retry normal mode

解决办法

升级zcbus后台服务（ zcbus-aarch64-8.1-16-20240608.tar.gz 及以后版本）

6.报错信息(detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: [])

[INF] LOAD THD[1] error data output to file /usr/local/zcbus/log/dmp20240607/10004_1_1_20240607142042.log, please check!
error at file[dml_direct_process.c] line[458], ZCBUS-20001: mysql_real_query failed: errCode = 3, detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: []
error at file[dml_process.c] line[846], ZCBUS-20001: mysql_real_query failed: errCode = 3, detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: []
error at file[msg_load_db.c] line[1310], ZCBUS-20001: mysql_real_query failed: errCode = 3, detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: []
error at file[msg_load_db.c] line[1358], ZCBUS-20001: mysql_real_query failed: errCode = 3, detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: []
[ERR] LOAD THD[1], ZCBUS-20001: mysql_real_query failed: errCode = 3, detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: []
[ERR] LOAD THD[1] msg_load, ZCBUS-20001: mysql_real_query failed: errCode = 3, detailMessage = tablet 67816 alive replica num 0 < load required replica num 1, alive backends: [], sleep 10 s and retry 1...
[LV0] REAL CONSUME THD: full subscription not complete, wait 5 seconds and check again...
[STAT] 2024-06-07 14:20:44: FULL CONSUME THD message 0 is loading by LOAD THD[1], load use 60 s already.

解决办法

升级DDL包即可。原因可能是执行建表语句时， 遇DECIMAL (65,10) 操作导致BE被杀掉了

7.报错信息（There is no scanNode Backend available.[10109: not alive]）

error at file[mysql/mysql.c] line[294], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = There is no scanNode Backend available.[10109: not alive]
error at file[mysql/mysql.c] line[587], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = There is no scanNode Backend available.[10109: not alive]
error at file[ddl_process.c] line[58], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = There is no scanNode Backend available.[10109: not alive]
error at file[msg_load_db.c] line[1690], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = There is no scanNode Backend available.[10109: not alive]
error at file[msg_load_db.c] line[1827], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = There is no scanNode Backend available

解决办法

DORIS be宕机,暂时没有找到原因。重启be即可

8.报错信息（failed to init rowset builder. version count: 2002, exceed limit: 2000）

error at file[load_process.c] line[494], ZCBUS-62015: doris load error, [CANCELLED][INTERNAL_ERROR]tablet error: [E-235]failed to init rowset builder. version count: 2002, exceed limit: 2000, tablet: 67866, host: 10.141.129.200
error at file[load_process.c] line[182], ZCBUS-62015: doris load error, [CANCELLED][INTERNAL_ERROR]tablet error: [E-235]failed to init rowset builder. version count: 2002, exceed limit: 2000, tablet: 67866, host: 10.141.129.200
error at file[msg_load_db.c] line[1832], ZCBUS-62015: doris load error, [CANCELLED][INTERNAL_ERROR]tablet error: [E-235]failed to init rowset builder. version count: 2002, exceed limit: 2000, tablet: 67866, host: 10.141.129.200
[ERR] LOAD THD[1], ZCBUS-62015: doris load error, [CANCELLED][INTERNAL_ERROR]tablet error: [E-235]failed to init rowset builder. version count: 2002, exceed limit: 2000, tablet: 67866, host: 10.141.129.200, retry normal mode

解决办法

修改 be.conf 参数文件 添加：be max_tablet_version_num=4000
max_tablet_version_num
类型：int
描述：限制单个 tablet 最大 version 的数量。用于防止导入过于频繁，或 compaction 不及时导致的大量 version 堆积问题。当超过限制后，导入任务将被拒绝。
默认值：500
这个错误的含义是，对应tablet的数据版本超过了最大限制（默认500，由 BE 参数 max_tablet_version_num 控制），后续写入将被拒绝。比如问题中这个错误，即表示 67866 这个tablet的数据版本超过了限制。
这个错误通常是因为导入的频率过高，大于后台数据的compaction速度，导致版本堆积并最终超过了限制。
此时，我们可以先通过show tablet 67866 语句，然后执行结果中的 show proc 语句，查看tablet各个副本的情况。
结果中的 versionCount即表示版本数量。如果发现某个副本的版本数量过多，则需要降低导入频率或停止导入，并观察版本数是否有下降。
如果停止导入后，版本数依然没有下降，则需要去对应的BE节点查看be.INFO日志，搜索tablet id以及 compaction关键词，检查compaction是否正常运行。

9.报错信息（INVERTED index can only apply to a single column）

CREATE INDEX `i_org_orgs_oopig` ON `testdb`.`org_orgs`  (`isbusinessunit`,`orgtype4`,`orgtype3`,`pk_group`)
[LV0] LOAD THD[3]: exec ddl[1] CREATE INDEX `i_org_orgs_oopig` ON `testdb`.`org_orgs`  (`isbusinessunit`,`orgtype4`,`orgtype3`,`pk_group`)...
error at file[mysql/mysql.c] line[294], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = INVERTED index can only apply to a single column.
[ERR] exec sql: CREATE INDEX `i_org_orgs_oopig` ON `testdb`.`org_orgs`  (`isbusinessunit`,`orgtype4`,`orgtype3`,`pk_group`)
error at file[ddl_process.c] line[175], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = INVERTED index can only apply to a single column.
error at file[msg_load_db.c] line[1690], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = INVERTED index can only apply to a single column.
error at file[msg_load_db.c] line[1827], ZCBUS-20001: mysql_real_query failed: errCode = 2, detailMessage = INVERTED index can only apply to a single column.

解决办法

升级DDL包

10.报错信息（[DATA_QUALITY_ERROR]too many filtered rows）

     TABLE[test.hi_psndoc_nationduty] INSERT[4941] DDL[0]
[STAT] 2024-06-07 16:00:36: LOAD THD[1] loading FULL message 11, table[test.hi_psndoc_nationduty] topic[10002.27.s.1] offset[13] length[5242517]...
[LV0] LOAD THD[1]: load mode.
[LV0] LOAD THD[1]: 2024-06-07 16:00:36: table[test.hi_psndoc_nationduty] bsd data time[2024-06-04 16:48:09], delay 256347 s.
LOAD THD[4]: exec -> curl --location-trusted -u root:KRDrgAk3EVo@ME3 -T /usr/local/zcbus/cache/client/customer10007/p29/4.txt -H "column_separator:<zcbus>," -H "line_delimiter:<zcbus>\n" http://10.141.129.200:8030/api/test/hi_psndoc_nationduty/_stream_load >/usr/local/zcbus/cache/client/customer10007/p29/4.txt.log 2>&1
LOAD THD[1]: exec -> curl --location-trusted -u root:KRDrgAk3EVo@ME3 -T /usr/local/zcbus/cache/client/customer10007/p29/1.txt -H "column_separator:<zcbus>," -H "line_delimiter:<zcbus>\n" http://10.141.129.200:8030/api/test/hi_psndoc_nationduty/_stream_load >/usr/local/zcbus/cache/client/customer10007/p29/1.txt.log 2>&1
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0 2769k    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 2769k  100   691  100 2769k    519  2082k  0:00:01  0:00:01 --:--:--   612
{
    "TxnId": 98843,
    "Label": "bef0cf43-4e37-4aed-8089-3d923945d661",
    "Comment": "",
    "TwoPhaseCommit": "false",
    "Status": "Fail",
    "Message": "[DATA_QUALITY_ERROR]too many filtered rows",
    "NumberTotalRows": 4910,
    "NumberLoadedRows": 4908,
    "NumberFilteredRows": 2,
    "NumberUnselectedRows": 0,
    "LoadBytes": 2835572,
    "LoadTimeMs": 1281,
    "BeginTxnTimeMs": 0,
    "StreamLoadPutTimeMs": 2,
    "ReadDataTimeMs": 0,
    "WriteDataTimeMs": 1274,
    "CommitAndPublishTimeMs": 0,
    "ErrorURL": "http://10.141.129.200:8040/api/_load_error_log?file=__shard_3/error_log_insert_stmt_974dd733fc5ab2f0-2220ae67c4129ca5_974dd733fc5ab2f0_2220ae67c4129ca5"
}
error at file[load_process.c] line[494], ZCBUS-62015: doris load error, [DATA_QUALITY_ERROR]too many filtered rows
error at file[load_process.c] line[182], ZCBUS-62015: doris load error, [DATA_QUALITY_ERROR]too many filtered rows
error at file[msg_load_db.c] line[1832], ZCBUS-62015: doris load error, [DATA_QUALITY_ERROR]too many filtered rows

error at file[mysql/mysql.c] line[294], ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_4/error_log_insert_stmt_2298ea38f0bd4563-afabd75e4ae271d9_2298ea38f0bd4563_afabd75e4ae271d9

解决办法

doris导入数据too many filtered row
原因
没有设置分隔符 column_separator
数据中包含分隔符导致分割后的数据列与cloumn数量不一致
重新全量订阅

11.报错信息（BUT data will be visible later, retry normal mode）

[INF] MYSQL VERSION: 50799
[INF] MYSQL INFO: 5.7.99
SET SESSION sql_mode='ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'
[LV0] LOAD THD[1]: multi-insert mode.
[LV0] LOAD THD[1]: 2024-06-07 16:20:25: table[testdb.bm_data] bsd data time[2024-06-04 14:53:12], delay 264433 s.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0 2892k    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 2892k    0     0  100 2892k      0   236k  0:00:12  0:00:12 --:--:--     0
100 2892k    0     0  100 2892k      0   114k  0:00:25  0:00:25 --:--:--     0
100 2892k    0     0  100 2892k      0  77336  0:00:38  0:00:38 --:--:--     0
100 2892k    0     0  100 2892k      0  57722  0:00:51  0:00:50 --:--:--     0
100 2892k    0     0  100 2892k      0  46033  0:01:04  0:01:03 --:--:--     0
100 2892k    0     0  100 2892k      0  38287  0:01:17  0:01:16 --:--:--     0
100 2892k    0     0  100 2892k      0  32770  0:01:29  0:01:29 --:--:--     0
100 2892k  100   581  100 2892k      6  32637  0:01:36  0:01:30  0:00:06   132
{
    "TxnId": 102419,
    "Label": "b1bdea6d-cbb8-479d-8ad9-9cbf2836357c",
    "Comment": "",
    "TwoPhaseCommit": "false",
    "Status": "Publish Timeout",
    "Message": "[PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later",
    "NumberTotalRows": 1623,
    "NumberLoadedRows": 1623,
    "NumberFilteredRows": 0,
    "NumberUnselectedRows": 0,
    "LoadBytes": 2961531,
    "LoadTimeMs": 90736,
    "BeginTxnTimeMs": 0,
    "StreamLoadPutTimeMs": 7,
    "ReadDataTimeMs": 0,
    "WriteDataTimeMs": 60722,
    "CommitAndPublishTimeMs": 0
}
error at file[load_process.c] line[494], ZCBUS-62015: doris load error, [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later
error at file[load_process.c] line[182], ZCBUS-62015: doris load error, [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later
error at file[msg_load_db.c] line[1832], ZCBUS-62015: doris load error, [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later
[ERR] LOAD THD[3], ZCBUS-62015: doris load error, [PUBLISH_TIMEOUT]TStatus: transaction commit successfully, BUT data will be visible later, retry normal mode

解决办法

有一批次streamLoad任务报错,实际是publish超时了这个猜测,可能是fe处理不过来，提高单次导入的吞吐,也可能be 有压力来不及publish了
解决办法
降低streamLoad任务每批次的频次,提高单次导入的数据量,保证总的数据量不变

12.报错信息（Insert has filtered data in strict mode）

error at file[dml_direct_process.c] line[458], ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686
error at file[dml_process.c] line[846], ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686
error at file[msg_load_db.c] line[1310], ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686
error at file[msg_load_db.c] line[1358], ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686
[ERR] LOAD THD[1], ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686
[ERR] LOAD THD[1] msg_load, ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686, sleep 10 s and retry 1...
[LV0] REAL CONSUME THD: full subscription not complete, wait 5 seconds and check again...
^C
[root@d5fdca907fd6 log]# curl http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_insert_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686
Reason: column_name[operator], the length of input is too long than schema. first 32 bytes of input str: [陈明飞                 ] schema length: 20; actual length: 26; . src line []; 
[root@d5fdca907fd6 log]# more /usr/local/zcbus/log/dmp20240607/10007_1_0_20240607164546.log
2024-06-07 16:45:46: op type: 0
test.wb_psn_cost_h          0/0
      0/1     type[char][10] name[pk_psn_cost_h] NULL
      1/2     type[char][10] name[pk_ct_manage] NULL
      2/3     type[char][10] name[pk_corp] NULL
      3/4     type[varchar][11] name[year] NULL
      4/5     type[char][10] name[period] NULL
      5/6     type[char][10] name[managers] NULL
      6/7     type[char][10] name[operator] NULL
      7/8     type[char][10] name[grantflag] NULL
      8/9     type[char][10] name[sendflag] NULL
      9/10    type[varchar][11] name[def_str1] NULL
     10/11    type[varchar][11] name[def_str2] NULL
     11/12    type[varchar][11] name[def_str3] NULL
     12/13    type[varchar][11] name[def_str4] NULL
     13/14    type[char][10] name[def_str5] NULL
     14/15    type[char][10] name[def_str6] NULL
     15/16    type[char][10] name[def_str7] NULL
     16/17    type[char][10] name[def_str8] NULL
     17/18    type[decimal][7] name[def_num1] NULL
     18/19    type[decimal][7] name[def_num2] NULL
     19/20    type[varchar][11] name[pk_org] NULL
     20/21    type[varchar][11] name[pk_group] NULL
     21/22    type[char][10] name[ts] NULL
     22/23    type[decimal][7] name[dr] NULL

pk/uk count: 1
  pk/uk 1:
    pk_psn_cost_h

error data:

row[1]:
   cols:23                 
     pk_psn_cost_h[string][20]='00000000000000135211'
     pk_ct_manage[string][20]='00000000000000013966'
     pk_corp[string][20]='00000000000000011900'
     year[string][4]='2018'
     period[string][2]='10'
     managers[string][0]=NULL
     operator[string][26]='陈明飞                 '
     grantflag[string][0]=NULL
     sendflag[string][1]='0'
     def_str1[string][0]=NULL
     def_str2[string][0]=NULL
     def_str3[string][0]=NULL
     def_str4[string][0]=NULL
     def_str5[string][0]=NULL
     def_str6[string][0]=NULL
     def_str7[string][0]=NULL
     def_str8[string][0]=NULL
     def_num1[number][0]=NULL
     def_num2[number][0]=NULL
     pk_org[string][0]=NULL
     pk_group[string][0]=NULL
     ts[string][19]='2018-12-31 15:25:10'
     dr[number][1]='0'

ZCBUS-20001: mysql_real_query failed: Insert has filtered data in strict mode, tracking_url=http://10.141.129.200:8040/api/_load_error_log?file=__shard_93/error_log_inse
rt_stmt_dd070572cac749d5-8cc2d9daf1d50686_dd070572cac749d5_8cc2d9daf1d50686

解决办法

手动修改表结构
alter table test.wb_psn_cost_h modify column operator varchar(300);
alter table test.wb_psn_work modify column pk_om_job varchar(30);

文档更新时间: 2024-06-11 00:55   作者：程少波