故障报告

1. 问题（故障）描述

_delimiter:<zcbus>\n" http://10.141.129.200:8030/api/testdb/bd_psndoc/_stream_load                                                           
{
    "TxnId": 21163,
    "Label": "cae29771-94d5-462d-a506-2bd6eacd2643",
    "Comment": "",
    "TwoPhaseCommit": "false",
    "Status": "Fail",
    "Message": "[DATA_QUALITY_ERROR]too many filtered rows",
    "NumberTotalRows": 1,
    "NumberLoadedRows": 0,
    "NumberFilteredRows": 1,
    "NumberUnselectedRows": 0,
    "LoadBytes": 8290539,
    "LoadTimeMs": 88,
    "BeginTxnTimeMs": 1,
    "StreamLoadPutTimeMs": 5,
    "ReadDataTimeMs": 1,
    "WriteDataTimeMs": 80,
    "CommitAndPublishTimeMs": 0,
    "ErrorURL": "http://10.141.129.200:8040/api/_load_error_log?file=__shard_18/error_log_insert_stmt_51436dbb94ccc41d-62673d8273db90bc_51436dbb94ccc41d_62673d8273db90bc"
}
[root@d5fdca907fd6 log]# curl http://10.141.129.200:8040/api/_load_error_log?file=__shard_18/error_log_insert_stmt_51436dbb94ccc41d-62673d8273db90bc_51436dbb94ccc41d_62673d8273db90bc
Reason: column_name[photo], the length of input string is too long than vec schema. first 32 bytes of input str: [89504e470d0a1a0a0000000d49484452] schema length: 2147483643; limit length: 1048576; actual length: 8247464; . src line []; 

2. 问题（故障）原因

doris string类型限制
变长字符串，默认支持 1048576 字节（1MB），可调大到 2147483643 字节（2GB）。可通过 BE 配置 string_type_length_soft_limit_bytes 调整。String 类型只能用在 Value 列，不能用在 Key 列和分区分桶列。

3. 解决

4. 参考

参考: https://doris.apache.org/zh-CN/docs/table-design/data-type