flink sql 连接kafka avro序列化异常 Malformed data. Length is negative: -25

最新推荐文章于 2025-06-20 01:44:17 发布

原创

最新推荐文章于 2025-06-20 01:44:17 发布 · 2.1k 阅读

标签

#flink #sql #kafka

收录于

本文介绍了在使用Flink SQL连接Kafka并处理Avro格式数据时遇到的序列化异常问题。错误源于SQL中字段定义与Avro schema不匹配，包括字段数量和类型。解决办法是确保SQL DDL与Avro schema完全一致。

反序列化 avro格式时候遇到如下问题，原因是flink sql 的数据源DDL的字段定义要和avro的schema定义一致，字段数量，字段类型都要一致。

Caused by: org.apache.avro.AvroRuntimeException: Malformed data. Length is negative: -25
	at org.apache.avro.io.BinaryDecoder.doReadBytes(BinaryDecoder.java:336) ~[flink-shaded-hadoop-2-uber-3.1.3-10.0-SNAPSHOT.jar:3.1.3-10.0-SNAPSHOT]
	at org.apache.avro.io.BinaryDecoder.readString(BinaryDecoder.java:263) ~[flink-shaded-hadoop-2-uber-3.1.3-10.0-SNAPSHOT.jar:3.1.3-10.0-SNAPSHOT]
	at org.apache.avro.io.ResolvingDecoder.readString(ResolvingDecoder.java:201) ~[flink-shaded-hadoop-2-uber-3.1.3-10.0-SNAPSHOT.jar:3.1.3-10.0-SNAPSHOT]
	at org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:422) ~[flink-shaded-hadoop-2-uber-3.1.3-10.0-SNAPSHOT.jar:3.1.3-10.0-SNAPSHOT]
	at org.apache.avro.generic.GenericDatumReader.readString(GenericDatumReader.java:414) ~[flink-shaded-hadoop-2-uber-3.1.3-10.0-SNAPSHOT.jar:3.1.3-10.0-SNAPSHOT]
	at org.apache