flume kafka sink 抛出异常 Bootstrap Servers must be specified

最新推荐文章于 2025-03-13 17:41:35 发布

转载最新推荐文章于 2025-03-13 17:41:35 发布 · 3.4k 阅读

0 ·

本内容遵循CC 4.0 BY-SA版权协议

原文链接：https://my.oschina.net/dreamness/blog/3084883

收录于

当前文章被以下社区和专栏收录：

在使用Flume传输数据到Kafka时，遇到了启动异常'Bootstrap Servers must be specified'。问题根源在于Flume Kafka Sink配置中遗漏了Kafka服务器地址。通过检查官方文档，发现需要明确指定Bootstrap Servers的配置项。修复此问题后，Flume成功连接到Kafka。

使用flume kafka sink时，启动flume抛出异常

Sink kafkasink has been removed due to an error during configuration
org.apache.flume.conf.ConfigurationException: Bootstrap Servers must be specified
	at org.apache.flume.sink.kafka.KafkaSink.translateOldProps(KafkaSink.java:371)
	at org.apache.flume.sink.kafka.KafkaSink.configure(KafkaSink.java:307)
	at org.apache.flume.conf.Configurables.configure(Configurables.java:41)

flume kafka sink相关如下：

a1.sinks.kafkasink.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.kafkasink.topic = logalerttopic
a1.sinks.kafkasink.bootstrap.servers = c1:9092, c2:9092, c3:9092
a1.sinks.kafkasink.flumeBatchSize = 20
a1.sinks.kafkasink.producer.acks = 1
a1.sinks.kafkasink.producer.compression.type = snappy
#a1.sinks.kafkasink.type = logger

经仔细对比官方文档发现， kafka sink相关配置项中，有几项配置带有kafka.的内容，在配置中被我忽略了。
更正如下：

a1.sinks.kafkasink.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.kafkasink.kafka.topic = logalerttopic
a1.sinks.kafkasink.kafka.bootstrap.servers = c1:9092, c2:9092, c3:9092
a1.sinks.kafkasink.flumeBatchSize = 20
a1.sinks.kafkasink.kafka.producer.acks = 1
a1.sinks.kafkasink.kafka.producer.compression.type = snappy

转载于:https://my.oschina.net/dreamness/blog/3084883

标签