Flink多任务多启动模式同时进行

最新推荐文章于 2022-05-31 21:43:53 发布

原创

最新推荐文章于 2022-05-31 21:43:53 发布 · 3.4k 阅读

标签

#flink #hadoop

收录于

当多个Flink任务尝试在同一端口8081上启动时，会出现端口冲突导致任务失败。为解决此问题，可以在`flink-conf.yaml`配置文件中设置`rest.bind-port`参数，指定一个端口范围，如50100-50200。这样，每次任务启动时会随机选取该范围内的一个端口，避免冲突。但若端口范围耗尽，仍可能报错。修正配置并重启Flink服务可以确保任务正常运行。

不知你们遇到过这样得问题没：

ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Could not start cluster entrypoint YarnJobClusterEntrypoint.
org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to initialize the cluster entrypoint YarnJobClusterEntrypoint.
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:187)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:518)
        at org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint.main(YarnJobClusterEntrypoint.java:119)
Caused by: org.apache.flink.util.FlinkException: Could not create the DispatcherResourceManagerComponent.
        at org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:261)
        at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.