Re: Flink On Yarn HA 部署模式下Flink程序无法启动

您好，我的版本是1.13.1 --Original-- From: "Yang Wang"https://issues.apache.org/jira/browse/FLINK-19212 Best, Yang 周瑞

Re: Flink On Yarn HA 部署模式下Flink程序无法启动

看报错应该是个已知问题[1]并且已经在1.11.2中修复 [1]. https://issues.apache.org/jira/browse/FLINK-19212 Best, Yang 周瑞 于2021年8月17日周二 上午11:04写道： > 您好：Flink程序部署在Yran上以Appliation Mode 模式启动的，在没有采用HA > 模式的时候可以正常启动，配置了HA之后，启动异常，麻烦帮忙看下是什么原因导致的. > > > HA 配置如下： > high-availability: zookeeper high-availability.storageDir:

Flink On Yarn HA 部署模式下Flink程序无法启动

您好：Flink程序部署在Yran上以Appliation Mode 模式启动的，在没有采用HA 模式的时候可以正常启动，配置了HA之后，启动异常，麻烦帮忙看下是什么原因导致的. HA 配置如下： high-availability: zookeeper high-availability.storageDir: hdfs://mycluster/flink/ha high-availability.zookeeper.quorum: zk-1:2181,zk-2:2181,zk-3:2181 high-availability.zookeeper.path.root:

Re: flink on yarn ha 高可用问题

nk扩展的同时也到在对应的服务器上配置hadoop，同时进行hadoop扩展？ > > > > > > > > > -- 原始邮件 ------ > 发件人: "Lin Li"; > 发送时间: 2019年4月2日(星期二) 上午9:47 > 收件人: "user-zh"; > > 主题: Re: flink on yarn ha 高可用问题 > > > > hdfs ha mode 下配置 logical nam

?????? flink on yarn ha ??????????

) 9:47 ??: "user-zh"; ????: Re: flink on yarn ha ?? hdfs ha mode ?? logical name ( https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html ) flink hdfs logical name ( flink task hdfs-clien

Re: flink on yarn ha 高可用问题

年4月2日周二 上午9:07写道： > flink on yarn ha模式下 > state.checkpoints.dir: > hdfs://namenode-host:port/flink-checkpoints这个配置怎么配置能进行namenode能自动切换 > > 现在只能指定namenode的hostname,假设这个namenode节点挂了,或者standby状态,flink任务checkpoint就报错，只能把节点起来，而且要将其切换为active节点 > 目前hadoop namenode已经进行ha部署了，手动kill 一个namen

flink on yarn ha ??????????

flink on yarn ha?? state.checkpoints.dir: hdfs://namenode-host:port/flink-checkpoints??namenode?? namenode??hostname,namenode,standby,flinkcheckpointactive hadoop namenode

Re: flink on yarn ha

Hi, This looks like a shading issue. Can you post the classpath the JobManager / AppMaster is logging on startup on the mailing list? If seems that Hadoop loads an unshaded version of the SecurityProtos. Maybe there is some hadoop version mixup. Are you using a Hadoop distribution (like CDH or

Re: flink on yarn ha

Hi, I update flink from 1.1.3 to 1.2 but fail this is jobManager error log Failed toString() invocation on an object of type [org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBImpl] java.lang.NoSuchMethodError:

Re: flink on yarn ha

Thanks, Stephan ! I will try it! 2017-02-21 21:42 GMT+08:00 Stephan Ewen : > Hi! > > Flink 1.1.4 and Flink 1.2 fixed a bunch of issues with HA, can you try > those versions? > > If these also have issues, could you share the logs of the JobManager? > > Thanks! > > On Tue, Feb

Re: flink on yarn ha

Hi! Flink 1.1.4 and Flink 1.2 fixed a bunch of issues with HA, can you try those versions? If these also have issues, could you share the logs of the JobManager? Thanks! On Tue, Feb 21, 2017 at 11:41 AM, lining jing wrote: > flink version: 1.1.3 > > kill jobmanager,

flink on yarn ha

flink version: 1.1.3 kill jobmanager, the job fail. Ha config did not work.