同步hive报错

2022-07-17 文章 ynz...@163.com 
Hi,

我在使用flink将数据写入hudi同步hive时，遇到了以下错误（flink-1.14.4、hadoop-3.3.1、hudi-0.11.1、hive-3.1.2、yarn-per-job），
当我仅将数据写入hudi时，成功；当我添加sync_hive配置后，报错，
org.apache.flink.runtime.rpc.akka.exceptions.AkkaRpcException: Could not start 
RpcEndpoint jobmanager_2.
at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:629)
 ~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleControlMessage(AkkaRpcActor.java:185)
 ~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.actor.Actor.aroundReceive(Actor.scala:537) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.actor.Actor.aroundReceive$(Actor.scala:535) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.actor.ActorCell.invoke(ActorCell.scala:548) 
~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) 
[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.dispatch.Mailbox.run(Mailbox.scala:231) 
[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at akka.dispatch.Mailbox.exec(Mailbox.scala:243) 
[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) 
[?:1.8.0_301]
at 
java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1067) 
[?:1.8.0_301]
at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1703) 
[?:1.8.0_301]
at 
java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:172) 
[?:1.8.0_301]
Caused by: org.apache.flink.runtime.jobmaster.JobMasterException: Could not 
start the JobMaster.
at 
org.apache.flink.runtime.jobmaster.JobMaster.onStart(JobMaster.java:391) 
~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:181)
 ~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.lambda$start$0(AkkaRpcActor.java:624)
 ~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at 
org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
 ~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.start(AkkaRpcActor.java:623)
 ~[flink-rpc-akka_95cbfbf8-1d54-4569-8d93-600a8c51abbe.jar:1.14.4]
... 20 more
Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to start the 
operator coordinators
at 
org.apache.flink.runtime.scheduler.DefaultOperatorCoordinatorHandler.startAllOperatorCoordinators(DefaultOperatorCoordinatorHandler.java:90)
 ~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.scheduler.SchedulerBase.startScheduling(SchedulerBase.java:585)
 ~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.jobmaster.JobMaster.startScheduling(JobMaster.java:965)
 ~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.jobmaster.JobMaster.startJobExecution(JobMaster.java:882)
 ~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.jobmaster.JobMaster.onStart(JobMaster.java:389) 
~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.rpc.RpcEndpoint.internalCallOnStart(RpcEndpoint.java:181)
 ~[flink-dist_2.11-1.14.4.jar:1.14.4]
at 
org.apache.flink.runtime.rpc.akka.AkkaRpcActor$StoppedState.lambda$start$0(AkkaRpcActor.java:624)

Re: 退订

2022-07-17 文章 yuxia 
Hi，退订发送任意内容至邮箱user-zh-unsubscr...@flink.apache.org 即可

Best regards,
Yuxia

- 原始邮件 -
发件人: "左铿" 
收件人: "user-zh" 
发送时间: 星期日, 2022年 7 月 17日 下午 6:02:40
主题: 退订

退订

Re: 退订

2022-07-17 文章 yuxia 
退订发送任意内容至邮箱user-zh-unsubscr...@flink.apache.org 即可

Best regards,
Yuxia

- 原始邮件 -
发件人: "henrylee" 
收件人: "user-zh" 
发送时间: 星期日, 2022年 7 月 17日 上午 10:33:08
主题: 退订

退订

1.15.1 web ui 控制台报错

2022-07-17 文章 yidan zhao 
如图，1.15.1启动后，提交examples中任务，web ui 查看checkpoint，不显示内容。
console报错：

main.a7e97c2f60a2616e.js:1 ERROR TypeError: Cannot read properties of
null (reading 'checkpointed_size')
at q (253.e9e8f2b56b4981f5.js:1:607974)
at Sl (main.a7e97c2f60a2616e.js:1:186068)
at Br (main.a7e97c2f60a2616e.js:1:184696)
at N8 (main.a7e97c2f60a2616e.js:1:185128)
at Br (main.a7e97c2f60a2616e.js:1:185153)
at N8 (main.a7e97c2f60a2616e.js:1:185128)
at Br (main.a7e97c2f60a2616e.js:1:185153)
at N8 (main.a7e97c2f60a2616e.js:1:185128)
at Br (main.a7e97c2f60a2616e.js:1:185153)
at B8 (main.a7e97c2f60a2616e.js:1:191872)

已提交到jira。

退订

2022-07-17 文章 左铿 
退订