Hello,
I am trying to use portable mode like this –
java -cp "target/samza-beam-examples-0.1.jar:lib/*"
org.apache.beam.examples.KafkaWordCount
--configFilePath=$PWD/deploy/examples/config/standalone.properties
--maxSourceParallelism=1024 --maxBundleSize=1000
--configOverride="{\"beam.override.portable\":\"true\",\"beam.override.control.port\":\"6789\"}"
--runner=org.apache.beam.runners.samza.SamzaRunner
<beam.version>2.19.0</beam.version>
<samza.version>1.3.0</samza.version>
I am getting this error-
2020/04/07 02:58:02.667 ERROR o.a.b.r.samza.SamzaPipelineResult.getStateInfo
123 - Running samza in Beam portable mode but failed to create job bundle
factory
java.lang.RuntimeException: Running samza in Beam portable mode but failed to
create job bundle factory
at
org.apache.beam.runners.samza.SamzaExecutionContext.start(SamzaExecutionContext.java:132)
at
org.apache.samza.container.SamzaContainer$$anonfun$run$2.apply(SamzaContainer.scala:743)
at
org.apache.samza.container.SamzaContainer$$anonfun$run$2.apply(SamzaContainer.scala:743)
at scala.Option.foreach(Option.scala:257)
at
org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:743)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.TimeoutException: null
at
java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771)
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at
org.apache.beam.runners.fnexecution.control.MapControlClientPool.getClient(MapControlClientPool.java:69)
at
org.apache.beam.runners.samza.SamzaExecutionContext.start(SamzaExecutionContext.java:123)
... 9 common frames omitted
2020/04/07 02:58:02.667 INFO org.apache.zookeeper.ZooKeeper.close 684 -
Session: 0x1715268ad9b0093 closed
2020/04/07 02:58:02.667 INFO o.a.zookeeper.ClientCnxn$EventThread.run 512 -
EventThread shut down
20/04/07 02:58:02 DEBUG zkclient.ZkClient: Closing ZkClient...done
2020/04/07 02:58:02.667 INFO org.apache.samza.zk.ZkJobCoordinator.stop 221 -
Job Coordinator shutdown finished with ShutdownComplete=true
Exception in thread "main"
org.apache.beam.sdk.Pipeline$PipelineExecutionException:
java.lang.RuntimeException: Running samza in Beam portable mode but failed to
create job bundle factory
at
org.apache.beam.runners.samza.SamzaPipelineResult.getStateInfo(SamzaPipelineResult.java:126)
at
org.apache.beam.runners.samza.SamzaPipelineResult.waitUntilFinish(SamzaPipelineResult.java:89)
at
org.apache.beam.runners.samza.SamzaPipelineResult.waitUntilFinish(SamzaPipelineResult.java:105)
at org.apache.beam.examples.KafkaWordCount.main(KafkaWordCount.java:141)
Caused by: java.lang.RuntimeException: Running samza in Beam portable mode but
failed to create job bundle factory
at
org.apache.beam.runners.samza.SamzaExecutionContext.start(SamzaExecutionContext.java:132)
at
org.apache.samza.container.SamzaContainer$$anonfun$run$2.apply(SamzaContainer.scala:743)
at
org.apache.samza.container.SamzaContainer$$anonfun$run$2.apply(SamzaContainer.scala:743)
at scala.Option.foreach(Option.scala:257)
at
org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:743)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.TimeoutException
at
java.util.concurrent.CompletableFuture.timedGet(CompletableFuture.java:1771)
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1915)
at
org.apache.beam.runners.fnexecution.control.MapControlClientPool.getClient(MapControlClientPool.java:69)
at
org.apache.beam.runners.samza.SamzaExecutionContext.start(SamzaExecutionContext.java:123)
... 9 more
What am I missing?
