Hello,
I am trying to use portable mode like this –
java -cp "target/samza-beam-examples-0.1.jar:lib/*"
org.apache.beam.examples.KafkaWordCount
--configFilePath=$PWD/deploy/examples/config/standalone.properties
--maxSourceParallelism=1024 --maxBundleSize=1000
alue
*task.shutdown.ms <http://task.shutdown.ms> = 1 + x*
*job.coordinator.zk.consensus.timeout.ms
<http://job.coordinator.zk.consensus.timeout.ms> = 3 + x*
Let me know how it goes.
Thanks,
Bharath
On Sat, Mar 21, 2020 at 3:17 PM Deshpande, Om
We are using beam with samza runner - beam.version 2.19.0, samza.version 1.3.0
And we are seeing the following excption frequently. Should we be tweaking some
configuration? Does this point to any network connectivity issue?
2020/03/21 21:42:09.896 INFO o.a.s.zk.ZkBarrierForVersionUpgrade -
Yes, we are resuming from samza’s last commit. But the problem is that the last
commit was done for data in the window that is not completely processed.
From: Lukasz Cwik
Date: Wednesday, July 10, 2019 at 11:07 AM
To: dev
Cc: "LeVeck, Matt" , "Deshpande, Omkar"
, X
am/sdk/transforms/GroupIntoBatches.html).
> This will group the elements into batches and then deliver to your ParDo
> afterwards. Please let us know whether this works for you.
>
> Thanks,
> Xinyu
>
>
>
> On Fri, Jan 18, 2019 at 10:27 AM Daniel
Hello,
I am using Samza runner with Apache Beam. Is there any documentation available
on how bundles are implemented in the Samza runner?
I have observed every Kafka record getting processed in its own bundle. How can
I get larger bundles?
2.9.0 0.14.1
Thanks,
Omkar
Hello,
I am getting following exception while running Beam Samza Runner –
java.lang.UnsupportedOperationException: Cannot create a producer for an input
system
at
org.apache.beam.runners.samza.adapter.BoundedSourceSystem$Factory.getProducer(BoundedSourceSystem.java:411)
at
=org.apache.samza.system.kafka.KafkaSystemFactory
systems.kafka.consumer.zookeeper.connect=localhost:2181
systems.kafka.producer.bootstrap.servers=localhost:9092
systems.kafka.default.stream.replication.factor=1
From: "Deshpande, Omkar"
Date: Thursday, January 3, 2019 at 5:24 PM
To: "dev@samza.apache.or
il.ArrayList.forEach(ArrayList.java:1257)
at
org.apache.samza.runtime.RemoteApplicationRunner.run(RemoteApplicationRunner.java:82)
... 5 more
Regards,
Omkar Deshpande
From: Xinyu Liu
Date: Thursday, January 3, 2019 at 3:25 PM
To: "dev@samza.apache.org" , &q
Samza 1.0. Can
you verify that the deployment is indeed using samza 0.14.1?
Thanks,
Prateek
On Wed, Jan 2, 2019 at 11:40 PM Deshpande, Omkar
wrote:
>
> Hello,
>
> I have been able to execute my Samza-Beam application in Local mode. And
Hello,
I have been able to execute my Samza-Beam application in Local mode. And now I
am trying to run a Samza-Beam application in Standalone mode.
Here is my configFile config.properties:
app.name=test-app
job.coordinator.factory=org.apache.samza.zk.ZkJobCoordinatorFactory
11 matches
Mail list logo
