date:20180615

new pom.xml for samza-parent-project

2018-06-15 Thread Martin Gainty

Martin Gainty has shared a OneDrive file with you. To view it, click the link 
below.



[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]

pom 1.xml




>mvn dependency:tree

[INFO] 
[INFO] Reactor Summary:
[INFO]
[INFO] Samza Job Parent ... SUCCESS [  4.798 s]
[INFO] Samza Job Parent 0.001-SNAPSHOT  SUCCESS [  0.407 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 5.925 s
[INFO] Finished at: 2018-06-15T17:28:04-04:00
[INFO] 


attached new pom.xml for samza-parent-project (parent of samza-grid)

be sure to supply  that conforms to your project in pom.xml

directory structure should look like:

samza-parent-project

|

-samza-grid

Have Fun


Martin
__

 _ _  _ _  _ ___ _  
  _   _ _   _  |_   _| |_ ___   |  _  |___ ___ 
___| |_ ___   |   __|___|  _| |_ _ _ _ ___ ___ ___   |   __|___ _ _ ___ _| 
|___| |_|_|___ ___| | |   | -_|  | | . | .'|  _|   | -_|  |__   | . |  
_|  _| | | | .'|  _| -_|  |   __| . | | |   | . | .'|  _| | . |   |   |_| 
|_|_|___|  |__|__|  _|__,|___|_|_|___|  |_|___|_| |_| |_|__,|_| |___|  
|__|  |___|___|_|_|___|__,|_| |_|___|_|_||_|




From: Martin Gainty 
Sent: Friday, June 15, 2018 5:25 PM
To: users@kafka.apache.org; subharaj.ma...@gmail.com
Subject: new pom.xml for samza-grid


[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 3.006 s
[INFO] Finished at: 2018-06-15T17:20:09-04:00
[INFO] 


kafka-grid pom.xml attached


change  to the specific version you want to declare


Martin
__

 _ _  _ _  _ ___ _  
  _   _ _   _  |_   _| |_ ___   |  _  |___ ___ 
___| |_ ___   |   __|___|  _| |_ _ _ _ ___ ___ ___   |   __|___ _ _ ___ _| 
|___| |_|_|___ ___| | |   | -_|  | | . | .'|  _|   | -_|  |__   | . |  
_|  _| | | | .'|  _| -_|  |   __| . | | |   | . | .'|  _| | . |   |   |_| 
|_|_|___|  |__|__|  _|__,|___|_|_|___|  |_|___|_| |_| |_|__,|_| |___|  
|__|  |___|___|_|_|___|__,|_| |_|___|_|_||_|




From: Debraj Manna 
Sent: Friday, June 15, 2018 12:03 PM
To: users@kafka.apache.org
Subject: Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 
0.10.0.0

Please find the kafka and samza dependencies in the below link
https://gist.github.com/debraj-manna/d51af1896d74b68da55f0ef252886692
[https://avatars2.githubusercontent.com/u/8141860?s=400&v=4]

Kafka 
Samza
gist.github.com
Kafka Samza




On Fri, Jun 15, 2018 at 9:14 PM, Martin Gainty  wrote:

> unable to determine execution scenario without seeing pom.xml
>
>
> please supply pom.xml
>
>
> Martin
> __
>
>
>
>
> 
> From: Debraj Manna 
> Sent: Friday, June 15, 2018 11:11 AM
> To: users@kafka.apache.org
> Subject: Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and
> Kafka 0.10.0.0
>
> Martin
>
> Everything is working fine with samza 0.12. I am now trying to upgrade to
> latest samza 0.14.1 which is causing this issue. I am posting the relevant
> part from the output of mvn dependency:tree
> -Dincludes=org.apache.kafka*,org.apache.samza .
>
> [INFO] com.vnera.grid.samza-grid:samza-job-package:jar:0.001-SNAPSHOT
> [INFO] +- com.vnera.grid.samza-grid:task:jar:0.001-SNAPSHOT:runtime
> [INFO] |  +- org.apache.samza:samza-api:jar:0.14.1:runtime
> [INFO] |  \- org.apache.kafka:kafka-clients:jar:0.10.0.0:runtime
> [INFO] +- org.apache.samza:samza-shell:tgz:dist:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-core_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-yarn_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-kafka_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-kv_2.11:jar:0.14.1:runtime
> [INFO] \- org.apache.kafka:kafka_2.11:jar:0.10.0.0:runtime
>
> On Fri, Jun 15, 2018 at 8:31 PM, Martin Gainty

new pom.xml for samza-grid

2018-06-15 Thread Martin Gainty

Martin Gainty has shared a OneDrive file with you. To view it, click the link 
below.



[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]

pom.xml




[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 3.006 s
[INFO] Finished at: 2018-06-15T17:20:09-04:00
[INFO] 


kafka-grid pom.xml attached


change  to the specific version you want to declare


Martin
__

 _ _  _ _  _ ___ _  
  _   _ _   _  |_   _| |_ ___   |  _  |___ ___ 
___| |_ ___   |   __|___|  _| |_ _ _ _ ___ ___ ___   |   __|___ _ _ ___ _| 
|___| |_|_|___ ___| | |   | -_|  | | . | .'|  _|   | -_|  |__   | . |  
_|  _| | | | .'|  _| -_|  |   __| . | | |   | . | .'|  _| | . |   |   |_| 
|_|_|___|  |__|__|  _|__,|___|_|_|___|  |_|___|_| |_| |_|__,|_| |___|  
|__|  |___|___|_|_|___|__,|_| |_|___|_|_||_|




From: Debraj Manna 
Sent: Friday, June 15, 2018 12:03 PM
To: users@kafka.apache.org
Subject: Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 
0.10.0.0

Please find the kafka and samza dependencies in the below link
https://gist.github.com/debraj-manna/d51af1896d74b68da55f0ef252886692
[https://avatars2.githubusercontent.com/u/8141860?s=400&v=4]

Kafka 
Samza
gist.github.com
Kafka Samza




On Fri, Jun 15, 2018 at 9:14 PM, Martin Gainty  wrote:

> unable to determine execution scenario without seeing pom.xml
>
>
> please supply pom.xml
>
>
> Martin
> __
>
>
>
>
> 
> From: Debraj Manna 
> Sent: Friday, June 15, 2018 11:11 AM
> To: users@kafka.apache.org
> Subject: Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and
> Kafka 0.10.0.0
>
> Martin
>
> Everything is working fine with samza 0.12. I am now trying to upgrade to
> latest samza 0.14.1 which is causing this issue. I am posting the relevant
> part from the output of mvn dependency:tree
> -Dincludes=org.apache.kafka*,org.apache.samza .
>
> [INFO] com.vnera.grid.samza-grid:samza-job-package:jar:0.001-SNAPSHOT
> [INFO] +- com.vnera.grid.samza-grid:task:jar:0.001-SNAPSHOT:runtime
> [INFO] |  +- org.apache.samza:samza-api:jar:0.14.1:runtime
> [INFO] |  \- org.apache.kafka:kafka-clients:jar:0.10.0.0:runtime
> [INFO] +- org.apache.samza:samza-shell:tgz:dist:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-core_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-yarn_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-kafka_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-kv_2.11:jar:0.14.1:runtime
> [INFO] \- org.apache.kafka:kafka_2.11:jar:0.10.0.0:runtime
>
> On Fri, Jun 15, 2018 at 8:31 PM, Martin Gainty 
> wrote:
>
> > a strong possibility is that kafka-core is missing as a dependency for
> > samza
> >
> > please supply samza pom.xml
> >
> >
> > Martin
> > __
> >
> >
> >
> >
> > 
> > From: Debraj Manna 
> > Sent: Friday, June 15, 2018 10:52 AM
> > To: users@kafka.apache.org
> > Subject: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka
> > 0.10.0.0
> >
> > Hi
> >
> > I have posted the same in d...@samza.apache.org , posting it here also if
> > anyone is aware.
> >
> > *I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting
> > the below exception. Is this related
> > to https://issues.apache.org/jira/browse/SAMZA-1509
> > . ? Is samza 0.14.2
> not
> > compatible with 0.10 Kafka ? The same code was working fine with samza
> > 0.12. *
> >
> > 2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session:
> 0x164031c68f3030a
> > closed
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/kafka/common/errors/TopicExistsException
> > at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> > createStream$3.apply(KafkaSystemAdmin.scala:467)
> > at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> > createStream$3.apply(KafkaSystemAdmin.scala:465)
> > at org.apache.samza.util.ExponentialSleepStrategy.run(
> > ExponentialSleepStrategy.scala:89)
> > at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
> > KafkaSystemAdmin.scala:447)
> > at org.apache.samza.job.JobRunner.run(JobRunner.scala:92)
> > at org.apache.samza.job.JobRunner$.doOperation(JobRunner.sca

Flink on Yarn -Connection unexpectedly close dby remote task manager..

2018-06-15 Thread Garrett Barton

Hey all,

 My jobs that I am trying to write in Flink 1.5 are failing after a few
minutes.  I recon its because the idle task managers are shutting down, but
it seems to kill the client and the running job, which was still going on
one of the other task managers.  either way I get:

org.apache.flink.client.program.ProgramInvocationException:
org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException:
Connection unexpectedly closed by remote task manager ''. This might
indicate that the remote task manager was lost...

Now I happen to have the last part of the flow paralleled to 1 right now
for debugging, so the 4 task managers that are spun up, 3 of them hit the
timeout period (currently set to 24).  I think as soon as the first one
goes the client throws up and the whole job dies as a result.

 Is this expected behavior and if so, short of making obscene task manager
timeout times, is there another way around it?

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Debraj Manna

Please find the kafka and samza dependencies in the below link
https://gist.github.com/debraj-manna/d51af1896d74b68da55f0ef252886692

On Fri, Jun 15, 2018 at 9:14 PM, Martin Gainty  wrote:

> unable to determine execution scenario without seeing pom.xml
>
>
> please supply pom.xml
>
>
> Martin
> __
>
>
>
>
> 
> From: Debraj Manna 
> Sent: Friday, June 15, 2018 11:11 AM
> To: users@kafka.apache.org
> Subject: Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and
> Kafka 0.10.0.0
>
> Martin
>
> Everything is working fine with samza 0.12. I am now trying to upgrade to
> latest samza 0.14.1 which is causing this issue. I am posting the relevant
> part from the output of mvn dependency:tree
> -Dincludes=org.apache.kafka*,org.apache.samza .
>
> [INFO] com.vnera.grid.samza-grid:samza-job-package:jar:0.001-SNAPSHOT
> [INFO] +- com.vnera.grid.samza-grid:task:jar:0.001-SNAPSHOT:runtime
> [INFO] |  +- org.apache.samza:samza-api:jar:0.14.1:runtime
> [INFO] |  \- org.apache.kafka:kafka-clients:jar:0.10.0.0:runtime
> [INFO] +- org.apache.samza:samza-shell:tgz:dist:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-core_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-yarn_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-kafka_2.11:jar:0.14.1:runtime
> [INFO] +- org.apache.samza:samza-kv_2.11:jar:0.14.1:runtime
> [INFO] \- org.apache.kafka:kafka_2.11:jar:0.10.0.0:runtime
>
> On Fri, Jun 15, 2018 at 8:31 PM, Martin Gainty 
> wrote:
>
> > a strong possibility is that kafka-core is missing as a dependency for
> > samza
> >
> > please supply samza pom.xml
> >
> >
> > Martin
> > __
> >
> >
> >
> >
> > 
> > From: Debraj Manna 
> > Sent: Friday, June 15, 2018 10:52 AM
> > To: users@kafka.apache.org
> > Subject: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka
> > 0.10.0.0
> >
> > Hi
> >
> > I have posted the same in d...@samza.apache.org , posting it here also if
> > anyone is aware.
> >
> > *I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting
> > the below exception. Is this related
> > to https://issues.apache.org/jira/browse/SAMZA-1509
> > . ? Is samza 0.14.2
> not
> > compatible with 0.10 Kafka ? The same code was working fine with samza
> > 0.12. *
> >
> > 2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session:
> 0x164031c68f3030a
> > closed
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> > org/apache/kafka/common/errors/TopicExistsException
> > at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> > createStream$3.apply(KafkaSystemAdmin.scala:467)
> > at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> > createStream$3.apply(KafkaSystemAdmin.scala:465)
> > at org.apache.samza.util.ExponentialSleepStrategy.run(
> > ExponentialSleepStrategy.scala:89)
> > at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
> > KafkaSystemAdmin.scala:447)
> > at org.apache.samza.job.JobRunner.run(JobRunner.scala:92)
> > at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:53)
> > at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
> > at org.apache.samza.job.JobRunner.main(JobRunner.scala)
> > Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
> > errors.TopicExistsException
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > ... 8 more
> >
>

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Martin Gainty

unable to determine execution scenario without seeing pom.xml


please supply pom.xml


Martin
__





From: Debraj Manna 
Sent: Friday, June 15, 2018 11:11 AM
To: users@kafka.apache.org
Subject: Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 
0.10.0.0

Martin

Everything is working fine with samza 0.12. I am now trying to upgrade to
latest samza 0.14.1 which is causing this issue. I am posting the relevant
part from the output of mvn dependency:tree
-Dincludes=org.apache.kafka*,org.apache.samza .

[INFO] com.vnera.grid.samza-grid:samza-job-package:jar:0.001-SNAPSHOT
[INFO] +- com.vnera.grid.samza-grid:task:jar:0.001-SNAPSHOT:runtime
[INFO] |  +- org.apache.samza:samza-api:jar:0.14.1:runtime
[INFO] |  \- org.apache.kafka:kafka-clients:jar:0.10.0.0:runtime
[INFO] +- org.apache.samza:samza-shell:tgz:dist:0.14.1:runtime
[INFO] +- org.apache.samza:samza-core_2.11:jar:0.14.1:runtime
[INFO] +- org.apache.samza:samza-yarn_2.11:jar:0.14.1:runtime
[INFO] +- org.apache.samza:samza-kafka_2.11:jar:0.14.1:runtime
[INFO] +- org.apache.samza:samza-kv_2.11:jar:0.14.1:runtime
[INFO] \- org.apache.kafka:kafka_2.11:jar:0.10.0.0:runtime

On Fri, Jun 15, 2018 at 8:31 PM, Martin Gainty  wrote:

> a strong possibility is that kafka-core is missing as a dependency for
> samza
>
> please supply samza pom.xml
>
>
> Martin
> __
>
>
>
>
> 
> From: Debraj Manna 
> Sent: Friday, June 15, 2018 10:52 AM
> To: users@kafka.apache.org
> Subject: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka
> 0.10.0.0
>
> Hi
>
> I have posted the same in d...@samza.apache.org , posting it here also if
> anyone is aware.
>
> *I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting
> the below exception. Is this related
> to https://issues.apache.org/jira/browse/SAMZA-1509
> . ? Is samza 0.14.2 not
> compatible with 0.10 Kafka ? The same code was working fine with samza
> 0.12. *
>
> 2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session: 0x164031c68f3030a
> closed
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/kafka/common/errors/TopicExistsException
> at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> createStream$3.apply(KafkaSystemAdmin.scala:467)
> at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> createStream$3.apply(KafkaSystemAdmin.scala:465)
> at org.apache.samza.util.ExponentialSleepStrategy.run(
> ExponentialSleepStrategy.scala:89)
> at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
> KafkaSystemAdmin.scala:447)
> at org.apache.samza.job.JobRunner.run(JobRunner.scala:92)
> at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:53)
> at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
> at org.apache.samza.job.JobRunner.main(JobRunner.scala)
> Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
> errors.TopicExistsException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 8 more
>

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Debraj Manna

Martin

Everything is working fine with samza 0.12. I am now trying to upgrade to
latest samza 0.14.1 which is causing this issue. I am posting the relevant
part from the output of mvn dependency:tree
-Dincludes=org.apache.kafka*,org.apache.samza .

[INFO] com.vnera.grid.samza-grid:samza-job-package:jar:0.001-SNAPSHOT
[INFO] +- com.vnera.grid.samza-grid:task:jar:0.001-SNAPSHOT:runtime
[INFO] |  +- org.apache.samza:samza-api:jar:0.14.1:runtime
[INFO] |  \- org.apache.kafka:kafka-clients:jar:0.10.0.0:runtime
[INFO] +- org.apache.samza:samza-shell:tgz:dist:0.14.1:runtime
[INFO] +- org.apache.samza:samza-core_2.11:jar:0.14.1:runtime
[INFO] +- org.apache.samza:samza-yarn_2.11:jar:0.14.1:runtime
[INFO] +- org.apache.samza:samza-kafka_2.11:jar:0.14.1:runtime
[INFO] +- org.apache.samza:samza-kv_2.11:jar:0.14.1:runtime
[INFO] \- org.apache.kafka:kafka_2.11:jar:0.10.0.0:runtime

On Fri, Jun 15, 2018 at 8:31 PM, Martin Gainty  wrote:

> a strong possibility is that kafka-core is missing as a dependency for
> samza
>
> please supply samza pom.xml
>
>
> Martin
> __
>
>
>
>
> 
> From: Debraj Manna 
> Sent: Friday, June 15, 2018 10:52 AM
> To: users@kafka.apache.org
> Subject: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka
> 0.10.0.0
>
> Hi
>
> I have posted the same in d...@samza.apache.org , posting it here also if
> anyone is aware.
>
> *I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting
> the below exception. Is this related
> to https://issues.apache.org/jira/browse/SAMZA-1509
> . ? Is samza 0.14.2 not
> compatible with 0.10 Kafka ? The same code was working fine with samza
> 0.12. *
>
> 2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session: 0x164031c68f3030a
> closed
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/kafka/common/errors/TopicExistsException
> at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> createStream$3.apply(KafkaSystemAdmin.scala:467)
> at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
> createStream$3.apply(KafkaSystemAdmin.scala:465)
> at org.apache.samza.util.ExponentialSleepStrategy.run(
> ExponentialSleepStrategy.scala:89)
> at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
> KafkaSystemAdmin.scala:447)
> at org.apache.samza.job.JobRunner.run(JobRunner.scala:92)
> at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:53)
> at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
> at org.apache.samza.job.JobRunner.main(JobRunner.scala)
> Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
> errors.TopicExistsException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 8 more
>

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Martin Gainty

a strong possibility is that kafka-core is missing as a dependency for samza

please supply samza pom.xml


Martin
__





From: Debraj Manna 
Sent: Friday, June 15, 2018 10:52 AM
To: users@kafka.apache.org
Subject: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 
0.10.0.0

Hi

I have posted the same in d...@samza.apache.org , posting it here also if
anyone is aware.

*I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting
the below exception. Is this related
to https://issues.apache.org/jira/browse/SAMZA-1509
. ? Is samza 0.14.2 not
compatible with 0.10 Kafka ? The same code was working fine with samza
0.12. *

2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session: 0x164031c68f3030a
closed
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/kafka/common/errors/TopicExistsException
at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
createStream$3.apply(KafkaSystemAdmin.scala:467)
at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
createStream$3.apply(KafkaSystemAdmin.scala:465)
at org.apache.samza.util.ExponentialSleepStrategy.run(
ExponentialSleepStrategy.scala:89)
at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
KafkaSystemAdmin.scala:447)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:92)
at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:53)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
at org.apache.samza.job.JobRunner.main(JobRunner.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
errors.TopicExistsException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 8 more

NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

2018-06-15 Thread Debraj Manna

Hi

I have posted the same in d...@samza.apache.org , posting it here also if
anyone is aware.

*I am trying to use samza 0.14.2 with Kafka Client 0.10.0 . I am getting
the below exception. Is this related
to https://issues.apache.org/jira/browse/SAMZA-1509
. ? Is samza 0.14.2 not
compatible with 0.10 Kafka ? The same code was working fine with samza
0.12. *

2018-06-15 13:47:29.228 [main] ZooKeeper [INFO] Session: 0x164031c68f3030a
closed
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/kafka/common/errors/TopicExistsException
at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
createStream$3.apply(KafkaSystemAdmin.scala:467)
at org.apache.samza.system.kafka.KafkaSystemAdmin$$anonfun$
createStream$3.apply(KafkaSystemAdmin.scala:465)
at org.apache.samza.util.ExponentialSleepStrategy.run(
ExponentialSleepStrategy.scala:89)
at org.apache.samza.system.kafka.KafkaSystemAdmin.createStream(
KafkaSystemAdmin.scala:447)
at org.apache.samza.job.JobRunner.run(JobRunner.scala:92)
at org.apache.samza.job.JobRunner$.doOperation(JobRunner.scala:53)
at org.apache.samza.job.JobRunner$.main(JobRunner.scala:48)
at org.apache.samza.job.JobRunner.main(JobRunner.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.kafka.common.
errors.TopicExistsException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 8 more

KafkaMetricsReporter implementing BrokerMetricsReporterMBean not calling stopReporter()

2018-06-15 Thread Ansel Zandegran

Hi,
We have implemented a reporter implementing BrokerMetricsReporterMBean.
We run in embedded mode. Reporters are started using
kafkaMetricsReporters =
  KafkaMetricsReporter$.MODULE$.startReporters(new 
VerifiableProperties(kafkaProperties));
kafkaServer = new KafkaServer(kafkaConfig,
  Time.SYSTEM,
  threadNamePrefix,
  kafkaMetricsReporters);
kafkaServer.startup();

startReporter is getting called but stopReporter() is not getting called during 
kafkaServer.shutdown().
We cannot have shutdown hooks in our environment.
Am I doing something wrong? How do I stop reporters?

Thanks for any advice.

Best regards,
Ansel

SQL Server CDC

2018-06-15 Thread Pranav Shah

Hello,

Good day!!!

I have requirement to capture change of SQL Server; but I don't want to use
SQL Server Replication. I can't use SQL Server CDC because limitation of
SQL Server version.

I know I can achieve using Kafka-Connect API but don't know how to do it.

Would you please do the needful to achieve it?

Thanks,
Pranav

new pom.xml for samza-parent-project

new pom.xml for samza-grid

Flink on Yarn -Connection unexpectedly close dby remote task manager..

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

Re: NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

NoClassDefFoundError TopicExistxException Samza 0.14.2 and Kafka 0.10.0.0

KafkaMetricsReporter implementing BrokerMetricsReporterMBean not calling stopReporter()

SQL Server CDC

10 matches

Site Navigation

Mail list logo

Footer information