Re: 3 processed message per incoming message

2015-06-15 Thread Yan Fang
Hi Shekar, a. How do I detect it? -- You can go to Yarn's monitoring page, usually, localhost:8088. May see what are running. b. How do I kill redundant jobs? -- Just like what you do for any Yarn jobs. *yarn application -kill applicationId* . If you are using the similar structure as the hello-s

3 processed message per incoming message

2015-06-15 Thread Shekar Tippur
Hello, I have a scenario where for each incoming message, I see 3 corresponding processed message. I am suspecting that I may have submitted the same job multiple number of times to Yarn. If this is the case, a. How do I detect it b. How do I kill redundant jobs? Could there be other reasons for

Re: Review Request 35067: SAMZA-546: Add config option max.in.flight.requests.per.connection

2015-06-15 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35067/#review87963 --- @Robert: Can you please add a unit test in TestKafkaConfig to veri

Re: Review Request 35067: SAMZA-546: Add config option max.in.flight.requests.per.connection

2015-06-15 Thread Navina Ramesh
> On June 8, 2015, 2:29 a.m., Navina Ramesh wrote: > > samza-kafka/src/main/scala/org/apache/samza/config/KafkaConfig.scala, line > > 182 > > > > > > This warning is valid only when the configured value for > > max.i

Re: Review Request 35067: SAMZA-546: Add config option max.in.flight.requests.per.connection

2015-06-15 Thread Navina Ramesh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35067/#review87952 --- Ship it! Ship It! - Navina Ramesh On June 15, 2015, 1:42 p.m., R

Re: Combine two web servlets in the AM?

2015-06-15 Thread Yan Fang
Thanks, Navina. Those two classes have been there for a while. So I think this is not really related to JobCoordinator/CoordinatorStream. Will just create a separate ticket for this. Of course, we can finish it within SAMZA-614. Cheers, Fang, Yan yanfang...@gmail.com On Mon, Jun 15, 2015 at 11:3

Re: Combine two web servlets in the AM?

2015-06-15 Thread Navina Ramesh
+1 for adding to the documentation. I didn¹t know about this difference. This information is perhaps part of the JobCoordinator/CoordinatorStream documentation - SAMZA-614? On 6/15/15, 11:27 AM, "Yan Fang" wrote: >All right. Sorry for bothering. I figured it >out. ApplicationMasterRestServlet is

Re: Combine two web servlets in the AM?

2015-06-15 Thread Yan Fang
All right. Sorry for bothering. I figured it out. ApplicationMasterRestServlet is for the RPC and ApplicationMasterWebServlet is for tracking. The AM dashboard is from the tracking url, not he RPC url. Maybe we should mention the RPC url in the doc as well, since not many people realize this. Fang

Re: Review Request 35067: SAMZA-546: Add config option max.in.flight.requests.per.connection

2015-06-15 Thread Robert Zuljevic
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35067/ --- (Updated June 15, 2015, 1:42 p.m.) Review request for samza. Repository: samz

Re: Review Request 35071: SAMZA-572 SamzaContainer checkpoints and windows immediately on startup

2015-06-15 Thread József Márton Jung
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35071/ --- (Updated June 15, 2015, noon) Review request for samza. Repository: samza D

Re: Review Request 35067: SAMZA-546: Add config option max.in.flight.requests.per.connection

2015-06-15 Thread Robert Zuljevic
> On June 8, 2015, 2:29 a.m., Navina Ramesh wrote: > > samza-kafka/src/main/scala/org/apache/samza/config/KafkaConfig.scala, line > > 182 > > > > > > This warning is valid only when the configured value for > > max.i