Review Request 35723: SAMZA-720: fix bootstrap hangs when container number > 1

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35723/ --- Review request for samza. Bugs: SAMZA-720 https://issues.apache.org/jira/br

Re: [VOTE] Apache Samza 0.9.1 RC0

Hi guys, 1. I have the difficulty in building the 0.9.1 branch. I think this is mainly related to SAMZA-721 . 2. Also, https://issues.apache.org/jira/browse/SAMZA-712 seems bothering people as well. 3. https://issues.apache.org/jira/browse/SAMZA-7

Re: [VOTE] Apache Samza 0.9.1 RC0

Yan, You rock. Thank you so much for the quick fix. I'm working on building and testing the patch. Cheers, Roger On Mon, Jun 22, 2015 at 1:09 AM, Yan Fang wrote: > Hi guys, > > 1. I have the difficulty in building the 0.9.1 branch. I think this is > mainly related to SAMZA-721 >

Re: Review Request 35723: SAMZA-720: fix bootstrap hangs when container number > 1

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35723/#review88820 --- Ship it! +1. LGTM. Thanks for the quick fix, Yan. - Yi Pan (Data I

Re: [VOTE] Apache Samza 0.9.1 RC0

Hi, Yan, Thanks a lot for the quick fix on the mentioned bugs. It seems the fix for SAMZA-720 is pretty localized and I am OK to push it into 0.9.1. I will be working on back porting those changes to 0.9.1 later today and fix all the release related issues. Thanks! -Yi On Mon, Jun 22, 2015 at 1

Re: [VOTE] Apache Samza 0.9.1 RC0

Good timing everybody, and very good work, Roger and Yan. Let's go ahead and cancel this vote, get SAMZA-720 in and roll a new RC. -jg On 22 June 2015 at 10:59, Yi Pan wrote: > Hi, Yan, > > Thanks a lot for the quick fix on the mentioned bugs. It seems the fix for > SAMZA-720 is pretty localize

Re: [VOTE] Apache Samza 0.9.1 RC0

Yan, I tested to patch locally and it looks good. Creating a patched release for myself to test in our environment. Thanks, again. Sent from my iPhone > On Jun 22, 2015, at 10:59 AM, Yi Pan wrote: > > Hi, Yan, > > Thanks a lot for the quick fix on the mentioned bugs. It seems the fix for >

Re: 3 processed message per incoming message

Yan, As suggested, I killed one of the application id's but looks like it respawns another one. Guessing I need to kill the application master and restart it? Cluster MetricsApps SubmittedApps PendingApps RunningApps CompletedContainers RunningMemory UsedMemory TotalMemory ReservedVCores UsedVCor

Deploying samza job to a remote yarn resource manager

Hi, According to https://samza.apache.org/learn/documentation/0.9/jobs/yarn-jobs.html , to deploy samza jobs to a remote yarn resource manager, I need to set the HADOOPYARNHOME environment variable. What should be the value of this variable if my yarn-site.xml is at $HOME/hadoop-2.6.0/etc/had

Re: 3 processed message per incoming message

Looks like when I kill an application ID, the next application ID in the pending queue takes over. As there are 2 running jobs, I see that for every in coming event, there are 2 outputs. a. How do I force to have just 1 running job b. How to force the number of application pending to a smaller numb

Re: Deploying samza job to a remote yarn resource manager

Hi George, Looks like there is a formatting issue on the samza website. The environment variable name should be HADOOP_YARN_HOME. In your case, it should point to hadoop home: $HOME/hadoop-2.6.0/ Please let me know if it works. Cheers! Navina On 6/22/15, 2:11 PM, "George Li" wrote: >Hi, > >Ac

Re: [VOTE] Apache Samza 0.9.1 RC0

Hey Yan, SAMZA-721 might be because you checkout master and switched to 0.9.1 branch, and you still have some files from master which git is not tracking. Can you try a git clean before you build 0.9.1 ? AFAIK you don't need joint compilation for core in 0.9.1. On Mon, Jun 22, 2015

Re: Deploying samza job to a remote yarn resource manager

Hi George, Also have a look at https://samza.apache.org/learn/tutorials/0.9/run-in-multi-node-yarn.html. You may need to install HTTP file system as well. Let us know if you have any questions. Thanks Milinda On Mon, Jun 22, 2015 at 5:56 PM, Navina Ramesh wrote: > Hi George, > > Looks like the

Re: [VOTE] Apache Samza 0.9.1 RC0

HI Naveen, Oh, yeah, you are right. This could be the reason. Will try to clean the git first. Let you know how it goes. Thanks, Fang, Yan yanfang...@gmail.com On Mon, Jun 22, 2015 at 3:02 PM, Naveen Somasundaram < nsomasunda...@linkedin.com.invalid> wrote: > Hey Yan, >SAMZA-72

Re: [VOTE] Apache Samza 0.9.1 RC0

Hi, guys, I am working on the list of things posted by Yan: 1. I have the difficulty in building the 0.9.1 branch. I think this is mainly related to SAMZA-721 . This seems to be an invalid case in 0.9.1. We only need the joint-compilation option i

Re: [VOTE] Apache Samza 0.9.1 RC0

Hi Yi Pan, " Is there any document regarding to how to publish the maven staging link? " -- Yes. Check the last part of the https://github.com/apache/samza/blob/master/RELEASE.md . Not sure if you have seen this. I should have pointed it out earlier. *_* Thanks, Fang, Yan yanfang...@gmail.com

Re: [VOTE] Apache Samza 0.9.1 RC0

Hi, Yan, Thanks for point out that! Actually I saw that last time and had the following question: should we publish the artifacts after the VOTE is completed or together w/ the VOTE? It seems like that we want to publish the binary artifacts together w/ the VOTE, right? -Yi On Mon, Jun 22, 2015

Re: [VOTE] Apache Samza 0.9.1 RC0

Hi Yi, This only publishes the artifacts to the staging repository for testing. After completing the vote, you can "release" the artifacts to the public repository by clicking the "release" button. :) Thanks, Fang, Yan yanfang...@gmail.com On Mon, Jun 22, 2015 at 5:30 PM, Yi Pan wrote: > Hi,

Re: Review Request 35723: SAMZA-720: fix bootstrap hangs when container number > 1

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35723/ --- (Updated June 23, 2015, 4:53 a.m.) Review request for samza. Changes ---