Re: Review Request 35723: SAMZA-720: fix bootstrap hangs when container number > 1

2015-06-22 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35723/ --- (Updated June 23, 2015, 4:53 a.m.) Review request for samza. Changes ---

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yan Fang
Hi Yi, This only publishes the artifacts to the staging repository for testing. After completing the vote, you can "release" the artifacts to the public repository by clicking the "release" button. :) Thanks, Fang, Yan yanfang...@gmail.com On Mon, Jun 22, 2015 at 5:30 PM, Yi Pan wrote: > Hi,

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yi Pan
Hi, Yan, Thanks for point out that! Actually I saw that last time and had the following question: should we publish the artifacts after the VOTE is completed or together w/ the VOTE? It seems like that we want to publish the binary artifacts together w/ the VOTE, right? -Yi On Mon, Jun 22, 2015

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yan Fang
Hi Yi Pan, " Is there any document regarding to how to publish the maven staging link? " -- Yes. Check the last part of the https://github.com/apache/samza/blob/master/RELEASE.md . Not sure if you have seen this. I should have pointed it out earlier. *_* Thanks, Fang, Yan yanfang...@gmail.com

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yi Pan
Hi, guys, I am working on the list of things posted by Yan: 1. I have the difficulty in building the 0.9.1 branch. I think this is mainly related to SAMZA-721 . This seems to be an invalid case in 0.9.1. We only need the joint-compilation option i

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yan Fang
HI Naveen, Oh, yeah, you are right. This could be the reason. Will try to clean the git first. Let you know how it goes. Thanks, Fang, Yan yanfang...@gmail.com On Mon, Jun 22, 2015 at 3:02 PM, Naveen Somasundaram < nsomasunda...@linkedin.com.invalid> wrote: > Hey Yan, >SAMZA-72

Re: Deploying samza job to a remote yarn resource manager

2015-06-22 Thread Milinda Pathirage
Hi George, Also have a look at https://samza.apache.org/learn/tutorials/0.9/run-in-multi-node-yarn.html. You may need to install HTTP file system as well. Let us know if you have any questions. Thanks Milinda On Mon, Jun 22, 2015 at 5:56 PM, Navina Ramesh wrote: > Hi George, > > Looks like the

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Naveen Somasundaram
Hey Yan, SAMZA-721 might be because you checkout master and switched to 0.9.1 branch, and you still have some files from master which git is not tracking. Can you try a git clean before you build 0.9.1 ? AFAIK you don't need joint compilation for core in 0.9.1. On Mon, Jun 22, 2015

Re: Deploying samza job to a remote yarn resource manager

2015-06-22 Thread Navina Ramesh
Hi George, Looks like there is a formatting issue on the samza website. The environment variable name should be HADOOP_YARN_HOME. In your case, it should point to hadoop home: $HOME/hadoop-2.6.0/ Please let me know if it works. Cheers! Navina On 6/22/15, 2:11 PM, "George Li" wrote: >Hi, > >Ac

Re: 3 processed message per incoming message

2015-06-22 Thread Shekar Tippur
Looks like when I kill an application ID, the next application ID in the pending queue takes over. As there are 2 running jobs, I see that for every in coming event, there are 2 outputs. a. How do I force to have just 1 running job b. How to force the number of application pending to a smaller numb

Deploying samza job to a remote yarn resource manager

2015-06-22 Thread George Li
Hi, According to https://samza.apache.org/learn/documentation/0.9/jobs/yarn-jobs.html , to deploy samza jobs to a remote yarn resource manager, I need to set the HADOOPYARNHOME environment variable. What should be the value of this variable if my yarn-site.xml is at $HOME/hadoop-2.6.0/etc/had

Re: 3 processed message per incoming message

2015-06-22 Thread Shekar Tippur
Yan, As suggested, I killed one of the application id's but looks like it respawns another one. Guessing I need to kill the application master and restart it? Cluster MetricsApps SubmittedApps PendingApps RunningApps CompletedContainers RunningMemory UsedMemory TotalMemory ReservedVCores UsedVCor

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Roger Hoover
Yan, I tested to patch locally and it looks good. Creating a patched release for myself to test in our environment. Thanks, again. Sent from my iPhone > On Jun 22, 2015, at 10:59 AM, Yi Pan wrote: > > Hi, Yan, > > Thanks a lot for the quick fix on the mentioned bugs. It seems the fix for >

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Jakob Homan
Good timing everybody, and very good work, Roger and Yan. Let's go ahead and cancel this vote, get SAMZA-720 in and roll a new RC. -jg On 22 June 2015 at 10:59, Yi Pan wrote: > Hi, Yan, > > Thanks a lot for the quick fix on the mentioned bugs. It seems the fix for > SAMZA-720 is pretty localize

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yi Pan
Hi, Yan, Thanks a lot for the quick fix on the mentioned bugs. It seems the fix for SAMZA-720 is pretty localized and I am OK to push it into 0.9.1. I will be working on back porting those changes to 0.9.1 later today and fix all the release related issues. Thanks! -Yi On Mon, Jun 22, 2015 at 1

Re: Review Request 35723: SAMZA-720: fix bootstrap hangs when container number > 1

2015-06-22 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35723/#review88820 --- Ship it! +1. LGTM. Thanks for the quick fix, Yan. - Yi Pan (Data I

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Roger Hoover
Yan, You rock. Thank you so much for the quick fix. I'm working on building and testing the patch. Cheers, Roger On Mon, Jun 22, 2015 at 1:09 AM, Yan Fang wrote: > Hi guys, > > 1. I have the difficulty in building the 0.9.1 branch. I think this is > mainly related to SAMZA-721 >

Re: [VOTE] Apache Samza 0.9.1 RC0

2015-06-22 Thread Yan Fang
Hi guys, 1. I have the difficulty in building the 0.9.1 branch. I think this is mainly related to SAMZA-721 . 2. Also, https://issues.apache.org/jira/browse/SAMZA-712 seems bothering people as well. 3. https://issues.apache.org/jira/browse/SAMZA-7

Review Request 35723: SAMZA-720: fix bootstrap hangs when container number > 1

2015-06-22 Thread Yan Fang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35723/ --- Review request for samza. Bugs: SAMZA-720 https://issues.apache.org/jira/br