Re: Hadoop QA failed to build in branch-1 & branch-1.3

2017-05-27 Thread Dima Spivak
Oops, gotcha. Should have scrolled further below the checking out of the master branch; I see further below that it was the 1.3 job. Is there a JIRA to address the JDK package not being available, Sean? Any reason we insist upon using Oracle for these runs instead of the OpenJDK equivalent? On Sa

Re: What is Dead Region Servers and how to clear them up?

2017-05-27 Thread Ted Yu
The involvement of Yarn can explain why you observed relatively more dead servers (compared to traditional deployment). Suppose in first run, Yarn allocates containers for region servers on a set of nodes. Subsequently, Yarn may choose nodes (for the same number of servers) which are not exactly t

Re: Hadoop QA failed to build in branch-1 & branch-1.3

2017-05-27 Thread Sean Busbey
Also, this is specifically when the per-branch docker image is attempting to install the jdk(s) that are appropriate for the given branch. like branch-1 that is mentioned above is here: https://github.com/apache/hbase/blob/branch-1/dev-support/docker/Dockerfile On Sat, May 27, 2017 at 2:10 PM, S

Re: Hadoop QA failed to build in branch-1 & branch-1.3

2017-05-27 Thread Sean Busbey
Dima, the issue pointed out above is specific to the branch-1* branches that do support java 7. the master branch already doesn't do any java 7, which is why the failures don't happen on it. On Sat, May 27, 2017 at 11:58 AM, Dima Spivak wrote: > Hey there, > > The master branch actually doesn't s

Re: What is Dead Region Servers and how to clear them up?

2017-05-27 Thread jeff saremi
Yes. we don't have fixed servers with the exceptions of ZK machines. We have 3 yarn jobs one for each of master, region, and thrift servers each launched separately with different number of nodes. I hope that's not what is causing problems. From: Ted Yu Sent: S

Re: What is Dead Region Servers and how to clear them up?

2017-05-27 Thread Ted Yu
Jeff: bq. We run our cluster on Yarn and upon restarting jobs in Yarn Can you clarify a bit more - are you running hbase processes inside Yarn container ? Cheers On Sat, May 27, 2017 at 10:58 AM, jeff saremi wrote: > Thanks @Yu Li > > You are absolutely correct. Dead R

Re: What is Dead Region Servers and how to clear them up?

2017-05-27 Thread jeff saremi
Thanks @Yu Li You are absolutely correct. Dead RS's will happen regardless. My issue with this is more "psychological". If I have done everything needed to be done to ensure that RSs are running fine and regions are assigned and such and hbck reports are consistent then

Re: Hadoop QA failed to build in branch-1 & branch-1.3

2017-05-27 Thread Dima Spivak
Hey there, The master branch actually doesn't support Java 7 at all, so we should remove that; good catch. Would you mind opening a JIRA for the issue and one of the members of the team with Jenkins access can address it? On Sat, May 27, 2017 at 3:18 AM OpenInx wrote: > Hi Guys > > Seems like w

Hadoop QA failed to build in branch-1 & branch-1.3

2017-05-27 Thread OpenInx
Hi Guys Seems like we always fail to install jdk7 for Hadoop QA currently. ( RUN apt-get -q update && apt-get -q install -y oracle-java7-installer failed) I'm not familiar with Hadoop QA environment, Could anyone help to (or tell how to) fix it ? 1. https://builds.apache.org/job/PreCommit-HB