Jenkins build is back to normal : Hadoop-common-trunk-Java8 #818

[Apache Jenkins Server]

See 

Build failed in Jenkins: Hadoop-common-trunk-Java8 #819

[Apache Jenkins Server]

See 

Changes:

[cnauroth] HDFS-9557. Reduce object allocation in PB conversion. Contributed by

[sseth] YARN-4207. Add a non-judgemental YARN app completion status. Contributed

--
[...truncated 5805 lines...]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.883 sec - in 
org.apache.hadoop.io.TestSequenceFileSync
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.retry.TestFailoverProxy
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.291 sec - in 
org.apache.hadoop.io.retry.TestFailoverProxy
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.retry.TestDefaultRetryPolicy
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.434 sec - in 
org.apache.hadoop.io.retry.TestDefaultRetryPolicy
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.retry.TestRetryProxy
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.289 sec - in 
org.apache.hadoop.io.retry.TestRetryProxy
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestDefaultStringifier
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.469 sec - in 
org.apache.hadoop.io.TestDefaultStringifier
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestBloomMapFile
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.704 sec - in 
org.apache.hadoop.io.TestBloomMapFile
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestBytesWritable
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.25 sec - in 
org.apache.hadoop.io.TestBytesWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestDummyRawCoder
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.096 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestDummyRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestXORRawCoder
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.196 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestXORRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.rawcoder.TestRSRawCoder
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.398 sec - in 
org.apache.hadoop.io.erasurecode.rawcoder.TestRSRawCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.TestECSchema
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.089 sec - in 
org.apache.hadoop.io.erasurecode.TestECSchema
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.coder.TestXORCoder
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.312 sec - in 
org.apache.hadoop.io.erasurecode.coder.TestXORCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.erasurecode.coder.TestRSErasureCoder
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.153 sec - in 
org.apache.hadoop.io.erasurecode.coder.TestRSErasureCoder
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestWritableUtils
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.178 sec - in 
org.apache.hadoop.io.TestWritableUtils
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestBooleanWritable
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec - in 
org.apache.hadoop.io.TestBooleanWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestDataByteBuffers
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.409 sec - in 
org.apache.hadoop.io.TestDataByteBuffers
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestVersionedWritable
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.181 sec - in 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Vinod Kumar Vavilapalli]

So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.

Are we still doing that? What are the RC0.1 and RC1 tags doing then?

+Vinod

> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
> 
> Thanks Akira for notice this. I don't think we can remove these tags as they 
> should be immutable as branches. I created these duplicated tags as after I 
> cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I 
> could still push to original tag by forcefully. The best thing I can do then 
> is to make them point to the same commit as now it is.
> 
> Thanks,
> 
> Junping
> 
> From: Akira AJISAKA 
> Sent: Wednesday, December 16, 2015 6:41 AM
> To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; 
> mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> 
> Thanks Junping for starting release process.
> I noticed there are duplicated tags:
> 
> * release-2.6.3-RC0
> * release-2.6.3-RC0.1
> * release-2.6.3-RC1
> 
> Could you remove RC0.1 and RC1?
> 
> Regards,
> Akira
> 
> On 12/16/15 10:17, yliu wrote:
>> Thanks Junping, +1.
>> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
>> basic functionalities.
>> 
>> Regards,
>> Yi Liu
>> 
>> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>> 
>>> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
>>> built locally. Ran some MR jobs successfully.
>>> 
>>> Best,
>>> Chang
>>> 
>>> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
>>> 
 Thanks Junping,
 
 +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
 both successfully finished.
 
 Regards,
 Wangda
 
 
 On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
 naganarasimha...@gmail.com> wrote:
 
> Hi Junping,
> 
> +0 (non binding)
> 
> Though everything else is working  fine (downloaded the tar ball and
> installed single node cluster setup and  verified  few MR jobs),
> submission of Unmanaged AM is getting the RM down. YARN-4452 has
> already been raised and i am working on it. Will provide the patch for
> the trunk and the 2.6.3 version asap
> 
> Regards,
> 
> + Naga
> 
> 
> 
> Thanks for the work Junping! Downloaded the src tarball. Built locally
> and successfully ran
> in single node mode with a few map reduce jobs. LGTM.
> 
> Li Lu
> 
> On Dec 14, 2015, at 04:23, Junping Du
> >
> wrote:
> 
> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
> issue and download
> should work now. Please try to download it again. Thanks!
> 
> 
> Thanks,
> 
> 
> Junping
> 
> 
> 
> From: sarjeet singh >
> Sent: Sunday, December 13, 2015 6:44 PM
> To: common-dev@hadoop.apache.org
> Cc: mapreduce-...@hadoop.apache.org>>> mapreduce-...@hadoop.apache.org
>> ;
> hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org;
> junping...@apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> 
> I am also getting the same error when downloading tar.gz:
> 
> "You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server."
> 
> - Sarjeet Singh
> 
> On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
> >
> wrote:
> Hi Junping,
> 
> Thank you for starting the voting.
> I cannot access the tar.gz file because of permission error. Could you
> check the permission to access the files?
> 
> Forbidden
> You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server.
> 
> Thanks,
> - Tsuyoshi
> 
> On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
>  j...@hortonworks.com>>
> wrote:
> 
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
> next maintenance release
> to follow up 2.6.2.) according to email thread of release plan 2.6.3
> [1]. Sorry for this RC
> coming a bit late as several blocker issues were getting committed
> until yesterday. Below
> is the details:
> 
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Varun Saxena]

+1 (non-binding)

- Downloaded the source and built locally.
- Set up a 2 node cluster.
- Ran a few mapreduce jobs successfully.

Regards,
Varun Saxena.

On Thu, Dec 17, 2015 at 12:06 AM, Tsuyoshi Ozawa  wrote:

> +1 (binding)
>
> - verified checksums
> - built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran
> tests and all of them passed.
>
> Thanks,
> - Tsuyoshi
>
> On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee  wrote:
> > +1 (non-binding)
> >
> > - downloaded source and binary and verified the signatures (although I
> > didn't connect with Junping via web of trust)
> > - started a pseudo-distributed cluster and ran test jobs
> > - browsed the RM and NN UI
> > - looked through the daemon logs
> >
> > Thanks Junping.
> >
> > Sangjin
> >
> > On Wed, Dec 16, 2015 at 5:11 AM, Brahma Reddy Battula <
> > brahmareddy.batt...@huawei.com> wrote:
> >
> >> +1 (non-binding)
> >>
> >> -- Downloaded both source and binary tarballs successfully.
> >> --Set up a pseudo-distributed cluster and Distributed HA Cluster
> >> --Ran Several jobs Slive,Terasort and pi.
> >> --All are working fine.
> >>
> >>
> >> Thanks & Regards
> >>  Brahma Reddy Battula
> >> 
> >> From: Steve Loughran [ste...@hortonworks.com]
> >> Sent: Wednesday, December 16, 2015 5:58 PM
> >> To: mapreduce-...@hadoop.apache.org
> >> Cc: Hadoop Common; hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org;
> >> junping...@apache.org
> >> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
> >>
> >> +1, binding
> >>
> >>
> >> Did a build and test with slider with the build set to
> >> -Dhadoop.version=2.6.3
> >>
> >> this does a D/L and test from the staging repo. All artifacts were
> >> located, and the tests completed
> >>
> >> > On 12 Dec 2015, at 00:16, Junping Du  wrote:
> >> >
> >> >
> >> > Hi all developers in hadoop community,
> >> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
> next
> >> maintenance release to follow up 2.6.2.) according to email thread of
> >> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several
> >> blocker issues were getting committed until yesterday. Below is the
> details:
> >> >
> >> > The RC is available for validation at:
> >> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> >> > *
> >> >
> >> > The RC tag in git is: release-2.6.3-RC0
> >> >
> >> > The maven artifacts are staged via repository.apache.org at:
> >> > *
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> >> > <
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/>*
> >> >
> >> > You can find my public key at:
> >> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >> >
> >> > Please try the release and vote. The vote will run for the usual 5
> days.
> >> >
> >> > Thanks and happy weekend!
> >> >
> >> >
> >> > Cheers,
> >> >
> >> > Junping
> >> >
> >> >
> >> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> >> >
> >>
> >>
>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Tsuyoshi Ozawa]

+1 (binding)

- verified checksums
- built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran
tests and all of them passed.

Thanks,
- Tsuyoshi

On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee  wrote:
> +1 (non-binding)
>
> - downloaded source and binary and verified the signatures (although I
> didn't connect with Junping via web of trust)
> - started a pseudo-distributed cluster and ran test jobs
> - browsed the RM and NN UI
> - looked through the daemon logs
>
> Thanks Junping.
>
> Sangjin
>
> On Wed, Dec 16, 2015 at 5:11 AM, Brahma Reddy Battula <
> brahmareddy.batt...@huawei.com> wrote:
>
>> +1 (non-binding)
>>
>> -- Downloaded both source and binary tarballs successfully.
>> --Set up a pseudo-distributed cluster and Distributed HA Cluster
>> --Ran Several jobs Slive,Terasort and pi.
>> --All are working fine.
>>
>>
>> Thanks & Regards
>>  Brahma Reddy Battula
>> 
>> From: Steve Loughran [ste...@hortonworks.com]
>> Sent: Wednesday, December 16, 2015 5:58 PM
>> To: mapreduce-...@hadoop.apache.org
>> Cc: Hadoop Common; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
>> junping...@apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>>
>> +1, binding
>>
>>
>> Did a build and test with slider with the build set to
>> -Dhadoop.version=2.6.3
>>
>> this does a D/L and test from the staging repo. All artifacts were
>> located, and the tests completed
>>
>> > On 12 Dec 2015, at 00:16, Junping Du  wrote:
>> >
>> >
>> > Hi all developers in hadoop community,
>> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next
>> maintenance release to follow up 2.6.2.) according to email thread of
>> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several
>> blocker issues were getting committed until yesterday. Below is the details:
>> >
>> > The RC is available for validation at:
>> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
>> > *
>> >
>> > The RC tag in git is: release-2.6.3-RC0
>> >
>> > The maven artifacts are staged via repository.apache.org at:
>> > *
>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
>> > <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/>*
>> >
>> > You can find my public key at:
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> > Please try the release and vote. The vote will run for the usual 5 days.
>> >
>> > Thanks and happy weekend!
>> >
>> >
>> > Cheers,
>> >
>> > Junping
>> >
>> >
>> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>> >
>>
>>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Mingliang Liu]

+1 (non-binding)

1. Download the pre-built tar and check the validity
2. Configure and start a pseudo-distributed cluster
3. Run example grep MapReduce job locally
4. Operate the HDFS copying files from/to local directory
5. Check execution logs

All good. Thanks.

L

> On Dec 11, 2015, at 4:16 PM, Junping Du  wrote:
> 
> 
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
> 
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> *
> 
> The RC tag in git is: release-2.6.3-RC0
> 
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> *
> 
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> 
> Please try the release and vote. The vote will run for the usual 5 days.
> 
> Thanks and happy weekend!
> 
> 
> Cheers,
> 
> Junping
> 
> 
> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> 

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Vinod Kumar Vavilapalli]

Per our discussion on JIRA and here, I was okay with this backport.

I want to get back to the RC quickly now, so went ahead and pulled the patch 
into 2.7.2 myself.

Thanks
+Vinod

> On Dec 10, 2015, at 4:06 PM, Konstantin Boudnik  wrote:
> 
> Vinod, are you Ok with me putting it into 2.7.2?
> 
> Cos
> 
> On Mon, Nov 30, 2015 at 01:25PM, Vinod Kumar Vavilapalli wrote:
>> I think we should get it in, I am still stuck on a couple of HDFS patches.
>> 
>> But I was not sure overall if the patch was right. Commented on the JIRA 
>> regarding the same.
>> 
>> Thanks
>> +Vinod
>> 
>>> On Nov 27, 2015, at 1:54 AM, Steve Loughran  wrote:
>>> 
>>> well, I'm not going to block it...it doesn't add anything more to the pom 
>>> dependencies that aren't there right now
>>> 
 On 26 Nov 2015, at 18:51, Konstantin Boudnik  wrote:
 
 On Wed, Nov 25, 2015 at 01:51PM, Steve Loughran wrote:
> 
>> On 25 Nov 2015, at 02:48, Konstantin Boudnik  wrote:
>> 
>> Vinod, hopefully it isn't too late for a quick fix to be included into 
>> 2.7.2
>> (sorry for jumping too late on this train). The JIRA in question is
>> HADOOP-12415 and I have committed it to trunk and branch-2 already.
>> 
>> Please let me know if this is still Ok to add into 2.7.2 as it seems to 
>> be
>> going through a respin. Thanks in advance,
>> 
>> Cos
>> 
> 
> 
> can you hold it off until 2.7.3? 2.7.2 was tested and we shoudn't be 
> making
> more changes now, even if its just to the POMs
 
 It's up to you guys, the fix is small but pretty critical IMO. The change 
 in
 question is literally breaking the build from the get go. In Bigtop we had 
 to
 patch 2.7.1 so we at least can build it into the stack. 
 
 For the users using official release tarball it won't simply work unless 
 they
 are going to patch it themselves.
 
 Cos
>>> 
>>> 
>> 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Vinod Kumar Vavilapalli]

+1 (binding) for the RC except for my question below about the tag.

I checked 2.6.3-RC0, based on my check-list:

- Signatures and message digests all are good in general.
- The top level full LICENSE, NOTICE and README for the source artifacts are 
good - CHANGES.txt for common, hdfs and mapped are correctly located.
- Able to build the tars out of the source tar ball using JDK 7. (Don’t have a 
JDK 6 at hand)

Testing: All testing on single node, unsecured, default mode.

- Started HDFS daemons successfully , created directories.
- Successfully started YARN daemons - ResourceManager, NodeManager and Timeline 
Service
- Successfully started MapReduce history server.
- Ran DistributedShell as a native YARN app.
- Ran wordcount, pi, random writer, sort, grep and they all pass just fine.
- Navigated through the RM, NM and Timeline UIs to make sure the views are 
working well.
- Navigated through the MapReduce UI to make sure the views are working well.

Thanks,
+Vinod


> On Dec 16, 2015, at 11:32 AM, Vinod Kumar Vavilapalli  
> wrote:
> 
> So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.
> 
> Are we still doing that? What are the RC0.1 and RC1 tags doing then?
> 
> +Vinod
> 
>> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
>> 
>> Thanks Akira for notice this. I don't think we can remove these tags as they 
>> should be immutable as branches. I created these duplicated tags as after I 
>> cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize 
>> I could still push to original tag by forcefully. The best thing I can do 
>> then is to make them point to the same commit as now it is.
>> 
>> Thanks,
>> 
>> Junping
>> 
>> From: Akira AJISAKA 
>> Sent: Wednesday, December 16, 2015 6:41 AM
>> To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; 
>> mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>> 
>> Thanks Junping for starting release process.
>> I noticed there are duplicated tags:
>> 
>> * release-2.6.3-RC0
>> * release-2.6.3-RC0.1
>> * release-2.6.3-RC1
>> 
>> Could you remove RC0.1 and RC1?
>> 
>> Regards,
>> Akira
>> 
>> On 12/16/15 10:17, yliu wrote:
>>> Thanks Junping, +1.
>>> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
>>> basic functionalities.
>>> 
>>> Regards,
>>> Yi Liu
>>> 
>>> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>>> 
 Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
 built locally. Ran some MR jobs successfully.
 
 Best,
 Chang
 
 On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
 
> Thanks Junping,
> 
> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
> both successfully finished.
> 
> Regards,
> Wangda
> 
> 
> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
> naganarasimha...@gmail.com> wrote:
> 
>> Hi Junping,
>> 
>> +0 (non binding)
>> 
>> Though everything else is working  fine (downloaded the tar ball and
>> installed single node cluster setup and  verified  few MR jobs),
>> submission of Unmanaged AM is getting the RM down. YARN-4452 has
>> already been raised and i am working on it. Will provide the patch for
>> the trunk and the 2.6.3 version asap
>> 
>> Regards,
>> 
>> + Naga
>> 
>> 
>> 
>> Thanks for the work Junping! Downloaded the src tarball. Built locally
>> and successfully ran
>> in single node mode with a few map reduce jobs. LGTM.
>> 
>> Li Lu
>> 
>> On Dec 14, 2015, at 04:23, Junping Du
>> >
>> wrote:
>> 
>> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
>> issue and download
>> should work now. Please try to download it again. Thanks!
>> 
>> 
>> Thanks,
>> 
>> 
>> Junping
>> 
>> 
>> 
>> From: sarjeet singh >
>> Sent: Sunday, December 13, 2015 6:44 PM
>> To: common-dev@hadoop.apache.org
>> Cc: mapreduce-...@hadoop.apache.org mapreduce-...@hadoop.apache.org
>>> ;
>> hdfs-...@hadoop.apache.org;
>> yarn-...@hadoop.apache.org;
>> junping...@apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>> 
>> I am also getting the same error when downloading tar.gz:
>> 
>> "You don't have permission to access
>> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
>> on this server."
>> 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Jason Lowe]

+1 (binding)
- Verified signatures and digests- Successfully built from source with native 
code support- Deployed to a single-node cluster and ran some test jobs
Jason

  From: Junping Du 
 To: Hadoop Common ; "hdfs-...@hadoop.apache.org" 
; "mapreduce-...@hadoop.apache.org" 
; "yarn-...@hadoop.apache.org" 
 
Cc: "junping...@apache.org" 
 Sent: Friday, December 11, 2015 6:16 PM
 Subject: [VOTE] Release Apache Hadoop 2.6.3 RC0
   

Hi all developers in hadoop community,
  I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
maintenance release to follow up 2.6.2.) according to email thread of release 
plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
were getting committed until yesterday. Below is the details:

The RC is available for validation at:
*http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
*

The RC tag in git is: release-2.6.3-RC0

The maven artifacts are staged via repository.apache.org at:
*https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
*

You can find my public key at:
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS

Please try the release and vote. The vote will run for the usual 5 days.

Thanks and happy weekend!


Cheers,

Junping


[1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y


 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Jian He]

+1,

Build and deploy the cluster from source code.
Ran a few example jobs and passed successfully. 

Jian

> On Dec 16, 2015, at 2:19 PM, Vinod Kumar Vavilapalli  
> wrote:
> 
> +1 (binding) for the RC except for my question below about the tag.
> 
> I checked 2.6.3-RC0, based on my check-list:
> 
> - Signatures and message digests all are good in general.
> - The top level full LICENSE, NOTICE and README for the source artifacts are 
> good - CHANGES.txt for common, hdfs and mapped are correctly located.
> - Able to build the tars out of the source tar ball using JDK 7. (Don’t have 
> a JDK 6 at hand)
> 
> Testing: All testing on single node, unsecured, default mode.
> 
> - Started HDFS daemons successfully , created directories.
> - Successfully started YARN daemons - ResourceManager, NodeManager and 
> Timeline Service
> - Successfully started MapReduce history server.
> - Ran DistributedShell as a native YARN app.
> - Ran wordcount, pi, random writer, sort, grep and they all pass just fine.
> - Navigated through the RM, NM and Timeline UIs to make sure the views are 
> working well.
> - Navigated through the MapReduce UI to make sure the views are working well.
> 
> Thanks,
> +Vinod
> 
> 
>> On Dec 16, 2015, at 11:32 AM, Vinod Kumar Vavilapalli  
>> wrote:
>> 
>> So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.
>> 
>> Are we still doing that? What are the RC0.1 and RC1 tags doing then?
>> 
>> +Vinod
>> 
>>> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
>>> 
>>> Thanks Akira for notice this. I don't think we can remove these tags as 
>>> they should be immutable as branches. I created these duplicated tags as 
>>> after I cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't 
>>> realize I could still push to original tag by forcefully. The best thing I 
>>> can do then is to make them point to the same commit as now it is.
>>> 
>>> Thanks,
>>> 
>>> Junping
>>> 
>>> From: Akira AJISAKA 
>>> Sent: Wednesday, December 16, 2015 6:41 AM
>>> To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; 
>>> mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>>> 
>>> Thanks Junping for starting release process.
>>> I noticed there are duplicated tags:
>>> 
>>> * release-2.6.3-RC0
>>> * release-2.6.3-RC0.1
>>> * release-2.6.3-RC1
>>> 
>>> Could you remove RC0.1 and RC1?
>>> 
>>> Regards,
>>> Akira
>>> 
>>> On 12/16/15 10:17, yliu wrote:
 Thanks Junping, +1.
 Download the tarball and deploy a small HDFS/YARN cluster, and verify few
 basic functionalities.
 
 Regards,
 Yi Liu
 
 On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
 
> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
> built locally. Ran some MR jobs successfully.
> 
> Best,
> Chang
> 
> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
> 
>> Thanks Junping,
>> 
>> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
>> both successfully finished.
>> 
>> Regards,
>> Wangda
>> 
>> 
>> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
>> naganarasimha...@gmail.com> wrote:
>> 
>>> Hi Junping,
>>> 
>>> +0 (non binding)
>>> 
>>> Though everything else is working  fine (downloaded the tar ball and
>>> installed single node cluster setup and  verified  few MR jobs),
>>> submission of Unmanaged AM is getting the RM down. YARN-4452 has
>>> already been raised and i am working on it. Will provide the patch for
>>> the trunk and the 2.6.3 version asap
>>> 
>>> Regards,
>>> 
>>> + Naga
>>> 
>>> 
>>> 
>>> Thanks for the work Junping! Downloaded the src tarball. Built locally
>>> and successfully ran
>>> in single node mode with a few map reduce jobs. LGTM.
>>> 
>>> Li Lu
>>> 
>>> On Dec 14, 2015, at 04:23, Junping Du
>>> >
>>> wrote:
>>> 
>>> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
>>> issue and download
>>> should work now. Please try to download it again. Thanks!
>>> 
>>> 
>>> Thanks,
>>> 
>>> 
>>> Junping
>>> 
>>> 
>>> 
>>> From: sarjeet singh >
>>> Sent: Sunday, December 13, 2015 6:44 PM
>>> To: common-dev@hadoop.apache.org
>>> Cc: mapreduce-...@hadoop.apache.org> mapreduce-...@hadoop.apache.org
 ;
>>> hdfs-...@hadoop.apache.org;
>>> 

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Vinod Kumar Vavilapalli]

Seeing as this came up very late, I am leaning towards dropping this off from 
2.7.2.

That said, I don’t see any reason why this shouldn’t be in 2.8.0 and 2.7.3. Set 
the target-versions accordingly on JIRA. If you agree, appreciate backport help 
to those branches.

Thanks
+Vinod

> On Dec 15, 2015, at 12:59 AM, Konstantin Shvachko  
> wrote:
> 
> Sorry for bringing this up late.
> I think we should pick up HDFS-9516 for this release.
> Rather critical bug fix, but up to you, Vinod.
> 
> Thanks,
> --Konst
> 
> On Wed, Nov 11, 2015 at 8:31 PM, Vinod Kumar Vavilapalli > wrote:
> 
>> Hi all,
>> 
>> 
>> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>> 
>> 
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>> 
>> 
>> The RC is available for validation at:
>> 
>> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/
>> 
>> *
>> 
>> 
>> The RC tag in git is: release-2.7.2-RC0
>> 
>> 
>> The maven artifacts are available via repository.apache.org at
>> 
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/
>> 
>> >> *
>> 
>> 
>> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
>> by quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>> 
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> 
>> Thanks,
>> 
>> Vinod
>> 
>> 
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes
>> 
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk
>> 

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

[Vinod Kumar Vavilapalli]

The last of the blockers went in late last week.

Re-spinning the RC now.

Thanks
+Vinod

> On Nov 13, 2015, at 10:26 AM, Vinod Kumar Vavilapalli  
> wrote:
> 
> Thanks for reporting this Jason!
> 
> Everyone, I am canceling this RC given the feedback, we will go again after 
> addressing the open issues.
> 
> Thanks
> +Vinod
> 
>> On Nov 13, 2015, at 7:57 AM, Jason Lowe > > wrote:
>> 
>> -1 (binding)
>> 
>> Ran into public localization issues and filed YARN-4354 
>> . We need that resolved 
>> before the release is ready.  We will either need a timely fix or may have 
>> to revert YARN-2902 to unblock the release if my root-cause analysis is 
>> correct.  I'll dig into this more today.
>> 
>> Jason
>> 
>> From: Vinod Kumar Vavilapalli > >
>> To: common-dev@hadoop.apache.org ; 
>> hdfs-...@hadoop.apache.org ; 
>> yarn-...@hadoop.apache.org ; 
>> mapreduce-...@hadoop.apache.org  
>> Cc: vino...@apache.org  
>> Sent: Wednesday, November 11, 2015 10:31 PM
>> Subject: [VOTE] Release Apache Hadoop 2.7.2 RC0
>> 
>> Hi all,
>> 
>> 
>> I've created a release candidate RC0 for Apache Hadoop 2.7.2.
>> 
>> 
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>> 
>> 
>> The RC is available for validation at:
>> 
>> *http://people.apache.org/~vinodkv/hadoop-2.7.2-RC0/ 
>> 
>> 
>> > >*
>> 
>> 
>> The RC tag in git is: release-2.7.2-RC0
>> 
>> 
>> The maven artifacts are available via repository.apache.org 
>>  at
>> 
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1023/ 
>> 
>> 
>> > >*
>> 
>> 
>> As you may have noted, an unusually long 2.6.3 release caused 2.7.2 to slip
>> by quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>> 
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> 
>> Thanks,
>> 
>> Vinod
>> 
>> 
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 
>> 
>> 
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk 
>> 
>> 
>> 
> 

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #820

[Apache Jenkins Server]

See 

[jira] [Created] (HADOOP-12652) Error message in Shell.checkIsBashSupported is misleading

[Wei-Chiu Chuang (JIRA)]

Wei-Chiu Chuang created HADOOP-12652:


 Summary: Error message in Shell.checkIsBashSupported is misleading
 Key: HADOOP-12652
 URL: https://issues.apache.org/jira/browse/HADOOP-12652
 Project: Hadoop Common
  Issue Type: Bug
  Components: util
Reporter: Wei-Chiu Chuang
Assignee: Wei-Chiu Chuang


Shell.checkIsBashSupported() creates a bash shell command to verify if the 
system supports bash. However, its error message is misleading, and the logic 
should be updated.

If the shell command throws an IOException, it does not imply the bash did not 
run successfully. If the shell command process was interrupted, its internal 
logic throws an InterruptedIOException, which is a subclass of IOException.
{code:title=Shell.checkIsBashSupported|borderStyle=solid}
ShellCommandExecutor shexec;
boolean supported = true;
try {
  String[] args = {"bash", "-c", "echo 1000"};
  shexec = new ShellCommandExecutor(args);
  shexec.execute();
} catch (IOException ioe) {
  LOG.warn("Bash is not supported by the OS", ioe);
  supported = false;
}
{code}
An example of it appeared in a recent jenkins job
https://builds.apache.org/job/PreCommit-HADOOP-Build/8257/testReport/org.apache.hadoop.ipc/TestRPCWaitForProxy/testInterruptedWaitForProxy/

{noformat}
2015-12-16 21:31:53,797 WARN  util.Shell (Shell.java:checkIsBashSupported(718)) 
- Bash is not supported by the OS
java.io.InterruptedIOException: java.lang.InterruptedException
at org.apache.hadoop.util.Shell.runCommand(Shell.java:930)
at org.apache.hadoop.util.Shell.run(Shell.java:838)
at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1117)
at org.apache.hadoop.util.Shell.checkIsBashSupported(Shell.java:716)
at org.apache.hadoop.util.Shell.(Shell.java:705)
at org.apache.hadoop.util.StringUtils.(StringUtils.java:79)
at 
org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:639)
at 
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:273)
at 
org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:261)
at 
org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:803)
at 
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:773)
at 
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:646)
at org.apache.hadoop.ipc.RPC.waitForProtocolProxy(RPC.java:397)
at org.apache.hadoop.ipc.RPC.waitForProtocolProxy(RPC.java:350)
at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:330)
at 
org.apache.hadoop.ipc.TestRPCWaitForProxy$RpcThread.run(TestRPCWaitForProxy.java:115)
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:503)
at java.lang.UNIXProcess.waitFor(UNIXProcess.java:264)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:920)
... 15 more
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Arpit Agarwal]

+1 (binding)

- Verified signatures for source and binary distributions
- Built jars from source with java 1.7.0_79
- Deployed single-node pseudo-cluster
- Ran example map reduce jobs
- Ran hdfs admin commands, verified NN web UI shows expected usages



On 12/11/15, 4:16 PM, "Junping Du"  wrote:

>
>Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
>
>The RC is available for validation at:
>*http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
>*
>
>The RC tag in git is: release-2.6.3-RC0
>
>The maven artifacts are staged via repository.apache.org at:
>*https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
>*
>
>You can find my public key at:
>http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
>Please try the release and vote. The vote will run for the usual 5 days.
>
>Thanks and happy weekend!
>
>
>Cheers,
>
>Junping
>
>
>[1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

[Jing Zhao]

Thanks for reporting the issue, Wangda. Recreating a new branch-2.8 based
on the current branch-2 makes sense to me.

Thanks,
-Jing

On Wed, Dec 16, 2015 at 5:38 PM, Wangda Tan  wrote:

> Hi folks,
>
> I found there're lots of commits are in branch-2 only.
> Ran "git log branch-2.8..branch-2".
>
> There're 35 commits for YARN, 41 commits for HDFS and 12 commits for
> COMMON. Only several of them are placed in 2.9.0 section in CHANGES.txt.
>
> I think we can either hard reset branch-2.8 to branch-2 and make necessary
> changes such as revert 2.9.0-only patches or backport them one by one. Any
> suggestions?
>
> Thanks,
> Wangda
>

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

[Tsuyoshi Ozawa]

Thanks Wangda for reporting issue. I'm also +1 for recreating a new
branch-2.8 based on current branch-2.8 too. After that, we can revert
2.9.0-only patches on the branch. I will help you if necessary, so
please let me know.

Thanks,
- Tsuyoshi

On Thu, Dec 17, 2015 at 10:51 AM, Jing Zhao  wrote:
> Thanks for reporting the issue, Wangda. Recreating a new branch-2.8 based
> on the current branch-2 makes sense to me.
>
> Thanks,
> -Jing
>
> On Wed, Dec 16, 2015 at 5:38 PM, Wangda Tan  wrote:
>
>> Hi folks,
>>
>> I found there're lots of commits are in branch-2 only.
>> Ran "git log branch-2.8..branch-2".
>>
>> There're 35 commits for YARN, 41 commits for HDFS and 12 commits for
>> COMMON. Only several of them are placed in 2.9.0 section in CHANGES.txt.
>>
>> I think we can either hard reset branch-2.8 to branch-2 and make necessary
>> changes such as revert 2.9.0-only patches or backport them one by one. Any
>> suggestions?
>>
>> Thanks,
>> Wangda
>>

Build failed in Jenkins: Hadoop-Common-trunk #2115

[Apache Jenkins Server]

See 

Changes:

[vinodkv] HADOOP-12415. Fixed pom files to correctly include compile-time

[vinodkv] Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool.

[jlowe] YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by

[xgong] MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by

--
[...truncated 3780 lines...]
[INFO] Using the builder 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder
 with a thread count of 1
[INFO] 
[INFO] 
[INFO] Building Apache Hadoop Annotations 3.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-annotations ---
[INFO] Deleting 

[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ 
hadoop-annotations ---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ 
hadoop-annotations ---
[INFO] There are 24 errors reported by Checkstyle 6.6 with 
checkstyle/checkstyle.xml ruleset.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-annotations 
---
[INFO] Executing tasks

main:
[mkdir] Created dir: 

[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
hadoop-annotations ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ 
hadoop-annotations ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 8 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
hadoop-annotations ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
hadoop-annotations ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-annotations 
---
[INFO] No tests to run.
[INFO] 
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-annotations ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ 
hadoop-annotations ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ 
hadoop-annotations ---
[INFO] No sources in project. Archive not created.
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ 
hadoop-annotations ---
[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ 
hadoop-annotations ---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ 
hadoop-annotations ---
[INFO] 
Loading source files for package org.apache.hadoop.classification.tools...
Loading source files for package org.apache.hadoop.classification...
Constructing Javadoc information...
Standard Doclet version 1.7.0_55
Building tree for all the packages and classes...
Generating 

Generating 

Generating 

Generating 

Generating 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Junping Du]

Hey Vinod,
Yes. We are voting for RC0 tag and all related build bits are related 
to RC0 only. 
Shall we do something special to RC0.1 or RC1 tag (they are just 
duplicated with RC0, pointing to the same commit as I mentioned below)? I guess 
no as we will have final tag for this release after vote ends. Isn't it?

Thanks,

Junping

From: Vinod Kumar Vavilapalli 
Sent: Wednesday, December 16, 2015 7:32 PM
To: common-dev@hadoop.apache.org
Cc: yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; 
hdfs-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag.

Are we still doing that? What are the RC0.1 and RC1 tags doing then?

+Vinod

> On Dec 16, 2015, at 2:13 AM, Junping Du  wrote:
>
> Thanks Akira for notice this. I don't think we can remove these tags as they 
> should be immutable as branches. I created these duplicated tags as after I 
> cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I 
> could still push to original tag by forcefully. The best thing I can do then 
> is to make them point to the same commit as now it is.
>
> Thanks,
>
> Junping
> 
> From: Akira AJISAKA 
> Sent: Wednesday, December 16, 2015 6:41 AM
> To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; 
> mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>
> Thanks Junping for starting release process.
> I noticed there are duplicated tags:
>
> * release-2.6.3-RC0
> * release-2.6.3-RC0.1
> * release-2.6.3-RC1
>
> Could you remove RC0.1 and RC1?
>
> Regards,
> Akira
>
> On 12/16/15 10:17, yliu wrote:
>> Thanks Junping, +1.
>> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
>> basic functionalities.
>>
>> Regards,
>> Yi Liu
>>
>> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>>
>>> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
>>> built locally. Ran some MR jobs successfully.
>>>
>>> Best,
>>> Chang
>>>
>>> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
>>>
 Thanks Junping,

 +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
 both successfully finished.

 Regards,
 Wangda


 On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
 naganarasimha...@gmail.com> wrote:

> Hi Junping,
>
> +0 (non binding)
>
> Though everything else is working  fine (downloaded the tar ball and
> installed single node cluster setup and  verified  few MR jobs),
> submission of Unmanaged AM is getting the RM down. YARN-4452 has
> already been raised and i am working on it. Will provide the patch for
> the trunk and the 2.6.3 version asap
>
> Regards,
>
> + Naga
>
> 
>
> Thanks for the work Junping! Downloaded the src tarball. Built locally
> and successfully ran
> in single node mode with a few map reduce jobs. LGTM.
>
> Li Lu
>
> On Dec 14, 2015, at 04:23, Junping Du
> >
> wrote:
>
> ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
> issue and download
> should work now. Please try to download it again. Thanks!
>
>
> Thanks,
>
>
> Junping
>
>
> 
> From: sarjeet singh >
> Sent: Sunday, December 13, 2015 6:44 PM
> To: common-dev@hadoop.apache.org
> Cc: mapreduce-...@hadoop.apache.org>>> mapreduce-...@hadoop.apache.org
>> ;
> hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org;
> junping...@apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>
> I am also getting the same error when downloading tar.gz:
>
> "You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server."
>
> - Sarjeet Singh
>
> On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
> >
> wrote:
> Hi Junping,
>
> Thank you for starting the voting.
> I cannot access the tar.gz file because of permission error. Could you
> check the permission to access the files?
>
> Forbidden
> You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
> on this server.
>
> Thanks,
> - Tsuyoshi
>
> On Sat, Dec 12, 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Xuan Gong]

+1 (binding),

Build and deploy the cluster from source code.
Ran a few example jobs and passed successfully. 

Xuan Gong

> On Dec 16, 2015, at 4:07 PM, Arpit Agarwal  wrote:
> 
> +1 (binding)
> 
> - Verified signatures for source and binary distributions
> - Built jars from source with java 1.7.0_79
> - Deployed single-node pseudo-cluster
> - Ran example map reduce jobs
> - Ran hdfs admin commands, verified NN web UI shows expected usages
> 
> 
> 
> On 12/11/15, 4:16 PM, "Junping Du"  wrote:
> 
>> 
>> Hi all developers in hadoop community,
>>  I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
>> maintenance release to follow up 2.6.2.) according to email thread of 
>> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several 
>> blocker issues were getting committed until yesterday. Below is the details:
>> 
>> The RC is available for validation at:
>> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
>> *
>> 
>> The RC tag in git is: release-2.6.3-RC0
>> 
>> The maven artifacts are staged via repository.apache.org at:
>> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
>> *
>> 
>> You can find my public key at:
>> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> 
>> Please try the release and vote. The vote will run for the usual 5 days.
>> 
>> Thanks and happy weekend!
>> 
>> 
>> Cheers,
>> 
>> Junping
>> 
>> 
>> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>> 

[jira] [Created] (HADOOP-12653) Client.java can get "Address already in use" when using kerberos and attempting to bind to any port on the local IP address

[Colin Patrick McCabe (JIRA)]

Colin Patrick McCabe created HADOOP-12653:
-

 Summary: Client.java can get "Address already in use" when using 
kerberos and attempting to bind to any port on the local IP address
 Key: HADOOP-12653
 URL: https://issues.apache.org/jira/browse/HADOOP-12653
 Project: Hadoop Common
  Issue Type: Bug
  Components: net
Affects Versions: 2.4.0
Reporter: Colin Patrick McCabe
Assignee: Colin Patrick McCabe


Client.java can get "Address already in use" when using kerberos and attempting 
to bind to any port on the local IP address.  It appears to be caused by the 
host running out of ports in the ephemeral range.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[VOTE] Release Apache Hadoop 2.7.2 RC1

[Vinod Kumar Vavilapalli]

Hi all,

I've created a release candidate RC1 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ 


The RC tag in git is: release-2.7.2-RC1

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1026/ 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html 
for quick perusal.

As you may have noted,
 - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
 - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc

[Important] Lots of 2.8.0 commits are in branch-2 only

[Wangda Tan]

Hi folks,

I found there're lots of commits are in branch-2 only.
Ran "git log branch-2.8..branch-2".

There're 35 commits for YARN, 41 commits for HDFS and 12 commits for
COMMON. Only several of them are placed in 2.9.0 section in CHANGES.txt.

I think we can either hard reset branch-2.8 to branch-2 and make necessary
changes such as revert 2.9.0-only patches or backport them one by one. Any
suggestions?

Thanks,
Wangda

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

[Vinod Kumar Vavilapalli]

Not entirely sure we have enough info to warrant a hard-reset. Yet.

Do we know how many of these are new features / improvement that we shouldn’t 
put any more into 2.8.0 and how many are bugs that we need to? If you don’t 
have time, I’ll look at it right after getting out 2.7.2 RC1.

Thanks
+Vinod

> On Dec 16, 2015, at 5:38 PM, Wangda Tan  wrote:
> 
> Hi folks,
> 
> I found there're lots of commits are in branch-2 only.
> Ran "git log branch-2.8..branch-2".
> 
> There're 35 commits for YARN, 41 commits for HDFS and 12 commits for
> COMMON. Only several of them are placed in 2.9.0 section in CHANGES.txt.
> 
> I think we can either hard reset branch-2.8 to branch-2 and make necessary
> changes such as revert 2.9.0-only patches or backport them one by one. Any
> suggestions?
> 
> Thanks,
> Wangda

Jenkins build is back to normal : Hadoop-Common-trunk #2116

[Apache Jenkins Server]

See 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Steve Loughran]

+1, binding


Did a build and test with slider with the build set to -Dhadoop.version=2.6.3

this does a D/L and test from the staging repo. All artifacts were located, and 
the tests completed

> On 12 Dec 2015, at 00:16, Junping Du  wrote:
> 
> 
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
> 
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> *
> 
> The RC tag in git is: release-2.6.3-RC0
> 
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> *
> 
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> 
> Please try the release and vote. The vote will run for the usual 5 days.
> 
> Thanks and happy weekend!
> 
> 
> Cheers,
> 
> Junping
> 
> 
> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> 

[jira] [Created] (HADOOP-12648) Not able to compile hadoop source code on windows

[Pardeep (JIRA)]

Pardeep created HADOOP-12648:


 Summary: Not able to compile hadoop source code on windows
 Key: HADOOP-12648
 URL: https://issues.apache.org/jira/browse/HADOOP-12648
 Project: Hadoop Common
  Issue Type: Wish
  Components: build
Affects Versions: 2.6.2
 Environment: WIndow 7 32 bit 
Maven 3.3.9
Protoc 2.5.0
Cmake 3.3.2
Zlib 1.2.7
Cygwin

Reporter: Pardeep


I haved added the path as per below :

cmake_path =C:\cmake
FINDBUGS_HOME=C:\FINDBUGS_HOME
HADOOP_HOME=C:\HOOO\hadoop-2.6.2-src
path=C:\JAVA\bin
ZLIB_HOME=C:\zlib-1.2.7
path 
=C:\oraclexe\app\oracle\product\11.2.0\server\bin;D:\Forms\bin;D:\Reports\bin;D:\oracle\ora92\bin;C:\Program
 Files\Oracle\jre\1.3.1\bin;C:\Program 
Files\Oracle\jre\1.1.8\bin;D:\Workflow\bin;C:\Program Files\Intel\iCLS 
Client\;%SystemRoot%\system32;%SystemRoot%;%SystemRoot%\System32\Wbem;%SYSTEMROOT%\System32\WindowsPowerShell\v1.0\;C:\Program
 Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program 
Files\Intel\Intel(R) Management Engine Components\IPT;C:\Program 
Files\WIDCOMM\Bluetooth Software\;C:\Program Files\Intel\WiFi\bin\;C:\Program 
Files\Common Files\Intel\WirelessCommon\;D:\Forms\jdk\bin;C:\Program 
Files\Intel\OpenCL SDK\2.0\bin\x86;D:\Reports\jdk\bin;C:\Program 
Files\TortoiseSVN\bin;c:\cygwin\bin;%M2_HOME%\bin;C:\protobuf;C/Windows/Microsoft.NET/Framework/v4.0.30319;C:\Program
 Files\Microsoft Windows Performance 
Toolkit\;C:\msysgit\Git\cmd;C:\msysgit\bin\;C:\msysgit\mingw\bin\;C:\cmake;C:\FINDBUGS_HOME;C:\zlib-1.2.7

Please let me know if anything is wrong or need to install any other s/w



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

RE: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Brahma Reddy Battula]

+1 (non-binding)

-- Downloaded both source and binary tarballs successfully.
--Set up a pseudo-distributed cluster and Distributed HA Cluster
--Ran Several jobs Slive,Terasort and pi.
--All are working fine.


Thanks & Regards
 Brahma Reddy Battula

From: Steve Loughran [ste...@hortonworks.com]
Sent: Wednesday, December 16, 2015 5:58 PM
To: mapreduce-...@hadoop.apache.org
Cc: Hadoop Common; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; 
junping...@apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, binding


Did a build and test with slider with the build set to -Dhadoop.version=2.6.3

this does a D/L and test from the staging repo. All artifacts were located, and 
the tests completed

> On 12 Dec 2015, at 00:16, Junping Du  wrote:
>
>
> Hi all developers in hadoop community,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next 
> maintenance release to follow up 2.6.2.) according to email thread of release 
> plan 2.6.3 [1]. Sorry for this RC coming a bit late as several blocker issues 
> were getting committed until yesterday. Below is the details:
>
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> *
>
> The RC tag in git is: release-2.6.3-RC0
>
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> *
>
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> Please try the release and vote. The vote will run for the usual 5 days.
>
> Thanks and happy weekend!
>
>
> Cheers,
>
> Junping
>
>
> [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
>

[jira] [Created] (HADOOP-12649) Improve UGI diagnostics and failure handling

[Steve Loughran (JIRA)]

Steve Loughran created HADOOP-12649:
---

 Summary: Improve UGI diagnostics and failure handling
 Key: HADOOP-12649
 URL: https://issues.apache.org/jira/browse/HADOOP-12649
 Project: Hadoop Common
  Issue Type: Improvement
  Components: security
Affects Versions: 2.7.1
 Environment: Kerberos
Reporter: Steve Loughran


Sometimes —apparently— some people cannot get kerberos to work.

The ability to diagnose problems here is hampered by some aspects of UGI
# the only way to turn on JAAS debug information is through an env var, not 
within the JVM
# failures are potentially underlogged
# exceptions raised are generic IOEs, so can't be trapped and filtered
# failure handling on the TGT renewer thread is nonexistent
# the code is barely-readable, underdocumented mess.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12650) Document all of the secret env vars

[Allen Wittenauer (JIRA)]

Allen Wittenauer created HADOOP-12650:
-

 Summary: Document all of the secret env vars
 Key: HADOOP-12650
 URL: https://issues.apache.org/jira/browse/HADOOP-12650
 Project: Hadoop Common
  Issue Type: Bug
  Components: scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer
Priority: Blocker


Over the years, developers have added all kinds of magical environment 
variables in the Java code without any concern or thought about either a) 
documenting them or b) whether they are already used by something else.  We 
need to update at least hadoop-env.sh to contain a list of these env vars so 
that end users know that they are either private/unsafe and/or how they can be 
used.

Just one of many examples: HADOOP_JAAS_DEBUG.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HADOOP-12648) Not able to compile hadoop source code on windows

[Brahma Reddy Battula (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Brahma Reddy Battula resolved HADOOP-12648.
---
Resolution: Not A Problem

> Not able to compile hadoop source code on windows
> -
>
> Key: HADOOP-12648
> URL: https://issues.apache.org/jira/browse/HADOOP-12648
> Project: Hadoop Common
>  Issue Type: Wish
>  Components: build
>Affects Versions: 2.6.2
> Environment: WIndow 7 32 bit 
> Maven 3.3.9
> Protoc 2.5.0
> Cmake 3.3.2
> Zlib 1.2.7
> Cygwin
>Reporter: Pardeep
>
> I haved added the path as per below :
> cmake_path =C:\cmake
> FINDBUGS_HOME=C:\FINDBUGS_HOME
> HADOOP_HOME=C:\HOOO\hadoop-2.6.2-src
> path=C:\JAVA\bin
> ZLIB_HOME=C:\zlib-1.2.7
> path 
> =C:\oraclexe\app\oracle\product\11.2.0\server\bin;D:\Forms\bin;D:\Reports\bin;D:\oracle\ora92\bin;C:\Program
>  Files\Oracle\jre\1.3.1\bin;C:\Program 
> Files\Oracle\jre\1.1.8\bin;D:\Workflow\bin;C:\Program Files\Intel\iCLS 
> Client\;%SystemRoot%\system32;%SystemRoot%;%SystemRoot%\System32\Wbem;%SYSTEMROOT%\System32\WindowsPowerShell\v1.0\;C:\Program
>  Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program 
> Files\Intel\Intel(R) Management Engine Components\IPT;C:\Program 
> Files\WIDCOMM\Bluetooth Software\;C:\Program Files\Intel\WiFi\bin\;C:\Program 
> Files\Common Files\Intel\WirelessCommon\;D:\Forms\jdk\bin;C:\Program 
> Files\Intel\OpenCL SDK\2.0\bin\x86;D:\Reports\jdk\bin;C:\Program 
> Files\TortoiseSVN\bin;c:\cygwin\bin;%M2_HOME%\bin;C:\protobuf;C/Windows/Microsoft.NET/Framework/v4.0.30319;C:\Program
>  Files\Microsoft Windows Performance 
> Toolkit\;C:\msysgit\Git\cmd;C:\msysgit\bin\;C:\msysgit\mingw\bin\;C:\cmake;C:\FINDBUGS_HOME;C:\zlib-1.2.7
> Please let me know if anything is wrong or need to install any other s/w



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12651) Replace dev-support with wrappers to Yetus

[Allen Wittenauer (JIRA)]

Allen Wittenauer created HADOOP-12651:
-

 Summary: Replace dev-support with wrappers to Yetus
 Key: HADOOP-12651
 URL: https://issues.apache.org/jira/browse/HADOOP-12651
 Project: Hadoop Common
  Issue Type: New Feature
  Components: scripts
Affects Versions: 3.0.0
Reporter: Allen Wittenauer


Now that Yetus has had a release, we should rip out the components that make it 
up from dev-support and replace them with wrappers.  The wrappers should:
* default to a sane version
* allow for version overrides via an env var
* download into patchprocess
* execute with the given parameters

Marking this as an incompatible change, since we should also remove the 
filename extensions and move these into a bin directory for better maintenance 
towards the future.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: Hadoop-common-trunk-Java8 #817

[Apache Jenkins Server]

See 

Changes:

[aw] HADOOP-12192. update releasedocmaker command line (aw)

--
[...truncated 5789 lines...]
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.362 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.36 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.773 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.402 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFile
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.132 sec - in 
org.apache.hadoop.io.file.tfile.TestTFile
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.176 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.069 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.246 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileSplit
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.118 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileSplit
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileComparator2
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.057 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileComparator2
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.213 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.069 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.604 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestVLong
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.506 sec - in 
org.apache.hadoop.io.file.tfile.TestVLong
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestTextNonUTF8
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.202 sec - in 
org.apache.hadoop.io.TestTextNonUTF8
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestArrayWritable
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.196 sec - in 
org.apache.hadoop.io.TestArrayWritable
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Steve Loughran]

> On 16 Dec 2015, at 06:41, Akira AJISAKA  wrote:
> 
> Thanks Junping for starting release process.
> I noticed there are duplicated tags:
> 
> * release-2.6.3-RC0
> * release-2.6.3-RC0.1
> * release-2.6.3-RC1
> 
> Could you remove RC0.1 and RC1?
> 
> Regards,
> Akira


the ASF has locked down tag & branch movement for now, so that you are 
guaranteed that the tag included in a vote is the tag you get when you download 
things.

The numbering suggestion was mine, I'm afraid

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Sangjin Lee]

+1 (non-binding)

- downloaded source and binary and verified the signatures (although I
didn't connect with Junping via web of trust)
- started a pseudo-distributed cluster and ran test jobs
- browsed the RM and NN UI
- looked through the daemon logs

Thanks Junping.

Sangjin

On Wed, Dec 16, 2015 at 5:11 AM, Brahma Reddy Battula <
brahmareddy.batt...@huawei.com> wrote:

> +1 (non-binding)
>
> -- Downloaded both source and binary tarballs successfully.
> --Set up a pseudo-distributed cluster and Distributed HA Cluster
> --Ran Several jobs Slive,Terasort and pi.
> --All are working fine.
>
>
> Thanks & Regards
>  Brahma Reddy Battula
> 
> From: Steve Loughran [ste...@hortonworks.com]
> Sent: Wednesday, December 16, 2015 5:58 PM
> To: mapreduce-...@hadoop.apache.org
> Cc: Hadoop Common; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
> junping...@apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0
>
> +1, binding
>
>
> Did a build and test with slider with the build set to
> -Dhadoop.version=2.6.3
>
> this does a D/L and test from the staging repo. All artifacts were
> located, and the tests completed
>
> > On 12 Dec 2015, at 00:16, Junping Du  wrote:
> >
> >
> > Hi all developers in hadoop community,
> >   I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the next
> maintenance release to follow up 2.6.2.) according to email thread of
> release plan 2.6.3 [1]. Sorry for this RC coming a bit late as several
> blocker issues were getting committed until yesterday. Below is the details:
> >
> > The RC is available for validation at:
> > *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
> > *
> >
> > The RC tag in git is: release-2.6.3-RC0
> >
> > The maven artifacts are staged via repository.apache.org at:
> > *
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
> > <
> https://repository.apache.org/content/repositories/orgapachehadoop-1025/>*
> >
> > You can find my public key at:
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > Please try the release and vote. The vote will run for the usual 5 days.
> >
> > Thanks and happy weekend!
> >
> >
> > Cheers,
> >
> > Junping
> >
> >
> > [1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y
> >
>
>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

[Junping Du]

Thanks Akira for notice this. I don't think we can remove these tags as they 
should be immutable as branches. I created these duplicated tags as after I cut 
off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I could 
still push to original tag by forcefully. The best thing I can do then is to 
make them point to the same commit as now it is.

Thanks,

Junping

From: Akira AJISAKA 
Sent: Wednesday, December 16, 2015 6:41 AM
To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org; 
mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Thanks Junping for starting release process.
I noticed there are duplicated tags:

* release-2.6.3-RC0
* release-2.6.3-RC0.1
* release-2.6.3-RC1

Could you remove RC0.1 and RC1?

Regards,
Akira

On 12/16/15 10:17, yliu wrote:
> Thanks Junping, +1.
> Download the tarball and deploy a small HDFS/YARN cluster, and verify few
> basic functionalities.
>
> Regards,
> Yi Liu
>
> On Wed, Dec 16, 2015 at 6:42 AM, Chang Li  wrote:
>
>> Thanks Junping, + 1(non binding). Downloaded the tarball, compiled and
>> built locally. Ran some MR jobs successfully.
>>
>> Best,
>> Chang
>>
>> On Tue, Dec 15, 2015 at 3:17 PM, Wangda Tan  wrote:
>>
>>> Thanks Junping,
>>>
>>> +1 (binding). Deploy a cluster locally, run distributed shell and MR job,
>>> both successfully finished.
>>>
>>> Regards,
>>> Wangda
>>>
>>>
>>> On Tue, Dec 15, 2015 at 12:43 PM, Naganarasimha Garla <
>>> naganarasimha...@gmail.com> wrote:
>>>
 Hi Junping,

 +0 (non binding)

 Though everything else is working  fine (downloaded the tar ball and
 installed single node cluster setup and  verified  few MR jobs),
 submission of Unmanaged AM is getting the RM down. YARN-4452 has
 already been raised and i am working on it. Will provide the patch for
 the trunk and the 2.6.3 version asap

 Regards,

 + Naga

 

 Thanks for the work Junping! Downloaded the src tarball. Built locally
 and successfully ran
 in single node mode with a few map reduce jobs. LGTM.

 Li Lu

 On Dec 14, 2015, at 04:23, Junping Du
 >
 wrote:

 ?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
 issue and download
 should work now. Please try to download it again. Thanks!


 Thanks,


 Junping


 
 From: sarjeet singh >
 Sent: Sunday, December 13, 2015 6:44 PM
 To: common-dev@hadoop.apache.org
 Cc: mapreduce-...@hadoop.apache.org>> mapreduce-...@hadoop.apache.org
> ;
 hdfs-...@hadoop.apache.org;
 yarn-...@hadoop.apache.org;
 junping...@apache.org
 Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

 I am also getting the same error when downloading tar.gz:

 "You don't have permission to access
 /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
 on this server."

 - Sarjeet Singh

 On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
 >
 wrote:
 Hi Junping,

 Thank you for starting the voting.
 I cannot access the tar.gz file because of permission error. Could you
 check the permission to access the files?

 Forbidden
 You don't have permission to access
 /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
 on this server.

 Thanks,
 - Tsuyoshi

 On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
 >
 wrote:

 Hi all developers in hadoop community,
I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
 next maintenance release
 to follow up 2.6.2.) according to email thread of release plan 2.6.3
 [1]. Sorry for this RC
 coming a bit late as several blocker issues were getting committed
 until yesterday. Below
 is the details:

 The RC is available for validation at:
 *http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
 *

 The RC tag in git is: release-2.6.3-RC0

 The maven artifacts are staged via
 repository.apache.org<
 http://repository.apache.org>
 at:
 *
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/
>> ?
 <
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1025/
> *