Re: [RESULT][VOTE] Release Apache Hadoop 2.7.0 RC0
It took a while for the artifact distribution to come around, I initially had trouble pushing them from home too. Anyways, I just updated the website too. Sending an announcement now.. Thanks, +Vinod On Apr 20, 2015, at 8:06 PM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: With 22 +1s (7 binding), one +0 and no -1s the vote passes. Thanks for everyone who tried the release and voted. I'll push the bits and send out an announcement. Thanks +Vinod On Apr 10, 2015, at 4:44 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
This is more than about bugs. In the past, incompatibilities are what bit us more than bugs. If we find such bad incompatibilities in 2.7.0 release, calling it not-stable yet (or alpha or whatever) leaves us with the ability to fix any incompatibilities in a final public-ready release. Thanks +Vinod On Apr 20, 2015, at 2:03 PM, Karthik Kambatla ka...@cloudera.commailto:ka...@cloudera.com wrote: How about we skip this all entirely? If the HDFS issues reported aren't going to render the cluster unusable, we could just release 2.7.0 and mark it current/latest. We can move the stable tag to 2.7.1 or 2.7.2 whichever version deserves the bit.
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
As I mentioned on the JIRA, I also ran into it just once. I didn't have the time to investigate, and just wanted to see if anyone else also ran into it. If it is a rare occurrence, I am fine with going through with the release. I have some naming reservations against calling 2.7.0 an alpha. I am fine with having a 2.7.0-alpha release, followed by 2.7.0-beta and 2.7.0 GA. Calling 2.7.0 alpha and 2.7.1 GA somehow doesn't seem right. I know we followed that for 2.0.0, but it didn't make much sense to me or many others I know (even outside Cloudera). How about we skip this all entirely? If the HDFS issues reported aren't going to render the cluster unusable, we could just release 2.7.0 and mark it current/latest. We can move the stable tag to 2.7.1 or 2.7.2 whichever version deserves the bit. On Mon, Apr 20, 2015 at 11:10 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Yup, missed this. Tx for bumping up. I did run simple MR jobs dist-shell on my Mac. Things worked fine. Brahma Reddy also commented on YARN-3492 saying that he could take Karthik's configs and run jobs successfully. So, I moved it out to 2.7.1, it's likely an environment issue. Karthik, please look at the JIRA. Thanks +Vinod On Apr 17, 2015, at 10:49 AM, Tsuyoshi Ozawa oz...@apache.org wrote: Hi Vinod, Could you check a comment by Karthik? Maybe you're missing it. Stood up a pseudo-dist cluster using the binary bits and ran a pi job. - The MR-AM got allocated, but never launched because the NM-RM didn't talk to each other. Filed YARN-3492. Was able to run jobs after restart. I believe we should at least investigate this further to see what could have been going on. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 12:47 PM, Tsuyoshi Ozawa oz...@apache.org wrote: I'd like to agree with Vinod's suggestion. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 9:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Haven't heard back and we are way past the voting period, closing this now. Here's my +1 to conclude the vote. Thanks +Vinod On Apr 20, 2015, at 10:31 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Apologies for the delay in replying. It's a bit unusual because I am trying something different this time. We discussed this before: http://markmail.org/thread/zwzze6cqqgwq4rmw The short summary is to push more frequent releases instead of waiting for making a release perfect - something that rarely works in practice. We have tried requesting downstream projects to use RC's before (for e.g. while doing 2.x alphas/betas), but it didn't yield much success without making explicit releases. That is why, I am pushing out 2.7.0 as alpha so that downstream projects can start integrating right away and uncover issues. Will immediately follow up with 2.7.1, 2.7.2 etc every 2-3 weeks from now. Does that make sense? I'll wait for your ack till later in the evening today and push the release out unless you are against this proposal. Thanks +Vinod On Apr 17, 2015, at 4:00 PM, Colin P. McCabe cmcc...@apache.org wrote: That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (non-binding) - A bit late but I ran a set of rolling upgrade tests last week from 2.6.0 Latest to 2.7.0 RC. - Tests covered rolling upgrade for individual components: NN, DN, NM, RM, HS- While rolling upgrade was in progress, several MR jobs were also running. - Everything worked as expected and the upgrades completed with no job failures. Phil On Sunday, April 19, 2015 1:08 PM, Steve Loughran ste...@hortonworks.com wrote: Has 2.7.0 actually shipped? As in: redistributed, maven artifacts pushed out, etc. If so, it's very much too late to do another RC. otherwise, maybe we should recognise that 2.7.0 isn't something we could push out, simply go straight to 2.7.1 and not worry about the 2.7.0 release -that is, just skip the final step of publishing. To get that 2.7.1 out in a timely manner though, it needs to have 0 changes other than these showstoppers; the ones which would have triggered a -1 (binding) if they showed up during the vote On 18 Apr 2015, at 00:00, Colin P. McCabe cmcc...@apache.org wrote: That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Tx for reporting these test results, Phil! Thanks +Vinod On Apr 20, 2015, at 7:50 AM, Phil Su phil...@yahoo-inc.com.INVALID wrote: +1 (non-binding) - A bit late but I ran a set of rolling upgrade tests last week from 2.6.0 Latest to 2.7.0 RC. - Tests covered rolling upgrade for individual components: NN, DN, NM, RM, HS- While rolling upgrade was in progress, several MR jobs were also running. - Everything worked as expected and the upgrades completed with no job failures. Phil On Sunday, April 19, 2015 1:08 PM, Steve Loughran ste...@hortonworks.com wrote: Has 2.7.0 actually shipped? As in: redistributed, maven artifacts pushed out, etc. If so, it's very much too late to do another RC. otherwise, maybe we should recognise that 2.7.0 isn't something we could push out, simply go straight to 2.7.1 and not worry about the 2.7.0 release -that is, just skip the final step of publishing. To get that 2.7.1 out in a timely manner though, it needs to have 0 changes other than these showstoppers; the ones which would have triggered a -1 (binding) if they showed up during the vote On 18 Apr 2015, at 00:00, Colin P. McCabe cmcc...@apache.org wrote: That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Apologies for the delay in replying. It's a bit unusual because I am trying something different this time. We discussed this before: http://markmail.org/thread/zwzze6cqqgwq4rmw The short summary is to push more frequent releases instead of waiting for making a release perfect - something that rarely works in practice. We have tried requesting downstream projects to use RC's before (for e.g. while doing 2.x alphas/betas), but it didn't yield much success without making explicit releases. That is why, I am pushing out 2.7.0 as alpha so that downstream projects can start integrating right away and uncover issues. Will immediately follow up with 2.7.1, 2.7.2 etc every 2-3 weeks from now. Does that make sense? I'll wait for your ack till later in the evening today and push the release out unless you are against this proposal. Thanks +Vinod On Apr 17, 2015, at 4:00 PM, Colin P. McCabe cmcc...@apache.org wrote: That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
I was on the road, to Hadoop Summit EU, so couldn't close the release. Will do so later today. I am pushing for 2.7.1, 2.7.2 etc - more agile releases. +Vinod On Apr 19, 2015, at 11:07 AM, Steve Loughran ste...@hortonworks.com wrote: Has 2.7.0 actually shipped? As in: redistributed, maven artifacts pushed out, etc. If so, it's very much too late to do another RC. otherwise, maybe we should recognise that 2.7.0 isn't something we could push out, simply go straight to 2.7.1 and not worry about the 2.7.0 release -that is, just skip the final step of publishing. To get that 2.7.1 out in a timely manner though, it needs to have 0 changes other than these showstoppers; the ones which would have triggered a -1 (binding) if they showed up during the vote On 18 Apr 2015, at 00:00, Colin P. McCabe cmcc...@apache.org wrote: That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Yup, missed this. Tx for bumping up. I did run simple MR jobs dist-shell on my Mac. Things worked fine. Brahma Reddy also commented on YARN-3492 saying that he could take Karthik's configs and run jobs successfully. So, I moved it out to 2.7.1, it's likely an environment issue. Karthik, please look at the JIRA. Thanks +Vinod On Apr 17, 2015, at 10:49 AM, Tsuyoshi Ozawa oz...@apache.org wrote: Hi Vinod, Could you check a comment by Karthik? Maybe you're missing it. Stood up a pseudo-dist cluster using the binary bits and ran a pi job. - The MR-AM got allocated, but never launched because the NM-RM didn't talk to each other. Filed YARN-3492. Was able to run jobs after restart. I believe we should at least investigate this further to see what could have been going on. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 12:47 PM, Tsuyoshi Ozawa oz...@apache.org wrote: I'd like to agree with Vinod's suggestion. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 9:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Has 2.7.0 actually shipped? As in: redistributed, maven artifacts pushed out, etc. If so, it's very much too late to do another RC. otherwise, maybe we should recognise that 2.7.0 isn't something we could push out, simply go straight to 2.7.1 and not worry about the 2.7.0 release -that is, just skip the final step of publishing. To get that 2.7.1 out in a timely manner though, it needs to have 0 changes other than these showstoppers; the ones which would have triggered a -1 (binding) if they showed up during the vote On 18 Apr 2015, at 00:00, Colin P. McCabe cmcc...@apache.org wrote: That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Hi Vinod, Could you check a comment by Karthik? Maybe you're missing it. Stood up a pseudo-dist cluster using the binary bits and ran a pi job. - The MR-AM got allocated, but never launched because the NM-RM didn't talk to each other. Filed YARN-3492. Was able to run jobs after restart. I believe we should at least investigate this further to see what could have been going on. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 12:47 PM, Tsuyoshi Ozawa oz...@apache.org wrote: I'd like to agree with Vinod's suggestion. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 9:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
I'd like to agree with Vinod's suggestion. Thanks, - Tsuyoshi On Fri, Apr 17, 2015 at 9:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
That's an interesting suggestion. What's the advantage of putting HDFS-8070, HDFS-8163, and HDFS-8179 in 2.7.1, instead of just doing another RC? We have only done one release candidate so far... seems a little unusual. I realize that some of this stuff came in after the voting period, but I would still feel slightly more comfortable just fixing it and doing an rc1, if that's possible in the next week or two. The people who want to get the upstream release into their hands as soon as possible can use rc0 as-is. Thoughts? best, Colin On Fri, Apr 17, 2015 at 3:35 PM, Arpit Agarwal aagar...@hortonworks.com wrote: +1 for calling 2.7.0 an alpha. There are a couple of more issues related to incorrect handling of timestamps. 1. HDFS-8163 - Using monotonicNow for block report scheduling causes test failures on recently restarted systems 2. HDFS-8179 - DFSClient#getServerDefaults returns null within 1 hour of NN start Tagged both as blockers for 2.7.1. On 4/17/15, 7:12 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Quick look tells me this is a bug that needs fixing. Am on the road, so couldn't close the vote right after 5 days. Seeing as this is coming up beyond the voting period, unless you feel strongly against it, I'd like to close the vote as a success but do the following: call this release an alpha for downstream consumption in line with my original proposal, following it up with a 2.7.1 in two weeks. Thanks +Vinod On Apr 17, 2015, at 2:27 AM, Colin P. McCabe cmcc...@apache.org wrote: I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (non-binding) - Downloaded and built the source. - Deployed to a local cluster and ran sample jobls like sleepJob and Wordcount. - Verified Signatures - Verified the RM UI for correctness. Thanks Vinod for taking the time and effort to drive this release. -Mit Desai On Wednesday, April 15, 2015 8:03 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White patwh...@yahoo-inc.com.INVALID wrote: +1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5% tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a JDK difference, 2.6.0 ran with jdk1.7 while 2.7.0 had jdk1.8, so some of the improvement may be from Java 1.8.0, that said, the 2.7.0 benchmarks compare well against current 2.6.0. Thanks. patw - Forwarded Message - From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org athttps://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending onhow it goes, get it stabilized and potentially use a 2.7.1 in a fewweeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (non-binding) Thanks,Vinod, for the time and effort you put into creating this release. I downloaded and built the source for 2.7.0, RC0. I started a local cluster and ran wordcount, sleep, and streaming jobs. In addition, I did the following: o I ran a distributed shell job which tested preserving containers across AM restarts. I did this by setting the -keep_containers_across_application_attempts flag and killing the first AM once the containers started. I checked the results by querying the timeline server and comparing the start and end times of the non-AM containers against the start and end times of the later AM containers. This verified that the non-AM containers started during the first AM's run and finished after the first AM had been killed and after the second AM had started. o I enabled the preemption feature and verified that containers were preempted from preemptable queues and not from non-preemptable ones. o I ran unit tests for hadoop-yarn-server-resourcemanage. All passed with the exception of TestFifoScheduler#testResourceOverCommit. o I ran unit tests for hadoop-yarn-server-nodemanager. All passed with the exception of TestResourceLocalizationService#testFailedDirsResourceRelease. o I ran unit tests for hadoop-hdfs. All passed with the exception of TestReplaceDatanodeOnFailure#testReplaceDatanodeOnFailure,TestBalancer#testUnknownDatanode, TestBPOfferService#testBasicFunctionality, and TestWebHdfsFileSystemContract#testGetFileBlockLocations. Thank you,-Eric Payne From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White patwh...@yahoo-inc.com.INVALID wrote: +1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5% tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a JDK difference, 2.6.0 ran with jdk1.7 while 2.7.0 had jdk1.8, so some of the improvement may be from Java 1.8.0, that said, the 2.7.0 benchmarks compare well against current 2.6.0. Thanks. patw - Forwarded Message - From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org athttps://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending onhow it goes, get it stabilized and potentially use a 2.7.1 in a fewweeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (binding) - Downloaded source tarball and verified signature and checksum. - Built from source, including native code on Linux and Windows. - Ran a 3-node unsecured cluster. - Tested various HDFS and YARN commands, including sample MapReduce jobs. - Confirmed that SecondaryNameNode can take a checkpoint. - HADOOP-9629: Tested integration with Azure storage as an alternative FileSystem. - HADOOP-11394/11395/11396: Built site docs and confirmed presence of these fixes in the documentation for Hadoop Compatible File Systems. - HDFS-7604: Confirmed presence of DataNode volume failure reporting in web UI and metrics. - HDFS-7879: Ran nm -g libhdfs.so and dumpbin /exports hdfs.dll to confirm export of public API symbols in libhdfs. Allen mentioned HDFS-8132, which reported a problem using JCarder on the build. Brahma, Todd and I have determined that root cause is incompatibility of the JCarder build with Java 7 classes. (2.7.0 is our first release compiling as Java 7.) This is not a problem that needs to hold up the release. Vinod, thank you for putting together the release. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/15/15, 7:07 AM, Mit Desai mitde...@yahoo-inc.com.INVALID wrote: +1 (non-binding) - Downloaded and built the source. - Deployed to a local cluster and ran sample jobls like sleepJob and Wordcount. - Verified Signatures - Verified the RM UI for correctness. Thanks Vinod for taking the time and effort to drive this release. -Mit Desai On Wednesday, April 15, 2015 8:03 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White patwh...@yahoo-inc.com.INVALID wrote: +1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5% tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a JDK difference, 2.6.0 ran with jdk1.7 while 2.7.0 had jdk1.8, so some of the improvement may be from Java 1.8.0, that said, the 2.7.0 benchmarks compare well against current 2.6.0. Thanks. patw - Forwarded Message - From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org athttps://repository.apache.org/content/repositories/orgapachehadoop-1017 / As discussed before - This release will only work with JDK 1.7 and above - I¹d like to use this as a starting release for 2.7.x [1], depending onhow it goes, get it stabilized and potentially use a 2.7.1 in a fewweeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Thanks for putting this together, Vinod. Stood up a pseudo-dist cluster using the binary bits and ran a pi job. - The MR-AM got allocated, but never launched because the NM-RM didn't talk to each other. Filed YARN-3492. Was able to run jobs after restart. I believe we should at least investigate this further to see what could have been going on. On Wed, Apr 15, 2015 at 1:11 PM, Kihwal Lee kih...@yahoo-inc.com.invalid wrote: +1 (binding)Built the source from the tag and ran basic test on pseudo distributed cluster. Kihwal From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw -- Karthik Kambatla Software Engineer, Cloudera Inc. http://five.sentenc.es
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Done. Thank you, Tsuyoshi. On 4/15/15 14:55, Tsuyoshi Ozawa wrote: Hey Akira, could you target the issues to 2.7.1? Thanks, - Tsuyoshi On Wed, Apr 15, 2015 at 2:51 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: +0 (non-binding) - Downloaded source - Built from source - Ran a pseudo-distributed cluster - Read documents downloaded from binary tarball - Looked Web UIs I found several issues to be fixed. - HDFS-8149: The footer of Web UI Hadoop, 2014 is old I'm thinking this is a regression from Hadoop 2.6.0. - HADOOP-11835: hadoop version outputs Subversion Unknown -r Unknown (Also, there are some Unknown version in Web UI) - HADOOP-11836: The content of index.html should be updated for 2.7.0. I'm thinking this two issues are not blocker. Regards, Akira On 4/15/15 11:05, Chris Nauroth wrote: +1 (binding) - Downloaded source tarball and verified signature and checksum. - Built from source, including native code on Linux and Windows. - Ran a 3-node unsecured cluster. - Tested various HDFS and YARN commands, including sample MapReduce jobs. - Confirmed that SecondaryNameNode can take a checkpoint. - HADOOP-9629: Tested integration with Azure storage as an alternative FileSystem. - HADOOP-11394/11395/11396: Built site docs and confirmed presence of these fixes in the documentation for Hadoop Compatible File Systems. - HDFS-7604: Confirmed presence of DataNode volume failure reporting in web UI and metrics. - HDFS-7879: Ran nm -g libhdfs.so and dumpbin /exports hdfs.dll to confirm export of public API symbols in libhdfs. Allen mentioned HDFS-8132, which reported a problem using JCarder on the build. Brahma, Todd and I have determined that root cause is incompatibility of the JCarder build with Java 7 classes. (2.7.0 is our first release compiling as Java 7.) This is not a problem that needs to hold up the release. Vinod, thank you for putting together the release. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/15/15, 7:07 AM, Mit Desai mitde...@yahoo-inc.com.INVALID wrote: +1 (non-binding) - Downloaded and built the source. - Deployed to a local cluster and ran sample jobls like sleepJob and Wordcount. - Verified Signatures - Verified the RM UI for correctness. Thanks Vinod for taking the time and effort to drive this release. -Mit Desai On Wednesday, April 15, 2015 8:03 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White patwh...@yahoo-inc.com.INVALID wrote: +1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5% tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a JDK difference, 2.6.0 ran with jdk1.7 while 2.7.0 had jdk1.8, so some of the improvement may be from Java 1.8.0, that said, the 2.7.0 benchmarks compare well against current 2.6.0. Thanks. patw - Forwarded Message - From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org athttps://repository.apache.org/content/repositories/orgapachehadoop-1017 / As discussed before - This release will only work with JDK 1.7 and above - I¹d like to use this as a starting release for 2.7.x [1], depending onhow it goes, get it stabilized and potentially use a 2.7.1 in a fewweeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (binding)Built the source from the tag and ran basic test on pseudo distributed cluster. Kihwal From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+0 (non-binding) - Downloaded source - Built from source - Ran a pseudo-distributed cluster - Read documents downloaded from binary tarball - Looked Web UIs I found several issues to be fixed. - HDFS-8149: The footer of Web UI Hadoop, 2014 is old I'm thinking this is a regression from Hadoop 2.6.0. - HADOOP-11835: hadoop version outputs Subversion Unknown -r Unknown (Also, there are some Unknown version in Web UI) - HADOOP-11836: The content of index.html should be updated for 2.7.0. I'm thinking this two issues are not blocker. Regards, Akira On 4/15/15 11:05, Chris Nauroth wrote: +1 (binding) - Downloaded source tarball and verified signature and checksum. - Built from source, including native code on Linux and Windows. - Ran a 3-node unsecured cluster. - Tested various HDFS and YARN commands, including sample MapReduce jobs. - Confirmed that SecondaryNameNode can take a checkpoint. - HADOOP-9629: Tested integration with Azure storage as an alternative FileSystem. - HADOOP-11394/11395/11396: Built site docs and confirmed presence of these fixes in the documentation for Hadoop Compatible File Systems. - HDFS-7604: Confirmed presence of DataNode volume failure reporting in web UI and metrics. - HDFS-7879: Ran nm -g libhdfs.so and dumpbin /exports hdfs.dll to confirm export of public API symbols in libhdfs. Allen mentioned HDFS-8132, which reported a problem using JCarder on the build. Brahma, Todd and I have determined that root cause is incompatibility of the JCarder build with Java 7 classes. (2.7.0 is our first release compiling as Java 7.) This is not a problem that needs to hold up the release. Vinod, thank you for putting together the release. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/15/15, 7:07 AM, Mit Desai mitde...@yahoo-inc.com.INVALID wrote: +1 (non-binding) - Downloaded and built the source. - Deployed to a local cluster and ran sample jobls like sleepJob and Wordcount. - Verified Signatures - Verified the RM UI for correctness. Thanks Vinod for taking the time and effort to drive this release. -Mit Desai On Wednesday, April 15, 2015 8:03 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White patwh...@yahoo-inc.com.INVALID wrote: +1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5% tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a JDK difference, 2.6.0 ran with jdk1.7 while 2.7.0 had jdk1.8, so some of the improvement may be from Java 1.8.0, that said, the 2.7.0 benchmarks compare well against current 2.6.0. Thanks. patw - Forwarded Message - From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org athttps://repository.apache.org/content/repositories/orgapachehadoop-1017 / As discussed before - This release will only work with JDK 1.7 and above - I¹d like to use this as a starting release for 2.7.x [1], depending onhow it goes, get it stabilized and potentially use a 2.7.1 in a fewweeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Hey Akira, could you target the issues to 2.7.1? Thanks, - Tsuyoshi On Wed, Apr 15, 2015 at 2:51 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jp wrote: +0 (non-binding) - Downloaded source - Built from source - Ran a pseudo-distributed cluster - Read documents downloaded from binary tarball - Looked Web UIs I found several issues to be fixed. - HDFS-8149: The footer of Web UI Hadoop, 2014 is old I'm thinking this is a regression from Hadoop 2.6.0. - HADOOP-11835: hadoop version outputs Subversion Unknown -r Unknown (Also, there are some Unknown version in Web UI) - HADOOP-11836: The content of index.html should be updated for 2.7.0. I'm thinking this two issues are not blocker. Regards, Akira On 4/15/15 11:05, Chris Nauroth wrote: +1 (binding) - Downloaded source tarball and verified signature and checksum. - Built from source, including native code on Linux and Windows. - Ran a 3-node unsecured cluster. - Tested various HDFS and YARN commands, including sample MapReduce jobs. - Confirmed that SecondaryNameNode can take a checkpoint. - HADOOP-9629: Tested integration with Azure storage as an alternative FileSystem. - HADOOP-11394/11395/11396: Built site docs and confirmed presence of these fixes in the documentation for Hadoop Compatible File Systems. - HDFS-7604: Confirmed presence of DataNode volume failure reporting in web UI and metrics. - HDFS-7879: Ran nm -g libhdfs.so and dumpbin /exports hdfs.dll to confirm export of public API symbols in libhdfs. Allen mentioned HDFS-8132, which reported a problem using JCarder on the build. Brahma, Todd and I have determined that root cause is incompatibility of the JCarder build with Java 7 classes. (2.7.0 is our first release compiling as Java 7.) This is not a problem that needs to hold up the release. Vinod, thank you for putting together the release. Chris Nauroth Hortonworks http://hortonworks.com/ On 4/15/15, 7:07 AM, Mit Desai mitde...@yahoo-inc.com.INVALID wrote: +1 (non-binding) - Downloaded and built the source. - Deployed to a local cluster and ran sample jobls like sleepJob and Wordcount. - Verified Signatures - Verified the RM UI for correctness. Thanks Vinod for taking the time and effort to drive this release. -Mit Desai On Wednesday, April 15, 2015 8:03 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Tx Pat. This is really interesting news! +Vinod On Apr 14, 2015, at 11:18 PM, Pat White patwh...@yahoo-inc.com.INVALID wrote: +1 non-binding Ran a performance comparison of 2.6.0 Latest with 2.7.0 RC, looks good, no regressions observed, most metrics are well within 5% tolerance (dfsio, sort, amrestart, gmv3) and some tests (scan, amscale, compression, shuffle) appear to have improvements. Disclaimer, please note a JDK difference, 2.6.0 ran with jdk1.7 while 2.7.0 had jdk1.8, so some of the improvement may be from Java 1.8.0, that said, the 2.7.0 benchmarks compare well against current 2.6.0. Thanks. patw - Forwarded Message - From: Vinod Kumar Vavilapalli vino...@apache.org To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Sent: Friday, April 10, 2015 6:44 PM Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org athttps://repository.apache.org/content/repositories/orgapachehadoop-1017 / As discussed before - This release will only work with JDK 1.7 and above - I¹d like to use this as a starting release for 2.7.x [1], depending onhow it goes, get it stabilized and potentially use a 2.7.1 in a fewweeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0http://markmail.org/thread/zwzze6cqqgwq4rmw
RE: [VOTE] Release Apache Hadoop 2.7.0 RC0
Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (non-binding) + verified signature and mds of source and binary tarball + built from source tarball + deployed binary tarball to 3 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 4/11/15 08:44, Vinod Kumar Vavilapalli wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (non-binding) + verified checksum + Deployed binary tarball, ran some examples, clicked around in the Web UIs thanks - Robert On Tue, Apr 14, 2015 at 10:22 AM, Masatake Iwasaki iwasak...@oss.nttdata.co.jp wrote: +1 (non-binding) + verified signature and mds of source and binary tarball + built from source tarball + deployed binary tarball to 3 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 4/11/15 08:44, Vinod Kumar Vavilapalli wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~ vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (binding) downloaded the source tar ball, built it, and ran some examples and distcp job. Thanks, -Jing On Tue, Apr 14, 2015 at 11:06 AM, Robert Kanter rkan...@cloudera.com wrote: +1 (non-binding) + verified checksum + Deployed binary tarball, ran some examples, clicked around in the Web UIs thanks - Robert On Tue, Apr 14, 2015 at 10:22 AM, Masatake Iwasaki iwasak...@oss.nttdata.co.jp wrote: +1 (non-binding) + verified signature and mds of source and binary tarball + built from source tarball + deployed binary tarball to 3 nodes cluster and run some hadoop-mapreduce-examples jobs Thanks, Masatake Iwasaki On 4/11/15 08:44, Vinod Kumar Vavilapalli wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~ vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
RE: [VOTE] Release Apache Hadoop 2.7.0 RC0
HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (Non-binding) + Built the source with Java 7 successfully + Deployed a single node cluster, and ran MR example jobs and DS jobs successfully + RM and ATS webUI showed the apps' information correctly Thanks Xuan Gong On 4/11/15, 9:30 PM, Zhijie Shen zs...@hortonworks.com wrote: +1 (Binding) + Downloaded the source tarball + Built the source with Java 7 successfully + Deployed a single node insecure cluster, and ran MR example jobs and DS jobs successfully, MR AM didn't hang + RM and TS webUI showed the apps' information correctly Thanks, Zhijie From: Wangda Tan wheele...@gmail.com Sent: Friday, April 10, 2015 5:25 PM To: yarn-...@hadoop.apache.org Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; Vinod Kumar Vavilapalli Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 +1 (Non-binding) Built from src, deployed a single node cluster, and tried to run some MR jobs. On Fri, Apr 10, 2015 at 4:44 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I¹d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1. (Non-binding) - Download hadoop-2.7.0-RC0-src.tar.gz and build locally. - Deploy a single node cluster and run some quota related hdfs/hadoop shell commands. - Run sample MR jobs. All basic tests result looks good to me. Thanks, Xiaoyu On 4/13/15, 5:43 AM, Junping Du j...@hortonworks.com wrote: +1. (Non-binding) - Download and verify the checksum on src and binary locally. - Deploy a single node cluster and play with simple MR jobs, i.e. PI, Terasort, etc. All looks fine for now. Thanks, Junping From: Vinod Kumar Vavilapalli vino...@apache.org Sent: Saturday, April 11, 2015 12:44 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I¹d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 non-binding build from source, deploy to a single node cluster, run wordcount, Terasort, etc. Also run Teragen using DockerContainerExecutor, works fine. Regards! Chen He On Mon, Apr 13, 2015 at 5:43 AM, Junping Du j...@hortonworks.com wrote: +1. (Non-binding) - Download and verify the checksum on src and binary locally. - Deploy a single node cluster and play with simple MR jobs, i.e. PI, Terasort, etc. All looks fine for now. Thanks, Junping From: Vinod Kumar Vavilapalli vino...@apache.org Sent: Saturday, April 11, 2015 12:44 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (non-binding) - Verified checksums on source and binary tar ball. - Built from source and launched single cluster. - Checked to launch some jobs successfully. - Killing application via RM UI. Thanks, - Tsuyoshi On Mon, Apr 13, 2015 at 7:43 AM, Junping Du j...@hortonworks.com wrote: +1. (Non-binding) - Download and verify the checksum on src and binary locally. - Deploy a single node cluster and play with simple MR jobs, i.e. PI, Terasort, etc. All looks fine for now. Thanks, Junping From: Vinod Kumar Vavilapalli vino...@apache.org Sent: Saturday, April 11, 2015 12:44 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
RE: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1(non-binding) Build from source, Deployed in 3 Node cluster Verified RM HA, RM Work preserving restart and NM restart features submitting simple MR Jobs And basic sanity testing is done. Thanks Regards Rohith Sharma K S -Original Message- From: Vinod Kumar Vavilapalli [mailto:vino...@apache.org] Sent: 11 April 2015 05:14 To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1. (Non-binding) - Download and verify the checksum on src and binary locally. - Deploy a single node cluster and play with simple MR jobs, i.e. PI, Terasort, etc. All looks fine for now. Thanks, Junping From: Vinod Kumar Vavilapalli vino...@apache.org Sent: Saturday, April 11, 2015 12:44 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Cc: vino...@apache.org Subject: [VOTE] Release Apache Hadoop 2.7.0 RC0 Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (binding) Arun On Fri, Apr 10, 2015 at 4:44 PM -0700, Vinod Kumar Vavilapalli vino...@apache.orgmailto:vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (Binding) + Downloaded the source tarball + Built the source with Java 7 successfully + Deployed a single node insecure cluster, and ran MR example jobs and DS jobs successfully, MR AM didn't hang + RM and TS webUI showed the apps' information correctly Thanks, Zhijie From: Wangda Tan wheele...@gmail.com Sent: Friday, April 10, 2015 5:25 PM To: yarn-...@hadoop.apache.org Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; Vinod Kumar Vavilapalli Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 +1 (Non-binding) Built from src, deployed a single node cluster, and tried to run some MR jobs. On Fri, Apr 10, 2015 at 4:44 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
[VOTE] Release Apache Hadoop 2.7.0 RC0
Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
+1 (Non-binding) Built from src, deployed a single node cluster, and tried to run some MR jobs. On Fri, Apr 10, 2015 at 4:44 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
