[jira] [Created] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

2015-04-09 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8117: --- Summary: More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data Key: HDFS-8117 URL: https://issues.apache.org/jira/browse/HDFS-8117 Proj

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Zhijie Shen
I meant we *haven't* done the compatibility check. From: Zhijie Shen Sent: Thursday, April 09, 2015 2:00 PM To: yarn-...@hadoop.apache.org; common-...@hadoop.apache.org Cc: hdfs-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org; Vinod Kumar Vavilapall

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Zhijie Shen
+1 for roll out 2.7.0 soon and continuing stabilization in 2.7.1. Agree with Karthik, it's better to exclude all improvements unless it turns out to blocking something. In terms of jdiff, we have done the compatibility check for quite a while in branch-2. Do we want to back port it to (some of)

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Mai Haohui
+1. It has been a long delay for 2.7.0. It's a good time to push it out. ~Haohui On Thu, Apr 9, 2015 at 12:56 PM, Steve Loughran wrote: > There's a couple of S3a fixes coming along which could go into a 2.7.1; > they've been held back to avoid rushing them in to 2.7.0 last-minute. > >> On 9 Apr

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Steve Loughran
There's a couple of S3a fixes coming along which could go into a 2.7.1; they've been held back to avoid rushing them in to 2.7.0 last-minute. > On 9 Apr 2015, at 20:33, Junping Du wrote: > > +1 (non-binding). > The plan sounds reasonable. We should make our release train more > fast-moving, a

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Junping Du
+1 (non-binding). The plan sounds reasonable. We should make our release train more fast-moving, and predictable - it could benefit our community and ecosystem in many aspects. Thanks, Junping From: Arpit Agarwal Sent: Thursday, April 09, 2015 8:23 PM T

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Arpit Agarwal
+1 for 2.7.1 and +1 for promoting it to 'stable', assuming it includes no new features or gratuitous improvements. Arpit On 4/9/15, 11:48 AM, "Vinod Kumar Vavilapalli" wrote: >Hi all, > >I feel like we haven't done a great job of maintaining the previous 2.x >releases. Seeing as how long 2

Re: 2.7 status

2015-04-09 Thread Arun Suresh
Vinod, Hmmm.. it is more a bug fix than an improvement. But if you feel this cant make it to 2.7.0, Then I guess it should be in 2.7.1 (Don't think it should wait till 2.8) -Arun On Thu, Apr 9, 2015 at 11:56 AM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote: > This seems like a follow

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Chris Nauroth
+1, full agreement with both Vinod and Karthik. Thanks! Chris Nauroth Hortonworks http://hortonworks.com/ On 4/9/15, 12:07 PM, "Karthik Kambatla" wrote: >Inline. > >On Thu, Apr 9, 2015 at 11:48 AM, Vinod Kumar Vavilapalli >> wrote: > >> Hi all, >> >> I feel like we haven't done a great jo

Re: A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Karthik Kambatla
Inline. On Thu, Apr 9, 2015 at 11:48 AM, Vinod Kumar Vavilapalli wrote: > Hi all, > > I feel like we haven't done a great job of maintaining the previous 2.x > releases. Seeing as how long 2.7.0 release has taken, I am sure we will > spend more time stabilizing it, fixing issues etc. > > I propo

Re: Removal of unused properties

2015-04-09 Thread Karthik Kambatla
Should be okay to remove. The policy was intended for configs that continue to be relevant like mapred.child.java.opts. In this case, since there is no TaskTracker anymore, leaving this config purely for compat reasons seems unnecessary. We could also improve the policies to clarify this. On Thu,

Re: 2.7 status

2015-04-09 Thread Vinod Kumar Vavilapalli
This seems like a follow up to a recently added feature. I see more of these type of patches for many new features added in 2.7.0. I'd like to avoid putting more into the already dragged on 2.7.0. We can do two things - I started an email thread on common-dev on 2.7.1. If this looks like a small

[jira] [Created] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

2015-04-09 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8116: Summary: RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug() Key: HDFS-8116 URL: https://issues.apache.org/jira/browse/HDFS-8116

A 2.7.1 release to follow up 2.7.0

2015-04-09 Thread Vinod Kumar Vavilapalli
Hi all, I feel like we haven't done a great job of maintaining the previous 2.x releases. Seeing as how long 2.7.0 release has taken, I am sure we will spend more time stabilizing it, fixing issues etc. I propose that we immediately follow up 2.7.0 with a 2.7.1 within 2-3 weeks. The focus obvious

Re: 2.7 status

2015-04-09 Thread Arun Suresh
Hey Vinod, I was wondering if you can include https://issues.apache.org/jira/browse/HDFS-8091 too.. Without it, i kinda makes https://issues.apache.org/jira/browse/HDFS-6826 incomplete.. Cheers -Arun Suresh On Thu, Apr 9, 2015 at 11:37 AM, Vinod Kumar Vavilapalli < vino...@hortonworks.com> wrote

[jira] [Resolved] (HDFS-7188) support build libhdfs3 on windows

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7188. Resolution: Fixed Fix Version/s: HDFS-6994 committed to HDFS-6994 > support b

Re: 2.7 status

2015-04-09 Thread Vinod Kumar Vavilapalli
Seems like they are already in, nothing more to do here.. +Vinod On Apr 1, 2015, at 7:45 PM, Zhijie Shen wrote: > Can we include YARN-3273 into 2.7? YARN-3430 needs it to fix the RM web UI > bug. > > Thanks, > Zhijie > > From: Vinod Kumar Vavilapalli

Re: 2.7 status

2015-04-09 Thread Vinod Kumar Vavilapalli
A couple of weeks late, but we are here. There is one last blocker that I am about to commit in a little while. I am starting the release process. +Vinod On Mar 25, 2015, at 9:53 AM, Vinod Kumar Vavilapalli wrote: > Progress has been really slow, but now we are down to four blockers across

[jira] [Created] (HDFS-8114) Erasure coding: Add auditlog FSNamesystem#createErasureCodingZone if this operation fails

2015-04-09 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8114: -- Summary: Erasure coding: Add auditlog FSNamesystem#createErasureCodingZone if this operation fails Key: HDFS-8114 URL: https://issues.apache.org/jira/browse/HDFS-8114 Project: Ha

Removal of unused properties

2015-04-09 Thread Akira AJISAKA
Hi Folks, In MAPREDUCE-6307, I'd like to remove unused "mapreduce.tasktracker.taskmemorymanager.monitoringinterval" property, however, the compatibility document says "Hadoop-defined properties are to be deprecated at least for one major release before being removed." http://hadoop.apache.or

Hadoop-Hdfs-trunk - Build # 2090 - Still Failing

2015-04-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2090/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5570 lines...] [INFO] [INFO] --- maven-enforcer-plugin:1

Build failed in Jenkins: Hadoop-Hdfs-trunk #2090

2015-04-09 Thread Apache Jenkins Server
See Changes: [aw] HADOOP-11781. fix race conditions and add URL support to smart-apply-patch.sh (Raymie Stata via aw) [wangda] YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda) [wangda] YA

Hadoop-Hdfs-trunk-Java8 - Build # 149 - Still Failing

2015-04-09 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/149/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5204 lines...] [INFO] [INFO] --- maven-enforcer-plu

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #149

2015-04-09 Thread Apache Jenkins Server
See Changes: [aw] HADOOP-11781. fix race conditions and add URL support to smart-apply-patch.sh (Raymie Stata via aw) [wangda] YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda) [wangd

[jira] [Created] (HDFS-8113) NullPointerException in BlockInfoContiguous causes block report failure

2015-04-09 Thread Chengbing Liu (JIRA)
Chengbing Liu created HDFS-8113: --- Summary: NullPointerException in BlockInfoContiguous causes block report failure Key: HDFS-8113 URL: https://issues.apache.org/jira/browse/HDFS-8113 Project: Hadoop HDF

[jira] [Created] (HDFS-8112) Enforce authorization policy to protect administration operations for EC zone and schemas

2015-04-09 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-8112: --- Summary: Enforce authorization policy to protect administration operations for EC zone and schemas Key: HDFS-8112 URL: https://issues.apache.org/jira/browse/HDFS-8112 Project:

[jira] [Resolved] (HDFS-8109) ECManager should be able to manage multiple ECSchemas

2015-04-09 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8109. - Resolution: Duplicate > ECManager should be able to manage multiple ECSchemas > ---

[jira] [Created] (HDFS-8111) NPE thrown when invalid FSImage filename given for "hdfs oiv_legacy" cmd

2015-04-09 Thread Archana T (JIRA)
Archana T created HDFS-8111: --- Summary: NPE thrown when invalid FSImage filename given for "hdfs oiv_legacy" cmd Key: HDFS-8111 URL: https://issues.apache.org/jira/browse/HDFS-8111 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-8104) Make hard-coded values consistent with the system default schema first before remove them

2015-04-09 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8104. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > Make hard-coded values cons