Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-01-09 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/

[Jan 8, 2018 9:20:17 PM] (billie) YARN-7704. Document improvement for registry 
dns. Contributed by Jian He
[Jan 8, 2018 10:25:39 PM] (weiy) HDFS-12945. Switch to ClientProtocol instead 
of NamenodeProtocols in
[Jan 8, 2018 11:34:00 PM] (manojpec) HDFS-12985. NameNode crashes during 
restart after an OpenForWrite file
[Jan 9, 2018 12:19:02 AM] (rchiang) YARN-4227. Ignore expired containers from 
removed nodes in
[Jan 9, 2018 1:51:09 AM] (inigoiri) HDFS-12808. Add LOG.isDebugEnabled() guard 
for LOG.debug(...).




-1 overall


The following subsystems voted -1:
asflicense findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api 
   org.apache.hadoop.yarn.api.records.Resource.getResources() may expose 
internal representation by returning Resource.resources At Resource.java:by 
returning Resource.resources At Resource.java:[line 234] 

Failed junit tests :

   hadoop.security.TestRaceWhenRelogin 
   hadoop.hdfs.TestReadStripedFileWithMissingBlocks 
   hadoop.hdfs.TestErasureCodingMultipleRacks 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.server.namenode.TestFSImage 
   hadoop.yarn.server.nodemanager.webapp.TestContainerLogsPage 
   hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.client.api.impl.TestAMRMClientOnRMRestart 
   hadoop.mapreduce.v2.app.rm.TestRMContainerAllocator 
   hadoop.mapreduce.v2.TestUberAM 
   hadoop.yarn.sls.nodemanager.TestNMSimulator 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-compile-javac-root.txt
  [280K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-checkstyle-root.txt
  [17M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-patch-shelldocs.txt
  [12K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/whitespace-eol.txt
  [9.2M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/whitespace-tabs.txt
  [292K]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api-warnings.html
  [8.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/diff-javadoc-javadoc-root.txt
  [760K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [156K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [256K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [44K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [76K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
  [20K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt
  [108K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [84K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt
  [12K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/651/artifac

Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Lei Xu
Hi, All

We have released Apache Hadoop 3.0.0 in December [1]. To further
improve the quality of release, we plan to cut branch-3.0.1 branch
tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus
of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes
[2].  No new features and improvement should be included.

We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb
1st, targeting for Feb 9th release.

Please feel free to share your insights.

[1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html
[2] https://issues.apache.org/jira/issues/?filter=12342842

Best,
-- 
Lei (Eddy) Xu
Software Engineer, Cloudera

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Andrew Wang
Hi Eddy, thanks for taking this on,

Historically we've waited for the first RC to cut the release branch since
it keeps things simpler for committers.

Also, could you check the permissions on your JIRA filter? It shows as
private for me.

Best,
Andrew

On Tue, Jan 9, 2018 at 11:17 AM, Lei Xu  wrote:

> Hi, All
>
> We have released Apache Hadoop 3.0.0 in December [1]. To further
> improve the quality of release, we plan to cut branch-3.0.1 branch
> tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus
> of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes
> [2].  No new features and improvement should be included.
>
> We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb
> 1st, targeting for Feb 9th release.
>
> Please feel free to share your insights.
>
> [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html
> [2] https://issues.apache.org/jira/issues/?filter=12342842
>
> Best,
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> -
> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
>
>


Re: Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Jason Lowe
Is it necessary to cut the branch so far ahead of the release?  branch-3.0
is already a maintenance line for 3.0.x releases.  Is there a known
feature/improvement planned to go into branch-3.0 that is not desirable for
the 3.0.1 release?

I have found in the past that branching so early leads to many useful fixes
being unnecessarily postponed to future releases because committers forget
to pick to the new, relatively long-lived patch branch.  This becomes
especially true if blockers end up dragging out the ultimate release date,
which has historically been quite common.  My preference would be to cut
this branch as close to the RC as possible.

Jason


On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu  wrote:

> Hi, All
>
> We have released Apache Hadoop 3.0.0 in December [1]. To further
> improve the quality of release, we plan to cut branch-3.0.1 branch
> tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus
> of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes
> [2].  No new features and improvement should be included.
>
> We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb
> 1st, targeting for Feb 9th release.
>
> Please feel free to share your insights.
>
> [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html
> [2] https://issues.apache.org/jira/issues/?filter=12342842
>
> Best,
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> -
> To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
>
>


Re: Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Lei Xu
Hi, Andrew and Jason

Thanks for the feedback!

I will follow the pattern and cut the branch on Feb 1st and start the
RC vote around Feb 5th then.

Best

On Tue, Jan 9, 2018 at 11:35 AM, Jason Lowe  wrote:
> Is it necessary to cut the branch so far ahead of the release?  branch-3.0
> is already a maintenance line for 3.0.x releases.  Is there a known
> feature/improvement planned to go into branch-3.0 that is not desirable for
> the 3.0.1 release?
>
> I have found in the past that branching so early leads to many useful fixes
> being unnecessarily postponed to future releases because committers forget
> to pick to the new, relatively long-lived patch branch.  This becomes
> especially true if blockers end up dragging out the ultimate release date,
> which has historically been quite common.  My preference would be to cut
> this branch as close to the RC as possible.
>
> Jason
>
>
> On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu  wrote:
>>
>> Hi, All
>>
>> We have released Apache Hadoop 3.0.0 in December [1]. To further
>> improve the quality of release, we plan to cut branch-3.0.1 branch
>> tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus
>> of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes
>> [2].  No new features and improvement should be included.
>>
>> We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb
>> 1st, targeting for Feb 9th release.
>>
>> Please feel free to share your insights.
>>
>> [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html
>> [2] https://issues.apache.org/jira/issues/?filter=12342842
>>
>> Best,
>> --
>> Lei (Eddy) Xu
>> Software Engineer, Cloudera
>>
>> -
>> To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
>>
>



-- 
Lei (Eddy) Xu
Software Engineer, Cloudera

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: Apache Hadoop 3.0.1 Release plan

2018-01-09 Thread Lei Xu
Hi, Andrew and Jason

Thanks for the feedback!

I will follow the pattern and cut the branch on Feb 1st and start the
RC vote around Feb 5th then.

Best

On Tue, Jan 9, 2018 at 11:35 AM, Jason Lowe  wrote:
> Is it necessary to cut the branch so far ahead of the release?  branch-3.0
> is already a maintenance line for 3.0.x releases.  Is there a known
> feature/improvement planned to go into branch-3.0 that is not desirable for
> the 3.0.1 release?
>
> I have found in the past that branching so early leads to many useful fixes
> being unnecessarily postponed to future releases because committers forget
> to pick to the new, relatively long-lived patch branch.  This becomes
> especially true if blockers end up dragging out the ultimate release date,
> which has historically been quite common.  My preference would be to cut
> this branch as close to the RC as possible.
>
> Jason
>
>
> On Tue, Jan 9, 2018 at 1:17 PM, Lei Xu  wrote:
>>
>> Hi, All
>>
>> We have released Apache Hadoop 3.0.0 in December [1]. To further
>> improve the quality of release, we plan to cut branch-3.0.1 branch
>> tomorrow for the preparation of Apache Hadoop 3.0.1 release. The focus
>> of 3.0.1 will be fixing blockers (3), critical bugs (1) and bug fixes
>> [2].  No new features and improvement should be included.
>>
>> We plan to cut branch-3.0.1 tomorrow (Jan 10th) and vote for RC on Feb
>> 1st, targeting for Feb 9th release.
>>
>> Please feel free to share your insights.
>>
>> [1] https://www.mail-archive.com/general@hadoop.apache.org/msg07757.html
>> [2] https://issues.apache.org/jira/issues/?filter=12342842
>>
>> Best,
>> --
>> Lei (Eddy) Xu
>> Software Engineer, Cloudera
>>
>> -
>> To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
>>
>



-- 
Lei (Eddy) Xu
Software Engineer, Cloudera

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-01-09 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/

[Jan 9, 2018 11:09:33 AM] (sunilg) YARN-7718. DistributedShell failed to 
specify resource other than
[Jan 9, 2018 12:27:01 PM] (bibinchundatt) YARN-7508. NPE in FiCaSchedulerApp 
when debug log enabled in
[Jan 9, 2018 3:52:59 PM] (jlowe) YARN-7663. RMAppImpl:Invalid event: START at 
KILLED. Contributed by




-1 overall


The following subsystems voted -1:
asflicense findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api 
   org.apache.hadoop.yarn.api.records.Resource.getResources() may expose 
internal representation by returning Resource.resources At Resource.java:by 
returning Resource.resources At Resource.java:[line 234] 

Failed junit tests :

   hadoop.hdfs.TestErasureCodingPoliciesWithRandomECPolicy 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.TestReadStripedFileWithMissingBlocks 
   hadoop.hdfs.TestLeaseRecovery2 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure070 
   hadoop.hdfs.TestReconstructStripedFile 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage 
   hadoop.hdfs.TestBlockStoragePolicy 
   hadoop.hdfs.TestErasureCodingMultipleRacks 
   hadoop.hdfs.TestDFSInotifyEventInputStream 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.TestDecommission 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-compile-javac-root.txt
  [280K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-checkstyle-root.txt
  [17M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-patch-shelldocs.txt
  [12K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/whitespace-eol.txt
  [9.2M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/whitespace-tabs.txt
  [292K]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api-warnings.html
  [8.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/diff-javadoc-javadoc-root.txt
  [760K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [556K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-common.txt
  [72K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-web-proxy.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [4.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/652/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop