Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-04-27 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/385/

[Apr 21, 2017 6:35:36 PM] (wang) HADOOP-14261. Some refactoring work for 
erasure coding raw coder.
[Apr 21, 2017 8:36:31 PM] (yzhang) HDFS-11689. New exception thrown by 
DFSClient%isHDFSEncryptionEnabled
[Apr 21, 2017 11:12:01 PM] (rkanter) MAPREDUCE-6871. Allow users to specify 
racks and nodes for strict
[Apr 22, 2017 3:35:48 AM] (yzhang) HDFS-11402. HDFS Snapshots should capture 
point-in-time copies of OPEN
[Apr 22, 2017 9:56:48 AM] (jzhuge) HDFS-11529. Add libHDFS API to return last 
exception. Contributed by
[Apr 24, 2017 7:58:57 AM] (sunilg) YARN-6291. Introduce query parameters (sort, 
filter, etc.) for tables to
[Apr 24, 2017 5:03:28 PM] (epayne) YARN-5617. AMs only intended to run one 
attempt can be run more than
[Apr 24, 2017 6:37:52 PM] (haibochen) YARN-6500. Do not mount inaccessible 
cgroups directories in
[Apr 24, 2017 7:33:19 PM] (stevel) HADOOP-14305 S3A SSE tests won't run in 
parallel: Bad request in
[Apr 24, 2017 8:17:35 PM] (wangda) YARN-6392. Add submit time to Application 
Summary log. (Zhihai Xu via
[Apr 25, 2017 10:30:42 PM] (jlowe) HDFS-11691. Add a proper scheme to the 
datanode links in NN web UI.
[Apr 25, 2017 11:26:09 PM] (rkanter) YARN-6423. Queue metrics doesn't work for 
Fair Scheduler in SLS (yufeigu
[Apr 26, 2017 1:33:41 AM] (liuml07) HADOOP-12856. FileUtil.checkDest() and 
RawLocalFileSystem.mkdirs() to
[Apr 26, 2017 1:45:56 AM] (xyao) HADOOP-14207. "dfsadmin -refreshCallQueue" 
fails with DecayRpcScheduler.
[Apr 26, 2017 3:54:56 AM] (liuml07) HADOOP-14349. Rename ADLS 
CONTRACT_ENABLE_KEY. Contributed by Mingliang
[Apr 26, 2017 5:06:51 AM] (jzhuge) HADOOP-14341. Support multi-line value for
[Apr 26, 2017 6:34:23 AM] (aajisaka) Revert "YARN-5007. Remove deprecated 
constructors of MiniYARNCluster and
[Apr 26, 2017 6:57:00 AM] (cdouglas) HDFS-6708. StorageType should be encoded 
in the block token. Contributed
[Apr 26, 2017 8:43:29 AM] (aajisaka) HDFS-11417. Add datanode admin command to 
get the storage info.
[Apr 26, 2017 6:44:59 PM] (jzhuge) HADOOP-14340. Enable KMS and HttpFS to 
exclude SSL ciphers. Contributed
[Apr 26, 2017 6:46:55 PM] (haibochen) YARN-6510. Fix profs stat file warning 
caused by process names that
[Apr 26, 2017 8:47:18 PM] (liuml07) HADOOP-14351. Azure: 
RemoteWasbAuthorizerImpl and
[Apr 27, 2017 12:28:49 AM] (shv) HDFS-11384. Balancer disperses getBlocks calls 
to avoid NameNode's rpc
[Apr 27, 2017 6:45:33 AM] (aajisaka) MAPREDUCE-6881. Fix warnings from Spotbugs 
in hadoop-mapreduce.
[Apr 27, 2017 7:12:27 AM] (aajisaka) HDFS-11697. Add javadoc for storage policy 
and erasure coding policy.
[Apr 27, 2017 7:57:08 AM] (aajisaka) HADOOP-11614. Remove httpclient dependency 
from hadoop-openstack.
[Apr 27, 2017 9:31:58 AM] (varunsaxena) YARN-6455. Enhance the 
timelinewriter.flush() race condition fix (Haibo
[Apr 27, 2017 11:19:04 AM] (stevel) HADOOP-14346. CryptoOutputStream throws 
IOException if stream is closed.




-1 overall


The following subsystems voted -1:
asflicense findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-common-project/hadoop-minikdc 
   Possible null pointer dereference in 
org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value of called 
method Dereferenced at 
MiniKdc.java:org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value 
of called method Dereferenced at MiniKdc.java:[line 368] 

FindBugs :

   module:hadoop-common-project/hadoop-auth 
   
org.apache.hadoop.security.authentication.server.MultiSchemeAuthenticationHandler.authenticate(HttpServletRequest,
 HttpServletResponse) makes inefficient use of keySet iterator instead of 
entrySet iterator At MultiSchemeAuthenticationHandler.java:of keySet iterator 
instead of entrySet iterator At MultiSchemeAuthenticationHandler.java:[line 
192] 

FindBugs :

   module:hadoop-common-project/hadoop-common 
   org.apache.hadoop.crypto.CipherSuite.setUnknownValue(int) 
unconditionally sets the field unknownValue At CipherSuite.java:unknownValue At 
CipherSuite.java:[line 44] 
   org.apache.hadoop.crypto.CryptoProtocolVersion.setUnknownValue(int) 
unconditionally sets the field unknownValue At 
CryptoProtocolVersion.java:unknownValue At CryptoProtocolVersion.java:[line 67] 
   Possible null pointer dereference in 
org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to return value of 
called method Dereferenced at 
FileUtil.java:org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to 
return value of called method Dereferenced at FileUtil.java:[line 118] 
   Possible null pointer dereference in 
org.apache.hadoop.fs.RawLocalFileSystem.handleEmptyDstDir

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2017-04-27 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/296/

[Apr 21, 2017 6:35:36 PM] (wang) HADOOP-14261. Some refactoring work for 
erasure coding raw coder.
[Apr 21, 2017 8:36:31 PM] (yzhang) HDFS-11689. New exception thrown by 
DFSClient%isHDFSEncryptionEnabled
[Apr 21, 2017 11:12:01 PM] (rkanter) MAPREDUCE-6871. Allow users to specify 
racks and nodes for strict
[Apr 22, 2017 3:35:48 AM] (yzhang) HDFS-11402. HDFS Snapshots should capture 
point-in-time copies of OPEN
[Apr 22, 2017 9:56:48 AM] (jzhuge) HDFS-11529. Add libHDFS API to return last 
exception. Contributed by
[Apr 24, 2017 7:58:57 AM] (sunilg) YARN-6291. Introduce query parameters (sort, 
filter, etc.) for tables to
[Apr 24, 2017 5:03:28 PM] (epayne) YARN-5617. AMs only intended to run one 
attempt can be run more than
[Apr 24, 2017 6:37:52 PM] (haibochen) YARN-6500. Do not mount inaccessible 
cgroups directories in
[Apr 24, 2017 7:33:19 PM] (stevel) HADOOP-14305 S3A SSE tests won't run in 
parallel: Bad request in
[Apr 24, 2017 8:17:35 PM] (wangda) YARN-6392. Add submit time to Application 
Summary log. (Zhihai Xu via
[Apr 25, 2017 10:30:42 PM] (jlowe) HDFS-11691. Add a proper scheme to the 
datanode links in NN web UI.
[Apr 25, 2017 11:26:09 PM] (rkanter) YARN-6423. Queue metrics doesn't work for 
Fair Scheduler in SLS (yufeigu
[Apr 26, 2017 1:33:41 AM] (liuml07) HADOOP-12856. FileUtil.checkDest() and 
RawLocalFileSystem.mkdirs() to
[Apr 26, 2017 1:45:56 AM] (xyao) HADOOP-14207. "dfsadmin -refreshCallQueue" 
fails with DecayRpcScheduler.
[Apr 26, 2017 3:54:56 AM] (liuml07) HADOOP-14349. Rename ADLS 
CONTRACT_ENABLE_KEY. Contributed by Mingliang
[Apr 26, 2017 5:06:51 AM] (jzhuge) HADOOP-14341. Support multi-line value for
[Apr 26, 2017 6:34:23 AM] (aajisaka) Revert "YARN-5007. Remove deprecated 
constructors of MiniYARNCluster and
[Apr 26, 2017 6:57:00 AM] (cdouglas) HDFS-6708. StorageType should be encoded 
in the block token. Contributed
[Apr 26, 2017 8:43:29 AM] (aajisaka) HDFS-11417. Add datanode admin command to 
get the storage info.
[Apr 26, 2017 6:44:59 PM] (jzhuge) HADOOP-14340. Enable KMS and HttpFS to 
exclude SSL ciphers. Contributed
[Apr 26, 2017 6:46:55 PM] (haibochen) YARN-6510. Fix profs stat file warning 
caused by process names that
[Apr 26, 2017 8:47:18 PM] (liuml07) HADOOP-14351. Azure: 
RemoteWasbAuthorizerImpl and
[Apr 27, 2017 12:28:49 AM] (shv) HDFS-11384. Balancer disperses getBlocks calls 
to avoid NameNode's rpc
[Apr 27, 2017 6:45:33 AM] (aajisaka) MAPREDUCE-6881. Fix warnings from Spotbugs 
in hadoop-mapreduce.
[Apr 27, 2017 7:12:27 AM] (aajisaka) HDFS-11697. Add javadoc for storage policy 
and erasure coding policy.
[Apr 27, 2017 7:57:08 AM] (aajisaka) HADOOP-11614. Remove httpclient dependency 
from hadoop-openstack.
[Apr 27, 2017 9:31:58 AM] (varunsaxena) YARN-6455. Enhance the 
timelinewriter.flush() race condition fix (Haibo
[Apr 27, 2017 11:19:04 AM] (stevel) HADOOP-14346. CryptoOutputStream throws 
IOException if stream is closed.




-1 overall


The following subsystems voted -1:
compile mvninstall unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.ha.TestZKFailoverControllerStress 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure 
   hadoop.hdfs.TestReadStripedFileWithMissingBlocks 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.server.blockmanagement.TestBlockManager 
   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090 
   hadoop.hdfs.TestDFSRSDefault10x4StripedOutputStreamWithFailure 
   hadoop.hdfs.TestRollingUpgrade 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.server.datanode.TestDataNodeUUID 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 
   hadoop.mapred.TestShuffleHandler 
   hadoop.tools.TestHadoopArchiveLogsRunner 
   hadoop.metrics2.impl.TestKafkaMetrics 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.yarn.client.api.impl.TestAMRMClient 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.ti

[jira] [Created] (YARN-6537) Consider running RM tests against the Router

2017-04-27 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6537:
--

 Summary: Consider running RM tests against the Router
 Key: YARN-6537
 URL: https://issues.apache.org/jira/browse/YARN-6537
 Project: Hadoop YARN
  Issue Type: Sub-task
  Components: federation, resourcemanager
Reporter: Giovanni Matteo Fumarola
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org



[jira] [Resolved] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-27 Thread Junping Du (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Junping Du resolved YARN-5007.
--
Resolution: Later
  Assignee: (was: Andras Bokor)

> Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster
> ---
>
> Key: YARN-5007
> URL: https://issues.apache.org/jira/browse/YARN-5007
> Project: Hadoop YARN
>  Issue Type: Test
>Reporter: Andras Bokor
>  Labels: oct16-easy
> Attachments: YARN-5007.01.patch, YARN-5007.02.patch, 
> YARN-5007.03.patch
>
>
> MiniYarnCluster has a deprecated constructor which is called by the other 
> constructors and it causes javac warnings during the build.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org



[jira] [Created] (YARN-6536) TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently

2017-04-27 Thread Eric Badger (JIRA)
Eric Badger created YARN-6536:
-

 Summary: TestAMRMClient.testAMRMClientWithSaslEncryption fails 
intermittently
 Key: YARN-6536
 URL: https://issues.apache.org/jira/browse/YARN-6536
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Eric Badger


{noformat}
java.lang.AssertionError: expected:<2> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at org.junit.Assert.assertEquals(Assert.java:542)
at 
org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.testAllocation(TestAMRMClient.java:1005)
at 
org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.registerAndAllocate(TestAMRMClient.java:703)
at 
org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.testAMRMClientWithSaslEncryption(TestAMRMClient.java:675)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org



Re: About 2.7.4 Release

2017-04-27 Thread Akira Ajisaka

Thanks Allen for the additional information.

> At one point, JIRA was configured to refuse re-opening after a 
release is cut.


In the past, release manager closed the tickets and the process is 
written in the wiki: https://wiki.apache.org/hadoop/HowToRelease


> 10. In JIRA, close issues resolved in the release. Disable mail 
notifications for this bulk change.


Therefore, let's close them.

On 2017/04/27 3:01, Allen Wittenauer wrote:



On Apr 25, 2017, at 12:35 AM, Akira Ajisaka  wrote:

Maybe we should create a jira to track this?


I think now either way (reopen or create) is fine.

Release doc maker creates change logs by fetching information from JIRA, so 
reopening the tickets should be avoided when a release process is in progress.



Keep in mind that the release documentation is part of the build 
process.  Users who are doing their own builds will have incomplete 
documentation if we keep re-opening JIRAs after a release.  At one point, JIRA 
was configured to refuse re-opening after a release is cut.  I'm not sure why 
it stopped doing that, but it might be time to see if we can re-enable that 
functionality.


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org