[jira] [Created] (MAPREDUCE-7201) Make Job History File Permissions configurable

2019-05-03 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created MAPREDUCE-7201:


 Summary: Make Job History File Permissions configurable
 Key: MAPREDUCE-7201
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7201
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
  Components: jobhistoryserver
Affects Versions: 3.2.0
Reporter: Prabhu Joseph
Assignee: Prabhu Joseph


Job History File Permissions are hardcoded to 770. MAPREDUCE-7010 allows to 
configure the intermediate user directory permission but still the jhist file 
permission are not changed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-05-03 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1125/

[May 2, 2019 4:51:11 AM] (bharat) HDDS-1483. Fix getMultipartKey javadoc. (#790)
[May 2, 2019 9:18:54 AM] (elek) HDDS-1412. Provide example k8s deployment files 
as part of the release
[May 2, 2019 9:23:44 AM] (elek) HDDS-1478. Provide k8s resources files for 
prometheus and performance
[May 2, 2019 9:35:01 AM] (elek) HDDS-1468. Inject configuration values to Java 
objects
[May 2, 2019 9:49:37 AM] (elek) HDDS-1479. Update S3.md documentation
[May 2, 2019 10:14:43 AM] (elek) HDDS-1469. Generate default configuration 
fragments based on annotations
[May 2, 2019 11:56:30 AM] (elek) HDDS-1482. Use strongly typed codec 
implementations for the S3Table
[May 2, 2019 2:48:30 PM] (elek) HADOOP-16183. Use latest Yetus to support ozone 
specific build process
[May 2, 2019 5:09:21 PM] (inigoiri) HDFS-14460. DFSUtil#getNamenodeWebAddr 
should return HTTPS address based
[May 2, 2019 7:39:26 PM] (ericp) YARN-9285: RM UI progress column is of wrong 
type. Contributed by  Ahmed
[May 2, 2019 7:58:42 PM] (gifuma) HADOOP-16282. Avoid FileStream to improve 
performance. Contributed by
[May 2, 2019 8:59:14 PM] (koneru.hanisha) HDDS-1473. DataNode ID file should be 
human readable. (#781)
[May 2, 2019 9:25:02 PM] (weichiu) HDFS-14453. Improve Bad Sequence Number 
Error Message. Contributed by




-1 overall


The following subsystems voted -1:
asflicense findbugs hadolint pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   
module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-documentstore
 
   Unread field:TimelineEventSubDoc.java:[line 56] 
   Unread field:TimelineMetricSubDoc.java:[line 44] 

FindBugs :

   
module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core
 
   Class org.apache.hadoop.applications.mawo.server.common.TaskStatus 
implements Cloneable but does not define or use clone method At 
TaskStatus.java:does not define or use clone method At TaskStatus.java:[lines 
39-346] 
   Equals method for 
org.apache.hadoop.applications.mawo.server.worker.WorkerId assumes the argument 
is of type WorkerId At WorkerId.java:the argument is of type WorkerId At 
WorkerId.java:[line 114] 
   
org.apache.hadoop.applications.mawo.server.worker.WorkerId.equals(Object) does 
not check for null argument At WorkerId.java:null argument At 
WorkerId.java:[lines 114-115] 

Failed junit tests :

   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.server.balancer.TestBalancer 
   hadoop.yarn.client.api.impl.TestTimelineClientV2Impl 
   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices 
   hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2 
   hadoop.yarn.client.cli.TestLogsCLI 
   hadoop.yarn.client.api.impl.TestAMRMClient 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapreduce.v2.app.TestRuntimeEstimators 
   hadoop.hdds.scm.container.TestContainerStateManagerIntegration 
   hadoop.hdds.scm.safemode.TestSCMSafeModeWithPipelineRules 
   hadoop.ozone.om.TestMultipleContainerReadWrite 
   hadoop.ozone.client.rpc.TestContainerStateMachineFailures 
   hadoop.ozone.web.client.TestBuckets 
   hadoop.ozone.TestStorageContainerManager 
   hadoop.ozone.client.rpc.TestBCSID 
   hadoop.ozone.om.TestOmMetrics 
   hadoop.ozone.scm.TestXceiverClientManager 
   hadoop.ozone.client.rpc.TestBlockOutputStreamWithFailures 
   hadoop.ozone.om.TestOmAcls 
   hadoop.hdds.scm.pipeline.TestRatisPipelineUtils 
   hadoop.ozone.web.client.TestKeys 
   
hadoop.ozone.container.common.statemachine.commandhandler.TestCloseContainerByPipeline
 
   hadoop.ozone.scm.node.TestQueryNode 
   hadoop.ozone.om.TestContainerReportWithKeys 
   hadoop.ozone.container.TestContainerReplication 
   hadoop.ozone.client.rpc.TestReadRetries 
   hadoop.ozone.web.TestOzoneVolumes 
   hadoop.ozone.client.rpc.TestOzoneClientRetriesOnException 
   hadoop.ozone.om.TestScmSafeMode 
   hadoop.ozone.om.TestOMDbCheckpointServlet 
   hadoop.ozone.om.TestOzoneManagerHA 
   hadoop.ozone.scm.TestSCMMXBean 
   hadoop.ozone.om.TestOmBlockVersioning 
   hadoop.ozone.om.TestOzoneManagerRestInterface 
   hadoop.ozone.scm.pipeline.TestSCMPipelineMetrics 
   hadoop.ozone.scm.TestSCMNodeManagerMXBean 
   hadoop.ozone.TestMiniOzoneCluster 
   hadoop.hdds.scm.pipeline.TestNodeFailure 
   hadoop.fs.ozone.contract.ITestOzoneContractRename 
   hadoop.fs.ozone.contract.ITestOzoneContractRootDir 

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-05-03 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/

No changes




-1 overall


The following subsystems voted -1:
asflicense findbugs hadolint pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml
 
   hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml 
   hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml
 

FindBugs :

   module:hadoop-common-project/hadoop-common 
   Class org.apache.hadoop.fs.GlobalStorageStatistics defines non-transient 
non-serializable instance field map In GlobalStorageStatistics.java:instance 
field map In GlobalStorageStatistics.java 

FindBugs :

   
module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client
 
   Boxed value is unboxed and then immediately reboxed in 
org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result,
 byte[], byte[], KeyConverter, ValueConverter, boolean) At 
ColumnRWHelper.java:then immediately reboxed in 
org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result,
 byte[], byte[], KeyConverter, ValueConverter, boolean) At 
ColumnRWHelper.java:[line 335] 

Failed junit tests :

   hadoop.hdfs.TestSetrepIncreasing 
   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.TestFileCorruption 
   hadoop.registry.secure.TestSecureLogins 
   hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-compile-cc-root-jdk1.7.0_95.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-compile-javac-root-jdk1.7.0_95.txt
  [328K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-compile-cc-root-jdk1.8.0_191.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-compile-javac-root-jdk1.8.0_191.txt
  [308K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-checkstyle-root.txt
  [16M]

   hadolint:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   pathlen:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-patch-shellcheck.txt
  [72K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-patch-shelldocs.txt
  [8.0K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/whitespace-eol.txt
  [12M]
   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/whitespace-tabs.txt
  [1.2M]

   xml:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/xml.txt
  [12K]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase_hadoop-yarn-server-timelineservice-hbase-client-warnings.html
  [8.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-javadoc-javadoc-root-jdk1.7.0_95.txt
  [16K]
   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/diff-javadoc-javadoc-root-jdk1.8.0_191.txt
  [1.1M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [292K]
   
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/310/artifact/out/patch-unit-hadoo