[jira] [Created] (HADOOP-16952) ADD .diff to gitignore
Ayush Saxena created HADOOP-16952: - Summary: ADD .diff to gitignore Key: HADOOP-16952 URL: https://issues.apache.org/jira/browse/HADOOP-16952 Project: Hadoop Common Issue Type: Improvement Reporter: Ayush Saxena Assignee: Ayush Saxena Add .diff to gitignore. Else on git add . it even stages the .diff files too. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16951) Tidy Up Text and ByteWritables Class
David Mollitor created HADOOP-16951:
---
Summary: Tidy Up Text and ByteWritables Class
Key: HADOOP-16951
URL: https://issues.apache.org/jira/browse/HADOOP-16951
Project: Hadoop Common
Issue Type: Improvement
Components: common
Reporter: David Mollitor
Assignee: David Mollitor
# Remove superfluous code
# Remove superfluous comments
# Checkstyle fixes
# Remove methods that simply call {{super}}.method()
# Use Java 8 facilities to streamline code where applicable
# Simplify and unify some of the constructs between the two classes
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Hadoop Storage community call
Thanks Gabor for today's discussion. Please find the recording here: https://cloudera.zoom.us/rec/play/6ccrJOiuqD43SdeUsQSDVvQvW9S8LK6s0CRK-fsNzkazViNQNAGlMudGN7dEOJ4JkMw9i6ZXHCbML8l9?continueMode=true https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing 4/1/2020 Speaker: Gabor Participants: Weichiu, Chen, Clay, Fabbri, Kevin, Mukund, Stephen, Steve, Brahma S3Guard no longer experimental S3 behavior caveats -- inconsistency, caching S3A new features in Hadoop 3.3 → delegation token, etags and versioning, openssl support, s3 select, better delete throttling to avoid thundering herd effect, S3Guard Fsck Future: IOStatistics, Vectored IO On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang wrote: > Hi! > > For the bi-weekly Hadoop Storage community next week, we'll do something > different this time: > > Gabor Bota is going to talk about "404 Not Found" -- New and old issues > with S3A; Current state and what's next. > > Stay tuned. Looking forward to seeing more cloud connector topics in the > future. > > April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm > > > Please join via Zoom: > https://cloudera.zoom.us/j/880548968 > > Past meeting minutes > > https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit > >
[jira] [Resolved] (HADOOP-14748) Wasb input streams to implement CanUnbuffer
[
https://issues.apache.org/jira/browse/HADOOP-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-14748.
-
Resolution: Won't Fix
> Wasb input streams to implement CanUnbuffer
> ---
>
> Key: HADOOP-14748
> URL: https://issues.apache.org/jira/browse/HADOOP-14748
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
>Affects Versions: 2.9.0
>Reporter: Steve Loughran
>Priority: Minor
>
> HBase relies on FileSystems implementing {{CanUnbuffer.unbuffer()}} to force
> input streams to free up remote connections (HBASE-9393Link). This works for
> HDFS, but not elsewhere.
> WASB {{BlockBlobInputStream}} can implement this by closing the stream in
> {{closeBlobInputStream}}, so it will be re-opened elsewhere.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Hadoop Storage community call
Reminder -- this call is happening in about 2 hours. Stay safe! Weichiu On Tue, Mar 24, 2020 at 5:44 PM Wei-Chiu Chuang wrote: > Hi! > > For the bi-weekly Hadoop Storage community next week, we'll do something > different this time: > > Gabor Bota is going to talk about "404 Not Found" -- New and old issues > with S3A; Current state and what's next. > > Stay tuned. Looking forward to seeing more cloud connector topics in the > future. > > April 1st (Wednesday) US Pacific 10am, GMT 5pm, India: 10:30pm > > > Please join via Zoom: > https://cloudera.zoom.us/j/880548968 > > Past meeting minutes > > https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit > >
Apache Hadoop qbt Report: branch2.10+JDK7 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] Failed junit tests : hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.tools.TestDFSAdminWithHA hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.registry.secure.TestSecureLogins hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppsModification hadoop.yarn.client.api.impl.TestAMRMProxy cc: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-compile-cc-root-jdk1.7.0_95.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-compile-javac-root-jdk1.7.0_95.txt [324K] cc: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-compile-cc-root-jdk1.8.0_242.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-compile-javac-root-jdk1.8.0_242.txt [304K] checkstyle: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-checkstyle-root.txt [16M] hadolint: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-patch-shellcheck.txt [56K] shelldocs: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-patch-shelldocs.txt [8.0K] whitespace: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/whitespace-tabs.txt [1.3M] xml: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/xml.txt [12K] findbugs: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase_hadoop-yarn-server-timelineservice-hbase-client-warnings.html [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-javadoc-javadoc-root-jdk1.7.0_95.txt [16K] https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/diff-javadoc-javadoc-root-jdk1.8.0_242.txt [1.1M] unit: https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [244K] https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt [12K] https://builds.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86/642/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-registry.txt [12K] https://builds.apache.
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1456/ [Mar 31, 2020 12:49:09 PM] (github) HADOOP-16910 : ABFS Streams to update FileSystem.Statistics counters on -1 overall The following subsystems voted -1: findbugs pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.metrics2.source.TestJvmMetrics hadoop.security.token.delegation.TestZKDelegationTokenSecretManager hadoop.hdfs.TestAclsEndToEnd hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.server.mover.TestStorageMover hadoop.hdfs.server.namenode.TestRefreshBlockPlacementPolicy hadoop.hdfs.server.blockmanagement.TestPendingReconstruction hadoop.hdfs.TestDecommissionWithStriped hadoop.hdfs.server.namenode.snapshot.TestSnapshot hadoop.hdfs.TestSetrepIncreasing hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy hadoop.hdfs.TestFileChecksumCompositeCrc hadoop.hdfs.server.balancer.TestBalancer hadoop.hdfs.TestLeaseRecovery2 hadoop.hdfs.TestFsShellPermission hadoop.hdfs.server.namenode.TestGetContentSummaryWithPermission hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot hadoop.hdfs.server.namenode.TestFSEditLogLoader hadoop.hdfs.TestErasureCodingPolicyWithSnapshot hadoop.hdfs.server.namenode.TestSecureNameNode hadoop.hdfs.tools.TestECAdmin hadoop.hdfs.TestFSOutputSummer hadoop.hdfs.TestQuotaAllowOwner hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.TestDFSUpgrade hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.tools.TestViewFSStoragePolicyCommands hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot hadoop.hdfs.server.namenode.TestFileTruncate hadoop.hdfs.server.namenode.TestAddStripedBlocks hadoop.hdfs.TestDecommissionWithBackoffMonitor hadoop.hdfs.server.namenode.TestFSImage hadoop.hdfs.TestMultiThreadedHflush hadoop.hdfs.TestFileCorruption hadoop.hdfs.TestFileAppend4 hadoop.hdfs.server.namenode.TestStripedINodeFile hadoop.hdfs.server.namenode.TestLargeDirectoryDelete hadoop.hdfs.TestErasureCodingExerciseAPIs hadoop.hdfs.server.namenode.TestQuotaByStorageType hadoop.hdfs.server.namenode.ha.TestStandbyInProgressTail hadoop.hdfs.TestReadStripedFileWithDNFailure hadoop.hdfs.TestClientProtocolForPipelineRecovery hadoop.hdfs.TestReplication hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocks hadoop.hdfs.tools.TestStoragePolicySatisfyAdminCommands hadoop.hdfs.server.blockmanagement.TestNodeCount hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots hadoop.hdfs.server.namenode.TestAuditLogs hadoop.hdfs.TestStoragePolicyPermissionSettings hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped hadoop.hdfs.server.namenode.TestUpgradeDomainBlockPlacementPolicy hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerWithStripedBlocks hadoop.hdfs.server.namenode.snapshot.TestSnapshotReplication hadoop.hdfs.client.impl.TestBlockReaderFactory hadoop.hdfs.TestDFSInotifyEventInputStream hadoop.hdfs.TestQuota hadoop.hdfs.TestFileChecksum hadoop.hdfs.TestStripedFileAppend hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport hadoop.hdfs.server.blockmanagement.TestBlockManager hadoop.hdfs.client.impl.TestBlockReaderLocal hadoop.hdfs.TestRestartDFS hadoop.hdfs.TestDistributedFileSystemWithEC
