[jira] [Resolved] (HDFS-16625) Unit tests aren't checking for PMDK availability
[
https://issues.apache.org/jira/browse/HDFS-16625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HDFS-16625.
-
Hadoop Flags: Reviewed
Resolution: Fixed
> Unit tests aren't checking for PMDK availability
>
>
> Key: HDFS-16625
> URL: https://issues.apache.org/jira/browse/HDFS-16625
> Project: Hadoop HDFS
> Issue Type: Test
> Components: test
>Affects Versions: 3.4.0, 3.3.9
>Reporter: Steve Vaughan
>Assignee: Steve Vaughan
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 3.4.0, 3.3.9
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> There are unit tests that require native PMDK libraries which aren't checking
> if the library is available, resulting in unsuccessful test. Adding the
> following in the test setup addresses the problem.
> {code:java}
> assumeTrue ("Requires PMDK", NativeIO.POSIX.isPmdkAvailable()); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16354) Add description of GETSNAPSHOTDIFFLISTING to WebHDFS doc
Masatake Iwasaki created HDFS-16354: --- Summary: Add description of GETSNAPSHOTDIFFLISTING to WebHDFS doc Key: HDFS-16354 URL: https://issues.apache.org/jira/browse/HDFS-16354 Project: Hadoop HDFS Issue Type: Improvement Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki HDFS-16091 added GETSNAPSHOTDIFFLISTING op leveraging ClientProtocol#getSnapshotDiffReportListing. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16249) Avoid calling getSnapshotDiffReportListing multiple times if not supported
Masatake Iwasaki created HDFS-16249: --- Summary: Avoid calling getSnapshotDiffReportListing multiple times if not supported Key: HDFS-16249 URL: https://issues.apache.org/jira/browse/HDFS-16249 Project: Hadoop HDFS Issue Type: Improvement Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16248) Add builder to SnapshotDiffReportListing
Masatake Iwasaki created HDFS-16248: --- Summary: Add builder to SnapshotDiffReportListing Key: HDFS-16248 URL: https://issues.apache.org/jira/browse/HDFS-16248 Project: Hadoop HDFS Issue Type: Improvement Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16240) Replace unshaded guava in HttpFSServerWebServer
Masatake Iwasaki created HDFS-16240: --- Summary: Replace unshaded guava in HttpFSServerWebServer Key: HDFS-16240 URL: https://issues.apache.org/jira/browse/HDFS-16240 Project: Hadoop HDFS Issue Type: Bug Components: httpfs Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki HDFS-16129 added use of com.google.common.annotations.VisibleForTesting to HttpFSServerWebServer. It is replaced by replace-guava replacer of HADOOP-17288 on every build time. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-16091) WebHDFS should support getSnapshotDiffReportListing
Masatake Iwasaki created HDFS-16091: --- Summary: WebHDFS should support getSnapshotDiffReportListing Key: HDFS-16091 URL: https://issues.apache.org/jira/browse/HDFS-16091 Project: Hadoop HDFS Issue Type: Improvement Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki When there are millions of diffs between two snapshots, the old getSnapshotDiffReport() isn't scalable. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-15802) Address build failure of hadoop-hdfs-native-client on RHEL/CentOS 8
[ https://issues.apache.org/jira/browse/HDFS-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-15802. - Resolution: Duplicate > Address build failure of hadoop-hdfs-native-client on RHEL/CentOS 8 > --- > > Key: HDFS-15802 > URL: https://issues.apache.org/jira/browse/HDFS-15802 > Project: Hadoop HDFS > Issue Type: Bug > Components: libhdfs++ >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Major > > Building environment described in BUILDING.txt does not work for RHEL CentOS > 8 due to HDFS-15740. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15802) Address build failure of hadoop-hdfs-native-client on RHEL/CentOS 8
Masatake Iwasaki created HDFS-15802: --- Summary: Address build failure of hadoop-hdfs-native-client on RHEL/CentOS 8 Key: HDFS-15802 URL: https://issues.apache.org/jira/browse/HDFS-15802 Project: Hadoop HDFS Issue Type: Bug Components: libhdfs++ Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Building environment described in BUILDING.txt does not work for RHEL CentOS 8 due to HDFS-15740. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15743) Fix -Pdist build failure of hadoop-hdfs-native-client
Masatake Iwasaki created HDFS-15743:
---
Summary: Fix -Pdist build failure of hadoop-hdfs-native-client
Key: HDFS-15743
URL: https://issues.apache.org/jira/browse/HDFS-15743
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{noformat}
[INFO] --- exec-maven-plugin:1.3.1:exec (pre-dist) @ hadoop-hdfs-native-client
---
tar: ./*: Cannot stat: No such file or directory
tar: Exiting with failure status due to previous errors
Checking to bundle with:
bundleoption=false, liboption=snappy.lib, pattern=libsnappy. libdir=
Checking to bundle with:
bundleoption=false, liboption=zstd.lib, pattern=libzstd. libdir=
Checking to bundle with:
bundleoption=false, liboption=openssl.lib, pattern=libcrypto. libdir=
Checking to bundle with:
bundleoption=false, liboption=isal.lib, pattern=libisal. libdir=
Checking to bundle with:
bundleoption=, liboption=pmdk.lib, pattern=pmdk libdir=
Bundling bin files failed
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-15670) Testcase TestBalancer#testBalancerWithPinnedBlocks always fails
[ https://issues.apache.org/jira/browse/HDFS-15670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-15670. - Resolution: Cannot Reproduce I'm closing this as not reproducible. I guess it should be an environmental issue. Feel free to reopen if you have updates. > Testcase TestBalancer#testBalancerWithPinnedBlocks always fails > --- > > Key: HDFS-15670 > URL: https://issues.apache.org/jira/browse/HDFS-15670 > Project: Hadoop HDFS > Issue Type: Sub-task >Affects Versions: 3.0.0-beta1 >Reporter: Jianfei Jiang >Priority: Major > Attachments: HADOOP-15108.000.patch > > > When running testcases without any code changes, the function > testBalancerWithPinnedBlocks in TestBalancer.java never succeeded. I tried to > use Ubuntu 16.04 and redhat 7, maybe the failure is not related to various > linux environment. I am not sure if there is some bug in this case or I used > wrong environment and settings. Could anyone give some advice. > --- > Test set: org.apache.hadoop.hdfs.server.balancer.TestBalancer > --- > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 100.389 sec > <<< FAILURE! - in org.apache.hadoop.hdfs.server.balancer.TestBalancer > testBalancerWithPinnedBlocks(org.apache.hadoop.hdfs.server.balancer.TestBalancer) > Time elapsed: 100.134 sec <<< ERROR! > java.lang.Exception: test timed out after 10 milliseconds > at java.lang.Object.wait(Native Method) > at > org.apache.hadoop.hdfs.DataStreamer.waitForAckedSeqno(DataStreamer.java:903) > at > org.apache.hadoop.hdfs.DFSOutputStream.flushInternal(DFSOutputStream.java:773) > at > org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:870) > at > org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:842) > at > org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) > at > org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:101) > at org.apache.hadoop.hdfs.DFSTestUtil.createFile(DFSTestUtil.java:441) > at > org.apache.hadoop.hdfs.server.balancer.TestBalancer.testBalancerWithPinnedBlocks(TestBalancer.java:515) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15702) Fix intermittent falilure of TestDecommission#testAllocAndIBRWhileDecommission
Masatake Iwasaki created HDFS-15702:
---
Summary: Fix intermittent falilure of
TestDecommission#testAllocAndIBRWhileDecommission
Key: HDFS-15702
URL: https://issues.apache.org/jira/browse/HDFS-15702
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{noformat}
java.lang.AssertionError: expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.hadoop.hdfs.TestDecommission.testAllocAndIBRWhileDecommission(TestDecommission.java:1025)
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-15676) TestRouterRpcMultiDestination#testNamenodeMetrics fails on trunk
[ https://issues.apache.org/jira/browse/HDFS-15676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-15676. - Resolution: Duplicate I'm closing this as fixed by HDFS-15677. I will reopen this if the failure of testNameNodeMetrics alone rise again. > TestRouterRpcMultiDestination#testNamenodeMetrics fails on trunk > > > Key: HDFS-15676 > URL: https://issues.apache.org/jira/browse/HDFS-15676 > Project: Hadoop HDFS > Issue Type: Sub-task >Reporter: Ahmed Hussein >Assignee: Masatake Iwasaki >Priority: Major > > qbt report (Nov 8, 2020, 11:28 AM) shows failures in testNamenodeMetrics -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-15296) TestBPOfferService#testMissBlocksWhenReregister is flaky
[
https://issues.apache.org/jira/browse/HDFS-15296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HDFS-15296.
-
Resolution: Duplicate
I'm closing this as duplicate of HDFS-15654.
> TestBPOfferService#testMissBlocksWhenReregister is flaky
>
>
> Key: HDFS-15296
> URL: https://issues.apache.org/jira/browse/HDFS-15296
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: test
>Affects Versions: 3.4.0
>Reporter: Mingliang Liu
>Priority: Major
>
> TestBPOfferService.testMissBlocksWhenReregister fails intermittently in
> {{trunk}} branch, not sure about other branches. Example failures are
> -
> https://builds.apache.org/job/hadoop-multibranch/job/PR-1964/4/testReport/org.apache.hadoop.hdfs.server.datanode/TestBPOfferService/testMissBlocksWhenReregister/
> -
> https://builds.apache.org/job/PreCommit-HDFS-Build/29175/testReport/org.apache.hadoop.hdfs.server.datanode/TestBPOfferService/testMissBlocksWhenReregister/
> Sample exception stack is:
> {quote}
> Stacktrace
> java.lang.AssertionError
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testMissBlocksWhenReregister(TestBPOfferService.java:350)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> {quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-15298) Fix the findbugs warnings introduced in HDFS-15217
[ https://issues.apache.org/jira/browse/HDFS-15298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-15298. - Fix Version/s: 3.4.0 Resolution: Fixed Committed to trunk. Thanks, [~brfrn169] and [~elgoiri]. > Fix the findbugs warnings introduced in HDFS-15217 > -- > > Key: HDFS-15298 > URL: https://issues.apache.org/jira/browse/HDFS-15298 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Toshihiro Suzuki >Assignee: Toshihiro Suzuki >Priority: Major > Fix For: 3.4.0 > > > We need to fix the findbugs warnings introduced in HDFS-15217: > https://builds.apache.org/job/hadoop-multibranch/job/PR-1954/5/artifact/out/new-findbugs-hadoop-hdfs-project_hadoop-hdfs.html -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-15228) Cannot rename file with space in name
[ https://issues.apache.org/jira/browse/HDFS-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-15228. - Resolution: Duplicate Closing this as duplicate of HDFS-14423. Please reopen if you need. > Cannot rename file with space in name > - > > Key: HDFS-15228 > URL: https://issues.apache.org/jira/browse/HDFS-15228 > Project: Hadoop HDFS > Issue Type: Bug > Components: webhdfs >Affects Versions: 3.2.0 > Environment: Oracle jdk1.8.161 >Reporter: Dylan Werner-Meier >Priority: Major > Attachments: TestWithStrangeFilenames.java, pom.xml > > > Hello, > While using webhdfs, I encountered a strange bug where I just cannot rename a > file if it has a space in the filename. > It seems strange to me, is there anything I am missing ? > > Edit: After some debugging, it seems to be linked with the way spaces are > encoded the webhdfs url: the JDK's URLEncoder uses '+' to encode spaces, > whereas a CURL command where the filename is encoded with '%20' for spaces > works just fine. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15271) Update DFSUtil.getSpnegoKeytabKey based on hadoop.http.authentication.kerberos.keytab
Masatake Iwasaki created HDFS-15271:
---
Summary: Update DFSUtil.getSpnegoKeytabKey based on
hadoop.http.authentication.kerberos.keytab
Key: HDFS-15271
URL: https://issues.apache.org/jira/browse/HDFS-15271
Project: Hadoop HDFS
Issue Type: Improvement
Components: security
Affects Versions: 3.3.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
After HADOOP-16314, setting {{dfs.web.authentication.kerberos.keytab}} has no
effect. Keytab file can be specified by
{{hadoop.http.authentication.kerberos.keytab}} now. DFSUtil.getSpnegoKeytabKey
should care about the new proeperty while keeping backward compatibility. Since
the {{getSpnegoKeytabKey}} is only called by NameNodeHttpServer and the value
is not used, deprecating it could be an option.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-15077) Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout
Masatake Iwasaki created HDFS-15077:
---
Summary: Fix intermittent failure of
TestDFSClientRetries#testLeaseRenewSocketTimeout
Key: HDFS-15077
URL: https://issues.apache.org/jira/browse/HDFS-15077
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{{TestDFSClientRetries#testLeaseRenewSocketTimeout}} intermittently fails due
to checking logic in {{verifyEmptyLease}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-14900) Fix build failure of hadoop-hdfs-native-client
Masatake Iwasaki created HDFS-14900: --- Summary: Fix build failure of hadoop-hdfs-native-client Key: HDFS-14900 URL: https://issues.apache.org/jira/browse/HDFS-14900 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 3.3.0 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Build with native profile failed due to lack of protobuf resources. I did not noticed this because build scceeds if protobuf-2.5.0 is installed. protobuf-3.7.1 is the correct version after HADOOP-16558. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-14707) Add JAVA_LIBRARY_PATH to HTTPFS startup options in branch-2
Masatake Iwasaki created HDFS-14707: --- Summary: Add JAVA_LIBRARY_PATH to HTTPFS startup options in branch-2 Key: HDFS-14707 URL: https://issues.apache.org/jira/browse/HDFS-14707 Project: Hadoop HDFS Issue Type: Improvement Components: httpfs Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Currently HTTPFS does not load hadoop native library since java.library.path is not set on Tomcat startup. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-14432) dfs.datanode.shared.file.descriptor.paths duplicated in hdfs-default.xml
[ https://issues.apache.org/jira/browse/HDFS-14432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-14432. - Resolution: Fixed Assignee: puleya7 Fix Version/s: 3.1.3 3.2.1 3.3.0 3.0.4 2.10.0 Thanks for the contribution, [~puleya7]. I committed this. > dfs.datanode.shared.file.descriptor.paths duplicated in hdfs-default.xml > > > Key: HDFS-14432 > URL: https://issues.apache.org/jira/browse/HDFS-14432 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs >Reporter: puleya7 >Assignee: puleya7 >Priority: Minor > Fix For: 2.10.0, 3.0.4, 3.3.0, 3.2.1, 3.1.3 > > > property "dfs.datanode.shared.file.descriptor.paths" appeared twice in > hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml (after > HDFS-6007、2.5.0) -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST
[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-12654. - Resolution: Not A Problem I'm closing this as not-a-problem. Please reopen if you can reproduce the 500 issue. We should update title on reopen. Thanks for pinging me, [~Sammi]. > APPEND API call is different in HTTPFS and NameNode REST > > > Key: HDFS-12654 > URL: https://issues.apache.org/jira/browse/HDFS-12654 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, httpfs, namenode >Affects Versions: 2.6.0, 2.7.0, 2.8.0, 3.0.0-beta1 >Reporter: Andras Czesznak >Priority: Major > > The APPEND REST API call behaves differently in the NameNode REST and the > HTTPFS codes. The NameNode version creates the target file the new data being > appended to if it does not exist at the time of the call issued. The HTTPFS > version assumes the target file exists when APPEND is called and can append > only the new data but does not create the target file it doesn't exist. > The two implementations should be standardized, preferably the HTTPFS version > should be modified to execute an implicit CREATE if the target file does not > exist. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-11995. - Resolution: Fixed Fix Version/s: 2.8.2 3.0.0-alpha4 2.9.0 Committed this to branch-2.8.2 and above. Thanks, [~nandakumar131]. > HDFS Architecture documentation incorrectly describes writing to a local > temporary file. > > > Key: HDFS-11995 > URL: https://issues.apache.org/jira/browse/HDFS-11995 > Project: Hadoop HDFS > Issue Type: Bug > Components: documentation >Affects Versions: 3.0.0-alpha3 >Reporter: Chris Nauroth >Assignee: Nandakumar >Priority: Minor > Fix For: 2.9.0, 3.0.0-alpha4, 2.8.2 > > Attachments: HDFS-11995.000.patch > > > The HDFS Architecture documentation has a section titled "Staging" that > describes clients writing to a local temporary file first before interacting > with the NameNode to allocate file metadata. This information is incorrect. > (Perhaps it was correct a long time ago, but it is no longer accurate with > respect to the current implementation.) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace
Masatake Iwasaki created HDFS-10871:
---
Summary: DiskBalancerWorkItem should not import jackson relocated
by htrace
Key: HDFS-10871
URL: https://issues.apache.org/jira/browse/HDFS-10871
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs-client
Affects Versions: 3.0.0-alpha1
Reporter: Masatake Iwasaki
Compiling trunk against upstream htrace fails since it does not bundle the
{{org.apache.htrace.fasterxml.jackson.annotation.JsonInclude}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-10230) HDFS Native Client build failed
[
https://issues.apache.org/jira/browse/HDFS-10230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HDFS-10230.
-
Resolution: Duplicate
I'm going to close this as duplicate of HADOOP-12692. Please reopen if this
turns out to be independent issue.
> HDFS Native Client build failed
> ---
>
> Key: HDFS-10230
> URL: https://issues.apache.org/jira/browse/HDFS-10230
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: build
>Reporter: John Zhuge
>Priority: Blocker
>
> HDFS Native Client build failed:
> https://builds.apache.org/job/Hadoop-trunk-Commit/9514/console
> {code}
> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @
> hadoop-hdfs-native-client ---
> Downloading:
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/3.0.0-SNAPSHOT/hadoop-hdfs-3.0.0-20160328.214654-6500.pom
> 4/21 KB
> 8/21 KB
> 8/21 KB
> 12/21 KB
> 14/21 KB
> 18/21 KB
> 21/21 KB
>
> Downloaded:
> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs/3.0.0-SNAPSHOT/hadoop-hdfs-3.0.0-20160328.214654-6500.pom
> (21 KB at 193.9 KB/sec)
> [WARNING]
> Dependency convergence error for org.apache.hadoop:hadoop-hdfs:3.0.0-SNAPSHOT
> paths to dependency are:
> +-org.apache.hadoop:hadoop-hdfs-native-client:3.0.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-hdfs:3.0.0-SNAPSHOT
> and
> +-org.apache.hadoop:hadoop-hdfs-native-client:3.0.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-hdfs:3.0.0-20160328.214654-6500
> [WARNING] Rule 0: org.apache.maven.plugins.enforcer.DependencyConvergence
> failed with message:
> Failed while enforcing releasability the error(s) are [
> Dependency convergence error for org.apache.hadoop:hadoop-hdfs:3.0.0-SNAPSHOT
> paths to dependency are:
> +-org.apache.hadoop:hadoop-hdfs-native-client:3.0.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-hdfs:3.0.0-SNAPSHOT
> and
> +-org.apache.hadoop:hadoop-hdfs-native-client:3.0.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-hdfs:3.0.0-20160328.214654-6500
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS
Masatake Iwasaki created HDFS-9954: -- Summary: Test RPC timeout fix of HADOOP-12672 against HDFS Key: HDFS-9954 URL: https://issues.apache.org/jira/browse/HDFS-9954 Project: Hadoop HDFS Issue Type: Test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9884) Use doxia macro to generate in-page TOC of HDFS site documentation
Masatake Iwasaki created HDFS-9884: -- Summary: Use doxia macro to generate in-page TOC of HDFS site documentation Key: HDFS-9884 URL: https://issues.apache.org/jira/browse/HDFS-9884 Project: Hadoop HDFS Issue Type: Improvement Components: documentation Affects Versions: 2.7.0 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Since maven-site-plugin 3.5 was releaced, we can use toc macro in Markdown. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9623) Update example configuration of block state change log in log4j.properties
Masatake Iwasaki created HDFS-9623: -- Summary: Update example configuration of block state change log in log4j.properties Key: HDFS-9623 URL: https://issues.apache.org/jira/browse/HDFS-9623 Project: Hadoop HDFS Issue Type: Bug Components: logging Affects Versions: 2.8.0 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor The log level of block state change log was changed from INFO to DEBUG by HDFS-6860. The example configuration in log4j.properties should be updated along with the change. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks
Masatake Iwasaki created HDFS-9618:
--
Summary: Fix mismatch between log level and guard in
BlockManager#computeRecoveryWorkForBlocks
Key: HDFS-9618
URL: https://issues.apache.org/jira/browse/HDFS-9618
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 3.0.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
Debug log message is constructed when {{Logger#isInfoEnabled}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HDFS-9601) Fix intermittent failure of TestNNThroughputBenchmark
Masatake Iwasaki created HDFS-9601: -- Summary: Fix intermittent failure of TestNNThroughputBenchmark Key: HDFS-9601 URL: https://issues.apache.org/jira/browse/HDFS-9601 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions: 3.0.0 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9437) Add utility to wait for finishing the process of heartbeat and block report
Masatake Iwasaki created HDFS-9437: -- Summary: Add utility to wait for finishing the process of heartbeat and block report Key: HDFS-9437 URL: https://issues.apache.org/jira/browse/HDFS-9437 Project: Hadoop HDFS Issue Type: Improvement Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki BPServiceActor provides test utility such as triggerBlockReportForTests, triggerHeartbeatForTests and triggerDeletionReportForTests. These methods triggers heartbeat/blockreport and is possible to return before the process is finished. Some unit tests intermittently fails due to this. Utilities to wait for finishing the process of hearteat/blockreport should be added in order to avoid flaky tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9428) Fix intermittent failure of TestDNFencing.testQueueingWithAppend
Masatake Iwasaki created HDFS-9428: -- Summary: Fix intermittent failure of TestDNFencing.testQueueingWithAppend Key: HDFS-9428 URL: https://issues.apache.org/jira/browse/HDFS-9428 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9423) Fix intermittent failure of TestEditLogTailer
Masatake Iwasaki created HDFS-9423: -- Summary: Fix intermittent failure of TestEditLogTailer Key: HDFS-9423 URL: https://issues.apache.org/jira/browse/HDFS-9423 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor TestEditLogTailer sometimes fails because EditLogTailer could exhausts retries before one of the NameNode become active. Maximum retries should be increased to use short tailing period for tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test
Masatake Iwasaki created HDFS-9270: -- Summary: TestShortCircuitLocalRead should not leave socket after unit test Key: HDFS-9270 URL: https://issues.apache.org/jira/browse/HDFS-9270 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions: 2.7.1 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor Unix domain sockets created by TestShortCircuitLocalRead and TestTracingShortCircuitLocalRead are not removed before finishing the tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
Masatake Iwasaki created HDFS-9225: -- Summary: Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack Key: HDFS-9225 URL: https://issues.apache.org/jira/browse/HDFS-9225 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor TestBlockManager#testBlocksAreNotUnderreplicatedInSingleRack sometimes fails in QA build due to mocking. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reopened HDFS-8915: Assignee: Masatake Iwasaki (was: Anu Engineer) I can reproduce this in my local environment. There is a chance that assertion is checked before all testing threads hold lock. > TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins > - > > Key: HDFS-8915 > URL: https://issues.apache.org/jira/browse/HDFS-8915 > Project: Hadoop HDFS > Issue Type: Bug > Components: HDFS >Affects Versions: 2.8.0 >Reporter: Anu Engineer >Assignee: Masatake Iwasaki > > This test was added as part of HDFS-8883, There is a race condition in the > test and it has failed *once* in the Apache Jenkins run. > Here is the stack > FAILED: > org.apache.hadoop.hdfs.server.namenode.TestFSNamesystem.testFSLockGetWaiterCount > Error Message: > Expected number of blocked thread not found expected:<3> but was:<1> > Stack Trace: > java.lang.AssertionError: Expected number of blocked thread not found > expected:<3> but was:<1> > at org.junit.Assert.fail(Assert.java:88) > at org.junit.Assert.failNotEquals(Assert.java:743) > at org.junit.Assert.assertEquals(Assert.java:118) > at org.junit.Assert.assertEquals(Assert.java:555) > at > org.apache.hadoop.hdfs.server.namenode.TestFSNamesystem.testFSLockGetWaiterCount(TestFSNamesystem.java:261) > From cursory code reading , even though we call into readlock.lock() there is > no guarantee that our thread is put in the wait queue. A proposed fix could > be to check for any thread in the lock queue instead of all 3, or disable the > test. > It could also indicate an issue with the test infra-structure but any test > open to variations in result due to infra-structure issues creates noise in > tests so we are better off fixing it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-8974) Convert docs in xdoc format to markdown
Masatake Iwasaki created HDFS-8974: -- Summary: Convert docs in xdoc format to markdown Key: HDFS-8974 URL: https://issues.apache.org/jira/browse/HDFS-8974 Project: Hadoop HDFS Issue Type: Improvement Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor Files in xdoc format should be converted to markdown for ease of maintenance. * hadoop-hdfs-project/hadoop-hdfs/src/site/xdoc/HdfsRollingUpgrade.xml * hadoop-hdfs-project/hadoop-hdfs/src/site/xdoc/HdfsSnapshots.xml -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-8945) Update the description about replica placement in HDFS Architecture documentation
Masatake Iwasaki created HDFS-8945: -- Summary: Update the description about replica placement in HDFS Architecture documentation Key: HDFS-8945 URL: https://issues.apache.org/jira/browse/HDFS-8945 Project: Hadoop HDFS Issue Type: Improvement Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor The description about replica placement should have * Explanation about storage types and storage policies should be added * placement policy for replication factor greater than 4 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-8942) Update hyperlink to rack awareness page in HDFS Architecture documentation
Masatake Iwasaki created HDFS-8942: -- Summary: Update hyperlink to rack awareness page in HDFS Architecture documentation Key: HDFS-8942 URL: https://issues.apache.org/jira/browse/HDFS-8942 Project: Hadoop HDFS Issue Type: Bug Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Trivial The hyperlink to rack awareness documentation in HdfsDesign.md is pointing to non-existent target. It should be fixed to point to RackAwareness.html. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HDFS-7135) Add trace command to FsShell
[ https://issues.apache.org/jira/browse/HDFS-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-7135. Resolution: Duplicate I'm closing this as duplicate of HADOOP-12124. I think using configuration property is better now. > Add trace command to FsShell > > > Key: HDFS-7135 > URL: https://issues.apache.org/jira/browse/HDFS-7135 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs-client >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki > Attachments: HDFS-7135-0.patch, HDFS-7135-1.patch > > > Adding manual tracing command which can be used like 'hdfs dfs -trace -ls /'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-8641) Mirror repository on GitHub is not synced with ASF repo
Masatake Iwasaki created HDFS-8641: -- Summary: Mirror repository on GitHub is not synced with ASF repo Key: HDFS-8641 URL: https://issues.apache.org/jira/browse/HDFS-8641 Project: Hadoop HDFS Issue Type: Task Reporter: Masatake Iwasaki Since Apr 19, 2015. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HDFS-6762) hadoop-hdfs build fails at module-javadocs
[ https://issues.apache.org/jira/browse/HDFS-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-6762. Resolution: Not A Problem I have seen similar build failures with the message "Exit code: 137". It always turned out that there is not enough memory. I'm closing this as "not a problem". Please reopen if this still reproduces. > hadoop-hdfs build fails at module-javadocs > -- > > Key: HDFS-6762 > URL: https://issues.apache.org/jira/browse/HDFS-6762 > Project: Hadoop HDFS > Issue Type: Bug > Components: build >Affects Versions: 2.4.1 > Environment: ubuntu trusty tahr >Reporter: Stijn Meevis >Priority: Critical > Original Estimate: 3h > Remaining Estimate: 3h > > Note; I never used JIRA before so sorry if I did it wrong > Maven build hangs for a long time at > main: > [INFO] Executed tasks > [INFO] > [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs --- > Eventually the build fails > main: > [INFO] Executed tasks > [INFO] > [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs --- > [INFO] > ExcludePrivateAnnotationsStandardDoclet > [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Hadoop Main SUCCESS [3.133s] > [INFO] Apache Hadoop Project POM . SUCCESS [3.134s] > [INFO] Apache Hadoop Annotations . SUCCESS [7.367s] > [INFO] Apache Hadoop Assemblies .. SUCCESS [1.000s] > [INFO] Apache Hadoop Project Dist POM SUCCESS [4.297s] > [INFO] Apache Hadoop Maven Plugins ... SUCCESS [4.673s] > [INFO] Apache Hadoop MiniKDC . SUCCESS [3.471s] > [INFO] Apache Hadoop Auth SUCCESS [4.589s] > [INFO] Apache Hadoop Auth Examples ... SUCCESS [2.567s] > [INFO] Apache Hadoop Common .. SUCCESS [1:26.140s] > [INFO] Apache Hadoop NFS . SUCCESS [25.938s] > [INFO] Apache Hadoop Common Project .. SUCCESS [0.070s] > [INFO] Apache Hadoop HDFS FAILURE > [12:25.155s] > [INFO] Apache Hadoop HttpFS .. SKIPPED > [INFO] Apache Hadoop HDFS BookKeeper Journal . SKIPPED > [INFO] Apache Hadoop HDFS-NFS SKIPPED > [INFO] Apache Hadoop HDFS Project SKIPPED > [INFO] hadoop-yarn ... SKIPPED > [INFO] hadoop-yarn-api ... SKIPPED > [INFO] hadoop-yarn-common SKIPPED > [INFO] hadoop-yarn-server SKIPPED > [INFO] hadoop-yarn-server-common . SKIPPED > [INFO] hadoop-yarn-server-nodemanager SKIPPED > [INFO] hadoop-yarn-server-web-proxy .. SKIPPED > [INFO] hadoop-yarn-server-applicationhistoryservice .. SKIPPED > [INFO] hadoop-yarn-server-resourcemanager SKIPPED > [INFO] hadoop-yarn-server-tests .. SKIPPED > [INFO] hadoop-yarn-client SKIPPED > [INFO] hadoop-yarn-applications .. SKIPPED > [INFO] hadoop-yarn-applications-distributedshell . SKIPPED > [INFO] hadoop-yarn-applications-unmanaged-am-launcher SKIPPED > [INFO] hadoop-yarn-site .. SKIPPED > [INFO] hadoop-yarn-project ... SKIPPED > [INFO] hadoop-mapreduce-client ... SKIPPED > [INFO] hadoop-mapreduce-client-core .. SKIPPED > [INFO] hadoop-mapreduce-client-common SKIPPED > [INFO] hadoop-mapreduce-client-shuffle ... SKIPPED > [INFO] hadoop-mapreduce-client-app ... SKIPPED > [INFO] hadoop-mapreduce-client-hs SKIPPED > [INFO] hadoop-mapreduce-client-jobclient . SKIPPED > [INFO] hadoop-mapreduce-client-hs-plugins SKIPPED > [INFO] Apache Hadoop MapReduce Examples .. SKIPPED > [INFO] hadoop-mapreduce .. SKIPPED > [INFO] Apache Hadoop MapReduce Streaming . SKIPPED > [INFO] Apache Hadoop Distributed Copy SKIPPED > [INFO] Apache Hadoop Archives SKIPPED > [INFO] Apache Hadoop Rumen ... SKIPPED > [INFO] Apache Hadoop Gridmix . SKIPPED > [INFO] Apache Hadoop Data Join ... SKIPPED > [INFO] Apache Hadoop Extras ...
[jira] [Created] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException
Masatake Iwasaki created HDFS-8463: -- Summary: Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException Key: HDFS-8463 URL: https://issues.apache.org/jira/browse/HDFS-8463 Project: Hadoop HDFS Issue Type: Bug Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-8284) Add usage of tracing originated in DFSClient to doc
Masatake Iwasaki created HDFS-8284: -- Summary: Add usage of tracing originated in DFSClient to doc Key: HDFS-8284 URL: https://issues.apache.org/jira/browse/HDFS-8284 Project: Hadoop HDFS Issue Type: Improvement Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Tracing originated in DFSClient uses configuration keys prefixed with "dfs.client.htrace" after HDFS-8213. Server side tracing uses conf keys prefixed with "dfs.htrace". -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-8063) Fix test failure in TestTracing
Masatake Iwasaki created HDFS-8063:
--
Summary: Fix test failure in TestTracing
Key: HDFS-8063
URL: https://issues.apache.org/jira/browse/HDFS-8063
Project: Hadoop HDFS
Issue Type: Bug
Components: test
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
Tests in TestTracing sometimes fails, especially on slow machine. The cause is
that spans is possible to arrive at receiver after {{assertSpanNamesFound}}
passed and {{SetSpanReceiver.SetHolder.spans.clear()}} is called for next test
case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054
Masatake Iwasaki created HDFS-7963: -- Summary: Fix expected tracing spans in TestTracing along with HDFS-7054 Key: HDFS-7963 URL: https://issues.apache.org/jira/browse/HDFS-7963 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7792) Add links to FaultInjectFramework and SLGUserGuide to site index
Masatake Iwasaki created HDFS-7792: -- Summary: Add links to FaultInjectFramework and SLGUserGuide to site index Key: HDFS-7792 URL: https://issues.apache.org/jira/browse/HDFS-7792 Project: Hadoop HDFS Issue Type: Bug Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor FaultInjectFramework.html SLGUserGuide.html are not linked from anywhere. Add link to them to site.xml if the contents are not outdated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7472) Fix typo in message of ReplicaNotFoundException
Masatake Iwasaki created HDFS-7472: -- Summary: Fix typo in message of ReplicaNotFoundException Key: HDFS-7472 URL: https://issues.apache.org/jira/browse/HDFS-7472 Project: Hadoop HDFS Issue Type: Bug Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Trivial unexpeted -> unexpected -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7320) The appearance of hadoop-hdfs-httpfs site docs is inconsistent
Masatake Iwasaki created HDFS-7320: -- Summary: The appearance of hadoop-hdfs-httpfs site docs is inconsistent Key: HDFS-7320 URL: https://issues.apache.org/jira/browse/HDFS-7320 Project: Hadoop HDFS Issue Type: Bug Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor The docs of hadoop-hdfs-httpfs use different maven-base.css and maven-theme.css from other modules. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7319) Remove dead link to HFTP documentation from index
Masatake Iwasaki created HDFS-7319: -- Summary: Remove dead link to HFTP documentation from index Key: HDFS-7319 URL: https://issues.apache.org/jira/browse/HDFS-7319 Project: Hadoop HDFS Issue Type: Bug Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor There is dead link to deprecated HFTP doc in doc index. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7223) Omit package name prefix from description of tracing span
Masatake Iwasaki created HDFS-7223: -- Summary: Omit package name prefix from description of tracing span Key: HDFS-7223 URL: https://issues.apache.org/jira/browse/HDFS-7223 Project: Hadoop HDFS Issue Type: Improvement Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor Current span description for IPC call is too long. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7202) package name of SpanReceiver cannot be omitted on "hadoop trace -add"
Masatake Iwasaki created HDFS-7202: -- Summary: package name of SpanReceiver cannot be omitted on "hadoop trace -add" Key: HDFS-7202 URL: https://issues.apache.org/jira/browse/HDFS-7202 Project: Hadoop HDFS Issue Type: Bug Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor This is not consistent with the configuration from file. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7186) Add usage of "hadoop trace" command to doc
Masatake Iwasaki created HDFS-7186: -- Summary: Add usage of "hadoop trace" command to doc Key: HDFS-7186 URL: https://issues.apache.org/jira/browse/HDFS-7186 Project: Hadoop HDFS Issue Type: Improvement Components: documentation Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor The command for tracing management was added in HDFS-6956. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7135) Add trace command to FsShell
Masatake Iwasaki created HDFS-7135: -- Summary: Add trace command to FsShell Key: HDFS-7135 URL: https://issues.apache.org/jira/browse/HDFS-7135 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Adding manual tracing command which can be used like 'hdfs dfs -trace -ls /'. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-7001) Tests in TestTracing depends on the order of execution
Masatake Iwasaki created HDFS-7001: -- Summary: Tests in TestTracing depends on the order of execution Key: HDFS-7001 URL: https://issues.apache.org/jira/browse/HDFS-7001 Project: Hadoop HDFS Issue Type: Bug Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor o.a.h.tracing.TestTracing#testSpanReceiverHost is assumed to be executed first. It should be done in BeforeClass. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-6881) Adding tracing spans to HDFS
Masatake Iwasaki created HDFS-6881: -- Summary: Adding tracing spans to HDFS Key: HDFS-6881 URL: https://issues.apache.org/jira/browse/HDFS-6881 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Masatake Iwasaki -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6879) Adding tracing to Hadoop RPC
Masatake Iwasaki created HDFS-6879: -- Summary: Adding tracing to Hadoop RPC Key: HDFS-6879 URL: https://issues.apache.org/jira/browse/HDFS-6879 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Masatake Iwasaki -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6880) Adding tracing to DataNode data transfer protocol
Masatake Iwasaki created HDFS-6880: -- Summary: Adding tracing to DataNode data transfer protocol Key: HDFS-6880 URL: https://issues.apache.org/jira/browse/HDFS-6880 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Masatake Iwasaki -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (HDFS-6007) Update documentation about short-circuit local reads
Masatake Iwasaki created HDFS-6007: -- Summary: Update documentation about short-circuit local reads Key: HDFS-6007 URL: https://issues.apache.org/jira/browse/HDFS-6007 Project: Hadoop HDFS Issue Type: Improvement Components: documentation Reporter: Masatake Iwasaki Priority: Minor updating the contents of "HDFS SHort-Circuit Local Reads" based on the changes in HDFS-5810. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
