[jira] [Created] (HADOOP-12007) GzipCodec native CodecPool leaks memory
Yejun Yang created HADOOP-12007: --- Summary: GzipCodec native CodecPool leaks memory Key: HADOOP-12007 URL: https://issues.apache.org/jira/browse/HADOOP-12007 Project: Hadoop Common Issue Type: Bug Reporter: Yejun Yang org/apache/hadoop/io/compress/GzipCodec.java call CompressionCodec.Util.createOutputStreamWithCodecPool to use CodecPool. But compressor objects are actually never returned to pool which cause memory leak. HADOOP-10591 uses CompressionOutputStream.close() to return Compressor object to pool. But CompressionCodec.Util.createOutputStreamWithCodecPool actually returns a CompressorStream which overrides close(). This cause CodecPool.returnCompressor never being called. In my log file I can see lots of "Got brand-new compressor [.gz]" but no "Got recycled compressor". -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HADOOP-11698: --- Status: Open (was: Patch Available) Cancelling patch as it no longer applies. > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-branch2.patch, HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10366) [Doc] wrap value of io.serializations in core-default.xml to fit better in browser
[
https://issues.apache.org/jira/browse/HADOOP-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551973#comment-14551973
]
Akira AJISAKA commented on HADOOP-10366:
+1. Thanks [~kanaka] for fixing
{{hadoop.security.crypto.codec.classes.aes.ctr.nopadding}} as well.
> [Doc] wrap value of io.serializations in core-default.xml to fit better in
> browser
> --
>
> Key: HADOOP-10366
> URL: https://issues.apache.org/jira/browse/HADOOP-10366
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.0.0
>Reporter: Chengwei Yang
>Assignee: kanaka kumar avvaru
>Priority: Trivial
> Labels: BB2015-05-RFC, documentation, newbie, patch
> Attachments: HADOOP-10366-03.patch, HADOOP-10366-wrap01,
> HADOOP-10366-wrap01.patch, HADOOP-10366-wrap02.patch, HADOOP-10366.patch
>
>
> The io.serialization property in core-default.xml has a very long value in a
> single line, as below
> {code}
>
> io.serializations
>
> org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
> A list of serialization classes that can be used for
> obtaining serializers and deserializers.
>
> {code}
> which not only break the code style (a very long line) but also not fit well
> in browser. Due to this single very long line, the "description" column can
> not show in browser by default
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-10366) [Doc] wrap value of io.serializations in core-default.xml to fit better in browser
[
https://issues.apache.org/jira/browse/HADOOP-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551977#comment-14551977
]
Akira AJISAKA commented on HADOOP-10366:
Cancelling my +1. Would you fix {{TransparentEncryption.md}} as well?
{code}
hadoop.security.crypto.codec.classes.aes.ctr.nopadding
Default:
`org.apache.hadoop.crypto.OpensslAesCtrCryptoCodec,org.apache.hadoop.crypto.JceAesCtrCryptoCodec`
{code}
> [Doc] wrap value of io.serializations in core-default.xml to fit better in
> browser
> --
>
> Key: HADOOP-10366
> URL: https://issues.apache.org/jira/browse/HADOOP-10366
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.0.0
>Reporter: Chengwei Yang
>Assignee: kanaka kumar avvaru
>Priority: Trivial
> Labels: BB2015-05-RFC, documentation, newbie, patch
> Attachments: HADOOP-10366-03.patch, HADOOP-10366-wrap01,
> HADOOP-10366-wrap01.patch, HADOOP-10366-wrap02.patch, HADOOP-10366.patch
>
>
> The io.serialization property in core-default.xml has a very long value in a
> single line, as below
> {code}
>
> io.serializations
>
> org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
> A list of serialization classes that can be used for
> obtaining serializers and deserializers.
>
> {code}
> which not only break the code style (a very long line) but also not fit well
> in browser. Due to this single very long line, the "description" column can
> not show in browser by default
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-11594) Improve the readability of site index of documentation
[ https://issues.apache.org/jira/browse/HADOOP-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-11594: -- Labels: (was: BB2015-05-TBR) > Improve the readability of site index of documentation > -- > > Key: HADOOP-11594 > URL: https://issues.apache.org/jira/browse/HADOOP-11594 > Project: Hadoop Common > Issue Type: Improvement > Components: documentation >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Attachments: HADOOP-11594.001.patch, HADOOP-11594.002.patch, > HADOOP-11594.003.patch > > > * change the order of items > * make redundant title shorter and fit it in single line as far as possible -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11594) Improve the readability of site index of documentation
[ https://issues.apache.org/jira/browse/HADOOP-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-11594: -- Attachment: HADOOP-11594.004.patch I rethinked about this. Changing titles and order of items at the same is hard to review and confusing to readers. Attached 004 just makes redundant titles shorter while keeping order of items except for "Architecture" of HDFS and "Commands Reference" of YARN. > Improve the readability of site index of documentation > -- > > Key: HADOOP-11594 > URL: https://issues.apache.org/jira/browse/HADOOP-11594 > Project: Hadoop Common > Issue Type: Improvement > Components: documentation >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Attachments: HADOOP-11594.001.patch, HADOOP-11594.002.patch, > HADOOP-11594.003.patch, HADOOP-11594.004.patch > > > * change the order of items > * make redundant title shorter and fit it in single line as far as possible -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-9613) [JDK8] Update jersey version to latest 1.x release
[
https://issues.apache.org/jira/browse/HADOOP-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551982#comment-14551982
]
Akira AJISAKA commented on HADOOP-9613:
---
Copied from
https://builds.apache.org/job/PreCommit-HADOOP-Build/6737/artifact/patchprocess/commentfile
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 14m 34s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 18 new or modified test files. |
| {color:red}-1{color} | javac | 7m 28s | The applied patch generated 5
additional warning messages. |
| {color:green}+1{color} | javadoc | 9m 39s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 4m 46s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 9s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 30s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:red}-1{color} | findbugs | 7m 44s | The patch appears to introduce 1
new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | common tests | 22m 26s | Tests passed in
hadoop-common. |
| {color:red}-1{color} | mapreduce tests | 9m 8s | Tests failed in
hadoop-mapreduce-client-app. |
| {color:red}-1{color} | mapreduce tests | 5m 26s | Tests failed in
hadoop-mapreduce-client-hs. |
| {color:red}-1{color} | yarn tests | 1m 55s | Tests failed in
hadoop-yarn-common. |
| {color:red}-1{color} | yarn tests | 2m 54s | Tests failed in
hadoop-yarn-server-applicationhistoryservice. |
| {color:red}-1{color} | yarn tests | 5m 49s | Tests failed in
hadoop-yarn-server-nodemanager. |
| {color:red}-1{color} | yarn tests | 48m 18s | Tests failed in
hadoop-yarn-server-resourcemanager. |
| | | 142m 46s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-yarn-server-resourcemanager |
| | Inconsistent synchronization of
org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore.isHDFS;
locked 66% of time Unsynchronized access at FileSystemRMStateStore.java:66%
of time Unsynchronized access at FileSystemRMStateStore.java:[line 156] |
| Failed unit tests | hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks |
| | hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempt |
| | hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts |
| | hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs |
| | hadoop.mapreduce.v2.app.webapp.TestAMWebServices |
| | hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf |
| | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesJobConf |
| | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesAttempts |
| | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesJobs |
| | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesJobsQuery |
| | hadoop.mapreduce.v2.hs.webapp.TestHsWebServices |
| | hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesTasks |
| | hadoop.yarn.client.api.impl.TestTimelineClient |
| | hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices |
| | hadoop.yarn.server.timeline.webapp.TestTimelineWebServices |
| | hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilter |
| | hadoop.yarn.server.timeline.webapp.TestTimelineWebServicesWithSSL |
| | hadoop.yarn.server.nodemanager.webapp.TestNMWebServices |
| | hadoop.yarn.server.nodemanager.webapp.TestNMWebServicesApps |
| | hadoop.yarn.server.nodemanager.webapp.TestNMWebServicesContainers |
| |
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppsModification |
| |
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokens |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesCapacitySched |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesFairScheduler |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodeLabels |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServices |
| | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12733701/HADOOP-9613.2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 0790275 |
| javac |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6737/artifact/patchprocess/diffJavacWarnings.txt
|
| Findbugs warnings |
https://builds.apache.o
[jira] [Commented] (HADOOP-11594) Improve the readability of site index of documentation
[
https://issues.apache.org/jira/browse/HADOOP-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551991#comment-14551991
]
Hadoop QA commented on HADOOP-11594:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 2m 54s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | release audit | 0m 19s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | site | 2m 57s | Site still builds. |
| {color:red}-1{color} | whitespace | 0m 0s | The patch has 1 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| | | 6m 13s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734087/HADOOP-11594.004.patch
|
| Optional Tests | site |
| git revision | trunk / ce53c8e |
| whitespace |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6784/artifact/patchprocess/whitespace.txt
|
| Java | 1.7.0_55 |
| uname | Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6784/console |
This message was automatically generated.
> Improve the readability of site index of documentation
> --
>
> Key: HADOOP-11594
> URL: https://issues.apache.org/jira/browse/HADOOP-11594
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
> Attachments: HADOOP-11594.001.patch, HADOOP-11594.002.patch,
> HADOOP-11594.003.patch, HADOOP-11594.004.patch
>
>
> * change the order of items
> * make redundant title shorter and fit it in single line as far as possible
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-9769) Remove org.apache.hadoop.fs.Stat when JDK6 support is dropped
[
https://issues.apache.org/jira/browse/HADOOP-9769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551994#comment-14551994
]
Kengo Seki commented on HADOOP-9769:
[~ajisakaa] thanks for your comment.
bq. I'm thinking we can remove Stat.isAvailable since Stat.getFileStatus is
available from all platforms.
Probably, {{Files.readAttributes(Paths.get(path.toString()),
PosixFileAttributes.class)}} raises {{UnsupportedOperationException}} on
Windows. So isAvailable is still needed and getFileStatus is not platform
independent yet.
bq. In addition, Stat can be removed and Stat.getFileStatus can be moved into
RawLocalFileSystem.
I'd like to do so. And on HADOOP-11935, [~cmccabe] suggests as follows. I'll
refer to it. I think these are very similar issues.
bq. +1 for using java.nio.file on Linux. On Windows we can use winutils like
always. The nice thing is, we won't need multiple code paths. The native
library is mandatory on Windows, and nio will always be available on Linux.
> Remove org.apache.hadoop.fs.Stat when JDK6 support is dropped
> -
>
> Key: HADOOP-9769
> URL: https://issues.apache.org/jira/browse/HADOOP-9769
> Project: Hadoop Common
> Issue Type: Improvement
>Affects Versions: 3.0.0
>Reporter: Andrew Wang
>Assignee: Kengo Seki
>Priority: Minor
> Attachments: HADOOP-9769.001.patch
>
>
> HADOOP-9652 introduces a new class which shells out to stat(1) because of the
> lack of lstat(2) in Java 6. Java 7 has support for reading symlink targets
> via {{Files#readSymbolicLink}}.
> When Hadoop drops Java 6 support, let's use this more portable method instead.
> See:
> http://docs.oracle.com/javase/7/docs/api/java/nio/file/Files.html#readSymbolicLink(java.nio.file.Path)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-9613) [JDK8] Update jersey version to latest 1.x release
[ https://issues.apache.org/jira/browse/HADOOP-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HADOOP-9613: --- Status: Open (was: Patch Available) The test failures are related. I'll fix test failures. Please wait a moment. > [JDK8] Update jersey version to latest 1.x release > -- > > Key: HADOOP-9613 > URL: https://issues.apache.org/jira/browse/HADOOP-9613 > Project: Hadoop Common > Issue Type: Sub-task > Components: build >Affects Versions: 2.4.0, 3.0.0 >Reporter: Timothy St. Clair >Assignee: Timothy St. Clair > Labels: BB2015-05-TBR, maven > Attachments: HADOOP-2.2.0-9613.patch, HADOOP-9613.1.patch, > HADOOP-9613.2.patch, HADOOP-9613.patch > > > Update pom.xml dependencies exposed when running a mvn-rpmbuild against > system dependencies on Fedora 18. > The existing version is 1.8 which is quite old. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11540) Raw Reed-Solomon coder using Intel ISA-L library
[ https://issues.apache.org/jira/browse/HADOOP-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HADOOP-11540: --- Attachment: HADOOP-11540-initial.patch Uploaded the initial patch, pending on deps. > Raw Reed-Solomon coder using Intel ISA-L library > > > Key: HADOOP-11540 > URL: https://issues.apache.org/jira/browse/HADOOP-11540 > Project: Hadoop Common > Issue Type: Sub-task >Affects Versions: HDFS-7285 >Reporter: Zhe Zhang >Assignee: Kai Zheng > Attachments: HADOOP-11540-initial.patch > > > This is to provide RS codec implementation using Intel ISA-L library for > encoding and decoding. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-10366) [Doc] wrap value of io.serializations in core-default.xml to fit better in browser
[
https://issues.apache.org/jira/browse/HADOOP-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kanaka kumar avvaru updated HADOOP-10366:
-
Attachment: HADOOP-10366-04.patch
> [Doc] wrap value of io.serializations in core-default.xml to fit better in
> browser
> --
>
> Key: HADOOP-10366
> URL: https://issues.apache.org/jira/browse/HADOOP-10366
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.0.0
>Reporter: Chengwei Yang
>Assignee: kanaka kumar avvaru
>Priority: Trivial
> Labels: BB2015-05-RFC, documentation, newbie, patch
> Attachments: HADOOP-10366-03.patch, HADOOP-10366-04.patch,
> HADOOP-10366-wrap01, HADOOP-10366-wrap01.patch, HADOOP-10366-wrap02.patch,
> HADOOP-10366.patch
>
>
> The io.serialization property in core-default.xml has a very long value in a
> single line, as below
> {code}
>
> io.serializations
>
> org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
> A list of serialization classes that can be used for
> obtaining serializers and deserializers.
>
> {code}
> which not only break the code style (a very long line) but also not fit well
> in browser. Due to this single very long line, the "description" column can
> not show in browser by default
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11887) Introduce Intel ISA-L erasure coding library for the native support
[ https://issues.apache.org/jira/browse/HADOOP-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552040#comment-14552040 ] Kai Zheng commented on HADOOP-11887: Hi [~cmccabe], I will update the patch here as you suggested. Meanwhile, would you help also take a look at the initial patches attached in HADOOP-11996 that bases on this work and HADOOP-11540 that comes up the resultant native erasure coders? I wish with the two patches it may be more clear how this work will be utilized, and makes sense overall in such organizing, but I'm not very sure. Your suggestion will be valuable and appreciated. Thanks in advance. > Introduce Intel ISA-L erasure coding library for the native support > --- > > Key: HADOOP-11887 > URL: https://issues.apache.org/jira/browse/HADOOP-11887 > Project: Hadoop Common > Issue Type: Sub-task > Components: io >Reporter: Kai Zheng >Assignee: Kai Zheng > Attachments: HADOOP-11887-v1.patch, HADOOP-11887-v2.patch > > > This is to introduce Intel ISA-L erasure coding library for the native > support, via dynamic loading mechanism (dynamic module, like *.so in *nix and > *.dll on Windows). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10366) [Doc] wrap value of io.serializations in core-default.xml to fit better in browser
[
https://issues.apache.org/jira/browse/HADOOP-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552048#comment-14552048
]
kanaka kumar avvaru commented on HADOOP-10366:
--
Thanks [~ajisakaa] for the suggestion. Here I have attached new patch which
includes correction in {{TransparentEncryption.md}}
But {{TransparentEncryption.md}} is in {{hadoop-hdfs}} source. Is it fine to
correct as part of this JIRA which is on Hadoop Common?
> [Doc] wrap value of io.serializations in core-default.xml to fit better in
> browser
> --
>
> Key: HADOOP-10366
> URL: https://issues.apache.org/jira/browse/HADOOP-10366
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.0.0
>Reporter: Chengwei Yang
>Assignee: kanaka kumar avvaru
>Priority: Trivial
> Labels: BB2015-05-RFC, documentation, newbie, patch
> Attachments: HADOOP-10366-03.patch, HADOOP-10366-04.patch,
> HADOOP-10366-wrap01, HADOOP-10366-wrap01.patch, HADOOP-10366-wrap02.patch,
> HADOOP-10366.patch
>
>
> The io.serialization property in core-default.xml has a very long value in a
> single line, as below
> {code}
>
> io.serializations
>
> org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
> A list of serialization classes that can be used for
> obtaining serializers and deserializers.
>
> {code}
> which not only break the code style (a very long line) but also not fit well
> in browser. Due to this single very long line, the "description" column can
> not show in browser by default
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-11698: -- Attachment: HADOOP-11698-branch2.patch > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-branch2.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-11698: -- Attachment: (was: HADOOP-11698-branch2.patch) > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-branch2.patch, HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-11698: -- Attachment: HADOOP-11698-002.patch > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10366) [Doc] wrap value of io.serializations in core-default.xml to fit better in browser
[
https://issues.apache.org/jira/browse/HADOOP-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552054#comment-14552054
]
Akira AJISAKA commented on HADOOP-10366:
Thanks [~kanaka] for updating the patch.
bq. Is it fine to correct as part of this JIRA which is on Hadoop Common?
It's fine because the fix is trivial for HDFS project. There are typically 3
reasons to split the patch into different projects :
https://issues.apache.org/jira/browse/YARN-3587?focusedCommentId=14534625&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14534625
> [Doc] wrap value of io.serializations in core-default.xml to fit better in
> browser
> --
>
> Key: HADOOP-10366
> URL: https://issues.apache.org/jira/browse/HADOOP-10366
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.0.0
>Reporter: Chengwei Yang
>Assignee: kanaka kumar avvaru
>Priority: Trivial
> Labels: BB2015-05-RFC, documentation, newbie, patch
> Attachments: HADOOP-10366-03.patch, HADOOP-10366-04.patch,
> HADOOP-10366-wrap01, HADOOP-10366-wrap01.patch, HADOOP-10366-wrap02.patch,
> HADOOP-10366.patch
>
>
> The io.serialization property in core-default.xml has a very long value in a
> single line, as below
> {code}
>
> io.serializations
>
> org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
> A list of serialization classes that can be used for
> obtaining serializers and deserializers.
>
> {code}
> which not only break the code style (a very long line) but also not fit well
> in browser. Due to this single very long line, the "description" column can
> not show in browser by default
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-11698: -- Status: Patch Available (was: Open) > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552061#comment-14552061 ] Brahma Reddy Battula commented on HADOOP-11698: --- [~ajisakaa] kindly review latest patch.. > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552071#comment-14552071 ] Akira AJISAKA commented on HADOOP-11698: +1 pending Jenkins. Thanks [~brahmareddy] for updating the patch. > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) remove distcpv1 from hadoop-extras
[
https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552094#comment-14552094
]
Hadoop QA commented on HADOOP-11698:
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 14m 35s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | javac | 7m 28s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 32s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 0m 21s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 35s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 34s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | tools/hadoop tests | 0m 51s | Tests passed in
hadoop-extras. |
| | | 35m 55s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734097/HADOOP-11698-002.patch
|
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / ce53c8e |
| hadoop-extras test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6786/artifact/patchprocess/testrun_hadoop-extras.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6786/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6786/console |
This message was automatically generated.
> remove distcpv1 from hadoop-extras
> --
>
> Key: HADOOP-11698
> URL: https://issues.apache.org/jira/browse/HADOOP-11698
> Project: Hadoop Common
> Issue Type: Improvement
> Components: tools/distcp
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
>Assignee: Brahma Reddy Battula
> Labels: BB2015-05-TBR
> Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch,
> HADOOP-11698.patch
>
>
> distcpv1 is pretty much unsupported. we should just remove it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) remove distcpv1 from hadoop-extras
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552100#comment-14552100 ] Akira AJISAKA commented on HADOOP-11698: Committing this shortly. > remove distcpv1 from hadoop-extras > -- > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Labels: BB2015-05-TBR > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HADOOP-11698: --- Labels: (was: BB2015-05-TBR) Release Note: Removed DistCpV1 and Logalyzer. Summary: Remove DistCpV1 and Logalyzer (was: remove distcpv1 from hadoop-extras) Hadoop Flags: Incompatible change,Reviewed (was: Incompatible change) > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HADOOP-11698: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Committed this to trunk. Thanks [~brahmareddy] for the contribution! > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552142#comment-14552142 ] Hudson commented on HADOOP-11698: - FAILURE: Integrated in Hadoop-trunk-Commit #7874 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/7874/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-9922) hadoop windows native build will fail in 32 bit machine
[ https://issues.apache.org/jira/browse/HADOOP-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552149#comment-14552149 ] Rohan Kulkarni commented on HADOOP-9922: Please can someone tell me how to install the patch , i don't see the patch ? is it some jar or something ? > hadoop windows native build will fail in 32 bit machine > --- > > Key: HADOOP-9922 > URL: https://issues.apache.org/jira/browse/HADOOP-9922 > Project: Hadoop Common > Issue Type: Bug > Components: build, native >Affects Versions: 3.0.0, 2.1.1-beta >Reporter: Vinayakumar B >Assignee: Kiran Kumar M R > Fix For: 2.7.0 > > Attachments: HADOOP-9922-002.patch, HADOOP-9922-003.patch, > HADOOP-9922-004.patch, HADOOP-9922-005.patch, HADOOP-9922.patch > > > Building Hadoop in windows 32 bit machine fails as native project is not > having Win32 configuration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-9922) hadoop windows native build will fail in 32 bit machine
[
https://issues.apache.org/jira/browse/HADOOP-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552157#comment-14552157
]
Kiran Kumar M R commented on HADOOP-9922:
-
Patch file is attached in this JIRA. Check attachments section.
HADOOP-9922-005.patch is latest and committed patch,
Download this file and place it in your hadoop source directory.
Use {{git apply HADOOP-9922-005.patch}} command to apply patch.
> hadoop windows native build will fail in 32 bit machine
> ---
>
> Key: HADOOP-9922
> URL: https://issues.apache.org/jira/browse/HADOOP-9922
> Project: Hadoop Common
> Issue Type: Bug
> Components: build, native
>Affects Versions: 3.0.0, 2.1.1-beta
>Reporter: Vinayakumar B
>Assignee: Kiran Kumar M R
> Fix For: 2.7.0
>
> Attachments: HADOOP-9922-002.patch, HADOOP-9922-003.patch,
> HADOOP-9922-004.patch, HADOOP-9922-005.patch, HADOOP-9922.patch
>
>
> Building Hadoop in windows 32 bit machine fails as native project is not
> having Win32 configuration
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11970) Replace uses of ThreadLocal with JDK7 ThreadLocalRandom
[ https://issues.apache.org/jira/browse/HADOOP-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552184#comment-14552184 ] Hudson commented on HADOOP-11970: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #202 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/202/]) HADOOP-11970. Replace uses of ThreadLocal with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) (cmccabe: rev 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/Host2NodesMap.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestDNFencing.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryPolicies.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/sharedcache/SharedCacheUploader.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestAppendSnapshotTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestByteArrayManager.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java > Replace uses of ThreadLocal with JDK7 ThreadLocalRandom > --- > > Key: HADOOP-11970 > URL: https://issues.apache.org/jira/browse/HADOOP-11970 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.8.0 > > Attachments: HADOOP-11970.1.patch, HADOOP-11970.2.patch, > HADOOP-11970.3.patch > > > ThreadLocalRandom should be used when available in place of > ThreadLocal. For JDK7 the difference is minimal, but JDK8 starts > including optimizations for ThreadLocalRandom. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11973) Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs
[ https://issues.apache.org/jira/browse/HADOOP-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552179#comment-14552179 ] Hudson commented on HADOOP-11973: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #202 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/202/]) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) (Arun Suresh: rev fd3cb533d2495ea220ab2e468835a43a784d7532) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/ZKDelegationTokenSecretManager.java > Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs > > > Key: HADOOP-11973 > URL: https://issues.apache.org/jira/browse/HADOOP-11973 > Project: Hadoop Common > Issue Type: Bug > Components: security >Affects Versions: 2.6.0 >Reporter: Gregory Chanan >Assignee: Gregory Chanan > Fix For: 2.7.1 > > Attachments: HADOOP-11973.patch, HADOOP-11973v2.patch, > HADOOP-11973v3.patch > > > I recently added an ACL Provider to the curator framework instance I pass to > the ZkDelegationTokenSecretManager, and notice some strangeness around ACLs. > I set: "zk-dt-secret-manager.znodeWorkingPath" to: > "solr/zkdtsm" > and notice that > /solr/zkdtsm/ > /solr/zkdtsm/ZKDTSMRoot > do not have ACLs > but all the znodes under /solr/zkdtsm/ZKDTSMRoot have ACLs. From adding some > logging, it looks like the ACLProvider is never called for /solr/zkdtsm and > /solr/zkdtsm/ZKDTSMRoot. I don't know if that's a Curator or > ZkDelegationTokenSecretManager issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12000) cannot use --java-home in test-patch
[ https://issues.apache.org/jira/browse/HADOOP-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552183#comment-14552183 ] Hudson commented on HADOOP-12000: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #202 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/202/]) HADOOP-12000. cannot use --java-home in test-patch (aw) (aw: rev 12d6c5ce4f78bc0e9464522715920866abe1f727) * hadoop-common-project/hadoop-common/CHANGES.txt * dev-support/test-patch.sh > cannot use --java-home in test-patch > > > Key: HADOOP-12000 > URL: https://issues.apache.org/jira/browse/HADOOP-12000 > Project: Hadoop Common > Issue Type: Test > Components: scripts >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 2.8.0 > > Attachments: HADOOP-12000.patch > > > Trivial bug, but breaks the docker patch: --java-home=blah doesn't work > because the case statement is broken. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11963) Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
[
https://issues.apache.org/jira/browse/HADOOP-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552193#comment-14552193
]
Hudson commented on HADOOP-11963:
-
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #202 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/202/])
HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer. (cnauroth: rev
e422e76fcaaa04fc22384d978a2abae967d801b6)
* hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
* hadoop-common-project/hadoop-common/CHANGES.txt
> Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
> -
>
> Key: HADOOP-11963
> URL: https://issues.apache.org/jira/browse/HADOOP-11963
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.7.0
>Reporter: Chris Nauroth
>Assignee: Anu Engineer
>Priority: Trivial
> Labels: newbie
> Fix For: 2.8.0
>
> Attachments: HADOOP-11963.001.patch
>
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Metrics.html#FSNamesystem
> {quote}
> PendingDataNodeMessageCourt (HA-only) Current number of pending
> block-related messages for later processing in the standby NameNode
> {quote}
> This needs to be changed to "PendingDataNodeMessageCount".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552178#comment-14552178 ] Hudson commented on HADOOP-11698: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #202 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/202/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11995) Make jetty version configurable from the maven command line
[ https://issues.apache.org/jira/browse/HADOOP-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552182#comment-14552182 ] Hudson commented on HADOOP-11995: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #202 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/202/]) HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. (wheat9: rev ce53c8eb0ccc582957ba1f4c0b7938db00f6ca31) * hadoop-project/pom.xml * hadoop-common-project/hadoop-common/CHANGES.txt > Make jetty version configurable from the maven command line > --- > > Key: HADOOP-11995 > URL: https://issues.apache.org/jira/browse/HADOOP-11995 > Project: Hadoop Common > Issue Type: Improvement > Components: build, ld >Reporter: sriharsha devineni >Assignee: sriharsha devineni >Priority: Trivial > Fix For: 2.8.0 > > Attachments: patch.txt > > > Variablize jetty version, which can be overwritten from maven command line > while building. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552201#comment-14552201 ] Hudson commented on HADOOP-11698: - SUCCESS: Integrated in Hadoop-Yarn-trunk #933 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/933/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java * hadoop-common-project/hadoop-common/CHANGES.txt > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11995) Make jetty version configurable from the maven command line
[ https://issues.apache.org/jira/browse/HADOOP-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552205#comment-14552205 ] Hudson commented on HADOOP-11995: - SUCCESS: Integrated in Hadoop-Yarn-trunk #933 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/933/]) HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. (wheat9: rev ce53c8eb0ccc582957ba1f4c0b7938db00f6ca31) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-project/pom.xml > Make jetty version configurable from the maven command line > --- > > Key: HADOOP-11995 > URL: https://issues.apache.org/jira/browse/HADOOP-11995 > Project: Hadoop Common > Issue Type: Improvement > Components: build, ld >Reporter: sriharsha devineni >Assignee: sriharsha devineni >Priority: Trivial > Fix For: 2.8.0 > > Attachments: patch.txt > > > Variablize jetty version, which can be overwritten from maven command line > while building. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11973) Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs
[ https://issues.apache.org/jira/browse/HADOOP-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552202#comment-14552202 ] Hudson commented on HADOOP-11973: - SUCCESS: Integrated in Hadoop-Yarn-trunk #933 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/933/]) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) (Arun Suresh: rev fd3cb533d2495ea220ab2e468835a43a784d7532) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/ZKDelegationTokenSecretManager.java > Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs > > > Key: HADOOP-11973 > URL: https://issues.apache.org/jira/browse/HADOOP-11973 > Project: Hadoop Common > Issue Type: Bug > Components: security >Affects Versions: 2.6.0 >Reporter: Gregory Chanan >Assignee: Gregory Chanan > Fix For: 2.7.1 > > Attachments: HADOOP-11973.patch, HADOOP-11973v2.patch, > HADOOP-11973v3.patch > > > I recently added an ACL Provider to the curator framework instance I pass to > the ZkDelegationTokenSecretManager, and notice some strangeness around ACLs. > I set: "zk-dt-secret-manager.znodeWorkingPath" to: > "solr/zkdtsm" > and notice that > /solr/zkdtsm/ > /solr/zkdtsm/ZKDTSMRoot > do not have ACLs > but all the znodes under /solr/zkdtsm/ZKDTSMRoot have ACLs. From adding some > logging, it looks like the ACLProvider is never called for /solr/zkdtsm and > /solr/zkdtsm/ZKDTSMRoot. I don't know if that's a Curator or > ZkDelegationTokenSecretManager issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11963) Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
[
https://issues.apache.org/jira/browse/HADOOP-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552215#comment-14552215
]
Hudson commented on HADOOP-11963:
-
SUCCESS: Integrated in Hadoop-Yarn-trunk #933 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/933/])
HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer. (cnauroth: rev
e422e76fcaaa04fc22384d978a2abae967d801b6)
* hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
* hadoop-common-project/hadoop-common/CHANGES.txt
> Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
> -
>
> Key: HADOOP-11963
> URL: https://issues.apache.org/jira/browse/HADOOP-11963
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.7.0
>Reporter: Chris Nauroth
>Assignee: Anu Engineer
>Priority: Trivial
> Labels: newbie
> Fix For: 2.8.0
>
> Attachments: HADOOP-11963.001.patch
>
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Metrics.html#FSNamesystem
> {quote}
> PendingDataNodeMessageCourt (HA-only) Current number of pending
> block-related messages for later processing in the standby NameNode
> {quote}
> This needs to be changed to "PendingDataNodeMessageCount".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11970) Replace uses of ThreadLocal with JDK7 ThreadLocalRandom
[ https://issues.apache.org/jira/browse/HADOOP-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552207#comment-14552207 ] Hudson commented on HADOOP-11970: - SUCCESS: Integrated in Hadoop-Yarn-trunk #933 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/933/]) HADOOP-11970. Replace uses of ThreadLocal with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) (cmccabe: rev 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestAppendSnapshotTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/Host2NodesMap.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryPolicies.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestDNFencing.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestByteArrayManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/sharedcache/SharedCacheUploader.java > Replace uses of ThreadLocal with JDK7 ThreadLocalRandom > --- > > Key: HADOOP-11970 > URL: https://issues.apache.org/jira/browse/HADOOP-11970 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.8.0 > > Attachments: HADOOP-11970.1.patch, HADOOP-11970.2.patch, > HADOOP-11970.3.patch > > > ThreadLocalRandom should be used when available in place of > ThreadLocal. For JDK7 the difference is minimal, but JDK8 starts > including optimizations for ThreadLocalRandom. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12000) cannot use --java-home in test-patch
[ https://issues.apache.org/jira/browse/HADOOP-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552206#comment-14552206 ] Hudson commented on HADOOP-12000: - SUCCESS: Integrated in Hadoop-Yarn-trunk #933 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/933/]) HADOOP-12000. cannot use --java-home in test-patch (aw) (aw: rev 12d6c5ce4f78bc0e9464522715920866abe1f727) * dev-support/test-patch.sh * hadoop-common-project/hadoop-common/CHANGES.txt > cannot use --java-home in test-patch > > > Key: HADOOP-12000 > URL: https://issues.apache.org/jira/browse/HADOOP-12000 > Project: Hadoop Common > Issue Type: Test > Components: scripts >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 2.8.0 > > Attachments: HADOOP-12000.patch > > > Trivial bug, but breaks the docker patch: --java-home=blah doesn't work > because the case statement is broken. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-12008) Investigate providing SPARC hardware-accelerated CRC32 code
Alan Burlison created HADOOP-12008: -- Summary: Investigate providing SPARC hardware-accelerated CRC32 code Key: HADOOP-12008 URL: https://issues.apache.org/jira/browse/HADOOP-12008 Project: Hadoop Common Issue Type: Sub-task Components: performance Affects Versions: 2.7.0 Environment: Solaris SPARC Reporter: Alan Burlison hadoop-common-project/hadoop-common/src/main/native/src/org/apache/hadoop/util contains code for hardware-accelerated CRC32 on x86 platforms. There is no corresponding code for the SPARC architecture, the possibility of providing it should be investigated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-10366) [Doc] wrap value of io.serializations in core-default.xml to fit better in browser
[
https://issues.apache.org/jira/browse/HADOOP-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552270#comment-14552270
]
Hadoop QA commented on HADOOP-10366:
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 17m 58s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 44s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 47s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | site | 3m 2s | Site still builds. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 36s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 33s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | common tests | 23m 0s | Tests passed in
hadoop-common. |
| {color:red}-1{color} | hdfs tests | 152m 35s | Tests failed in hadoop-hdfs. |
| | | 216m 40s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.hdfs.server.namenode.TestDeadDatanode |
| | hadoop.hdfs.server.namenode.TestTransferFsImage |
| | hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps |
| | hadoop.hdfs.server.namenode.TestMetaSave |
| Timed out tests |
org.apache.hadoop.hdfs.server.namenode.TestLargeDirectoryDelete |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734095/HADOOP-10366-04.patch |
| Optional Tests | javadoc javac unit site |
| git revision | trunk / ce53c8e |
| hadoop-common test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6785/artifact/patchprocess/testrun_hadoop-common.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6785/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6785/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6785/console |
This message was automatically generated.
> [Doc] wrap value of io.serializations in core-default.xml to fit better in
> browser
> --
>
> Key: HADOOP-10366
> URL: https://issues.apache.org/jira/browse/HADOOP-10366
> Project: Hadoop Common
> Issue Type: Improvement
> Components: documentation
>Affects Versions: 3.0.0
>Reporter: Chengwei Yang
>Assignee: kanaka kumar avvaru
>Priority: Trivial
> Labels: BB2015-05-RFC, documentation, newbie, patch
> Attachments: HADOOP-10366-03.patch, HADOOP-10366-04.patch,
> HADOOP-10366-wrap01, HADOOP-10366-wrap01.patch, HADOOP-10366-wrap02.patch,
> HADOOP-10366.patch
>
>
> The io.serialization property in core-default.xml has a very long value in a
> single line, as below
> {code}
>
> io.serializations
>
> org.apache.hadoop.io.serializer.WritableSerialization,org.apache.hadoop.io.serializer.avro.AvroSpecificSerialization,org.apache.hadoop.io.serializer.avro.AvroReflectSerialization
> A list of serialization classes that can be used for
> obtaining serializers and deserializers.
>
> {code}
> which not only break the code style (a very long line) but also not fit well
> in browser. Due to this single very long line, the "description" column can
> not show in browser by default
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-12007) GzipCodec native CodecPool leaks memory
[ https://issues.apache.org/jira/browse/HADOOP-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552330#comment-14552330 ] Ravi Prakash commented on HADOOP-12007: --- What version of Hadoop are you using Yejun? > GzipCodec native CodecPool leaks memory > --- > > Key: HADOOP-12007 > URL: https://issues.apache.org/jira/browse/HADOOP-12007 > Project: Hadoop Common > Issue Type: Bug >Reporter: Yejun Yang > > org/apache/hadoop/io/compress/GzipCodec.java call > CompressionCodec.Util.createOutputStreamWithCodecPool to use CodecPool. But > compressor objects are actually never returned to pool which cause memory > leak. > HADOOP-10591 uses CompressionOutputStream.close() to return Compressor object > to pool. But CompressionCodec.Util.createOutputStreamWithCodecPool actually > returns a CompressorStream which overrides close(). > This cause CodecPool.returnCompressor never being called. In my log file I > can see lots of "Got brand-new compressor [.gz]" but no "Got recycled > compressor". -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12000) cannot use --java-home in test-patch
[ https://issues.apache.org/jira/browse/HADOOP-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552389#comment-14552389 ] Hudson commented on HADOOP-12000: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2131 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2131/]) HADOOP-12000. cannot use --java-home in test-patch (aw) (aw: rev 12d6c5ce4f78bc0e9464522715920866abe1f727) * dev-support/test-patch.sh * hadoop-common-project/hadoop-common/CHANGES.txt > cannot use --java-home in test-patch > > > Key: HADOOP-12000 > URL: https://issues.apache.org/jira/browse/HADOOP-12000 > Project: Hadoop Common > Issue Type: Test > Components: scripts >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 2.8.0 > > Attachments: HADOOP-12000.patch > > > Trivial bug, but breaks the docker patch: --java-home=blah doesn't work > because the case statement is broken. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11963) Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
[
https://issues.apache.org/jira/browse/HADOOP-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552398#comment-14552398
]
Hudson commented on HADOOP-11963:
-
FAILURE: Integrated in Hadoop-Hdfs-trunk #2131 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2131/])
HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer. (cnauroth: rev
e422e76fcaaa04fc22384d978a2abae967d801b6)
* hadoop-common-project/hadoop-common/CHANGES.txt
* hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
> Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
> -
>
> Key: HADOOP-11963
> URL: https://issues.apache.org/jira/browse/HADOOP-11963
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.7.0
>Reporter: Chris Nauroth
>Assignee: Anu Engineer
>Priority: Trivial
> Labels: newbie
> Fix For: 2.8.0
>
> Attachments: HADOOP-11963.001.patch
>
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Metrics.html#FSNamesystem
> {quote}
> PendingDataNodeMessageCourt (HA-only) Current number of pending
> block-related messages for later processing in the standby NameNode
> {quote}
> This needs to be changed to "PendingDataNodeMessageCount".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11973) Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs
[ https://issues.apache.org/jira/browse/HADOOP-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552385#comment-14552385 ] Hudson commented on HADOOP-11973: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2131 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2131/]) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) (Arun Suresh: rev fd3cb533d2495ea220ab2e468835a43a784d7532) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/ZKDelegationTokenSecretManager.java > Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs > > > Key: HADOOP-11973 > URL: https://issues.apache.org/jira/browse/HADOOP-11973 > Project: Hadoop Common > Issue Type: Bug > Components: security >Affects Versions: 2.6.0 >Reporter: Gregory Chanan >Assignee: Gregory Chanan > Fix For: 2.7.1 > > Attachments: HADOOP-11973.patch, HADOOP-11973v2.patch, > HADOOP-11973v3.patch > > > I recently added an ACL Provider to the curator framework instance I pass to > the ZkDelegationTokenSecretManager, and notice some strangeness around ACLs. > I set: "zk-dt-secret-manager.znodeWorkingPath" to: > "solr/zkdtsm" > and notice that > /solr/zkdtsm/ > /solr/zkdtsm/ZKDTSMRoot > do not have ACLs > but all the znodes under /solr/zkdtsm/ZKDTSMRoot have ACLs. From adding some > logging, it looks like the ACLProvider is never called for /solr/zkdtsm and > /solr/zkdtsm/ZKDTSMRoot. I don't know if that's a Curator or > ZkDelegationTokenSecretManager issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11970) Replace uses of ThreadLocal with JDK7 ThreadLocalRandom
[ https://issues.apache.org/jira/browse/HADOOP-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552390#comment-14552390 ] Hudson commented on HADOOP-11970: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2131 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2131/]) HADOOP-11970. Replace uses of ThreadLocal with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) (cmccabe: rev 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestAppendSnapshotTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/Host2NodesMap.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryPolicies.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/sharedcache/SharedCacheUploader.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestByteArrayManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestDNFencing.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java > Replace uses of ThreadLocal with JDK7 ThreadLocalRandom > --- > > Key: HADOOP-11970 > URL: https://issues.apache.org/jira/browse/HADOOP-11970 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.8.0 > > Attachments: HADOOP-11970.1.patch, HADOOP-11970.2.patch, > HADOOP-11970.3.patch > > > ThreadLocalRandom should be used when available in place of > ThreadLocal. For JDK7 the difference is minimal, but JDK8 starts > including optimizations for ThreadLocalRandom. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552384#comment-14552384 ] Hudson commented on HADOOP-11698: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2131 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2131/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11995) Make jetty version configurable from the maven command line
[ https://issues.apache.org/jira/browse/HADOOP-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552388#comment-14552388 ] Hudson commented on HADOOP-11995: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2131 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2131/]) HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. (wheat9: rev ce53c8eb0ccc582957ba1f4c0b7938db00f6ca31) * hadoop-project/pom.xml * hadoop-common-project/hadoop-common/CHANGES.txt > Make jetty version configurable from the maven command line > --- > > Key: HADOOP-11995 > URL: https://issues.apache.org/jira/browse/HADOOP-11995 > Project: Hadoop Common > Issue Type: Improvement > Components: build, ld >Reporter: sriharsha devineni >Assignee: sriharsha devineni >Priority: Trivial > Fix For: 2.8.0 > > Attachments: patch.txt > > > Variablize jetty version, which can be overwritten from maven command line > while building. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12007) GzipCodec native CodecPool leaks memory
[ https://issues.apache.org/jira/browse/HADOOP-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552407#comment-14552407 ] Yejun Yang commented on HADOOP-12007: - 2.7.0. My code use CompressionCodecFactory getCodecByClassName to get the codec object. Then create with the CompressorStream with createOutputStream(out). If I use CodecPool directly with createOutputStream(out, compressor) and returning comporessor to pool afterward, everything works correctly. > GzipCodec native CodecPool leaks memory > --- > > Key: HADOOP-12007 > URL: https://issues.apache.org/jira/browse/HADOOP-12007 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.0 >Reporter: Yejun Yang > > org/apache/hadoop/io/compress/GzipCodec.java call > CompressionCodec.Util.createOutputStreamWithCodecPool to use CodecPool. But > compressor objects are actually never returned to pool which cause memory > leak. > HADOOP-10591 uses CompressionOutputStream.close() to return Compressor object > to pool. But CompressionCodec.Util.createOutputStreamWithCodecPool actually > returns a CompressorStream which overrides close(). > This cause CodecPool.returnCompressor never being called. In my log file I > can see lots of "Got brand-new compressor [.gz]" but no "Got recycled > compressor". -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-12007) GzipCodec native CodecPool leaks memory
[ https://issues.apache.org/jira/browse/HADOOP-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yejun Yang updated HADOOP-12007: Affects Version/s: 2.7.0 > GzipCodec native CodecPool leaks memory > --- > > Key: HADOOP-12007 > URL: https://issues.apache.org/jira/browse/HADOOP-12007 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.0 >Reporter: Yejun Yang > > org/apache/hadoop/io/compress/GzipCodec.java call > CompressionCodec.Util.createOutputStreamWithCodecPool to use CodecPool. But > compressor objects are actually never returned to pool which cause memory > leak. > HADOOP-10591 uses CompressionOutputStream.close() to return Compressor object > to pool. But CompressionCodec.Util.createOutputStreamWithCodecPool actually > returns a CompressorStream which overrides close(). > This cause CodecPool.returnCompressor never being called. In my log file I > can see lots of "Got brand-new compressor [.gz]" but no "Got recycled > compressor". -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12007) GzipCodec native CodecPool leaks memory
[ https://issues.apache.org/jira/browse/HADOOP-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552415#comment-14552415 ] Yejun Yang commented on HADOOP-12007: - If I understand HADOOP-10591 correctly, the code to return comprossor to codecpool was never called. Because the close() method in CompressionOutputStream.java is overrrided by CompressorStream.java. > GzipCodec native CodecPool leaks memory > --- > > Key: HADOOP-12007 > URL: https://issues.apache.org/jira/browse/HADOOP-12007 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.0 >Reporter: Yejun Yang > > org/apache/hadoop/io/compress/GzipCodec.java call > CompressionCodec.Util.createOutputStreamWithCodecPool to use CodecPool. But > compressor objects are actually never returned to pool which cause memory > leak. > HADOOP-10591 uses CompressionOutputStream.close() to return Compressor object > to pool. But CompressionCodec.Util.createOutputStreamWithCodecPool actually > returns a CompressorStream which overrides close(). > This cause CodecPool.returnCompressor never being called. In my log file I > can see lots of "Got brand-new compressor [.gz]" but no "Got recycled > compressor". -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11973) Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs
[ https://issues.apache.org/jira/browse/HADOOP-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552435#comment-14552435 ] Hudson commented on HADOOP-11973: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #191 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/]) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) (Arun Suresh: rev fd3cb533d2495ea220ab2e468835a43a784d7532) * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/ZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/CHANGES.txt > Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs > > > Key: HADOOP-11973 > URL: https://issues.apache.org/jira/browse/HADOOP-11973 > Project: Hadoop Common > Issue Type: Bug > Components: security >Affects Versions: 2.6.0 >Reporter: Gregory Chanan >Assignee: Gregory Chanan > Fix For: 2.7.1 > > Attachments: HADOOP-11973.patch, HADOOP-11973v2.patch, > HADOOP-11973v3.patch > > > I recently added an ACL Provider to the curator framework instance I pass to > the ZkDelegationTokenSecretManager, and notice some strangeness around ACLs. > I set: "zk-dt-secret-manager.znodeWorkingPath" to: > "solr/zkdtsm" > and notice that > /solr/zkdtsm/ > /solr/zkdtsm/ZKDTSMRoot > do not have ACLs > but all the znodes under /solr/zkdtsm/ZKDTSMRoot have ACLs. From adding some > logging, it looks like the ACLProvider is never called for /solr/zkdtsm and > /solr/zkdtsm/ZKDTSMRoot. I don't know if that's a Curator or > ZkDelegationTokenSecretManager issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11970) Replace uses of ThreadLocal with JDK7 ThreadLocalRandom
[ https://issues.apache.org/jira/browse/HADOOP-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552440#comment-14552440 ] Hudson commented on HADOOP-11970: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #191 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/]) HADOOP-11970. Replace uses of ThreadLocal with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) (cmccabe: rev 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/sharedcache/SharedCacheUploader.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryPolicies.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/Host2NodesMap.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestByteArrayManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestDNFencing.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestAppendSnapshotTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java > Replace uses of ThreadLocal with JDK7 ThreadLocalRandom > --- > > Key: HADOOP-11970 > URL: https://issues.apache.org/jira/browse/HADOOP-11970 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.8.0 > > Attachments: HADOOP-11970.1.patch, HADOOP-11970.2.patch, > HADOOP-11970.3.patch > > > ThreadLocalRandom should be used when available in place of > ThreadLocal. For JDK7 the difference is minimal, but JDK8 starts > including optimizations for ThreadLocalRandom. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12000) cannot use --java-home in test-patch
[ https://issues.apache.org/jira/browse/HADOOP-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552439#comment-14552439 ] Hudson commented on HADOOP-12000: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #191 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/]) HADOOP-12000. cannot use --java-home in test-patch (aw) (aw: rev 12d6c5ce4f78bc0e9464522715920866abe1f727) * dev-support/test-patch.sh * hadoop-common-project/hadoop-common/CHANGES.txt > cannot use --java-home in test-patch > > > Key: HADOOP-12000 > URL: https://issues.apache.org/jira/browse/HADOOP-12000 > Project: Hadoop Common > Issue Type: Test > Components: scripts >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 2.8.0 > > Attachments: HADOOP-12000.patch > > > Trivial bug, but breaks the docker patch: --java-home=blah doesn't work > because the case statement is broken. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552434#comment-14552434 ] Hudson commented on HADOOP-11698: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #191 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11995) Make jetty version configurable from the maven command line
[ https://issues.apache.org/jira/browse/HADOOP-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552438#comment-14552438 ] Hudson commented on HADOOP-11995: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #191 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/]) HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. (wheat9: rev ce53c8eb0ccc582957ba1f4c0b7938db00f6ca31) * hadoop-project/pom.xml * hadoop-common-project/hadoop-common/CHANGES.txt > Make jetty version configurable from the maven command line > --- > > Key: HADOOP-11995 > URL: https://issues.apache.org/jira/browse/HADOOP-11995 > Project: Hadoop Common > Issue Type: Improvement > Components: build, ld >Reporter: sriharsha devineni >Assignee: sriharsha devineni >Priority: Trivial > Fix For: 2.8.0 > > Attachments: patch.txt > > > Variablize jetty version, which can be overwritten from maven command line > while building. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11963) Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
[
https://issues.apache.org/jira/browse/HADOOP-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552448#comment-14552448
]
Hudson commented on HADOOP-11963:
-
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #191 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/191/])
HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer. (cnauroth: rev
e422e76fcaaa04fc22384d978a2abae967d801b6)
* hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
* hadoop-common-project/hadoop-common/CHANGES.txt
> Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
> -
>
> Key: HADOOP-11963
> URL: https://issues.apache.org/jira/browse/HADOOP-11963
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.7.0
>Reporter: Chris Nauroth
>Assignee: Anu Engineer
>Priority: Trivial
> Labels: newbie
> Fix For: 2.8.0
>
> Attachments: HADOOP-11963.001.patch
>
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Metrics.html#FSNamesystem
> {quote}
> PendingDataNodeMessageCourt (HA-only) Current number of pending
> block-related messages for later processing in the standby NameNode
> {quote}
> This needs to be changed to "PendingDataNodeMessageCount".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[
https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552461#comment-14552461
]
Sean Busbey commented on HADOOP-11933:
--
{quote}
+ --java-home)
+JAVA_HOME=${i#*=}
{quote}
Doesn't this need to do the --java-home=*) thing that the other options do?
> run test-patch.sh in a docker container under Jenkins
> -
>
> Key: HADOOP-11933
> URL: https://issues.apache.org/jira/browse/HADOOP-11933
> Project: Hadoop Common
> Issue Type: Test
>Reporter: Allen Wittenauer
>Assignee: Allen Wittenauer
> Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch,
> HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch
>
>
> because of how hard it is to control the content of the Jenkins environment,
> it would be beneficial to run it in a docker container so that we can have
> tight control of the environment
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[
https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552472#comment-14552472
]
Sean Busbey commented on HADOOP-11933:
--
{code}
+function cleanup_apache_jenkins_docker
+{
+ # On Jenkins, do some cleanup of old stuff since
+ # no body else seems to be
+
{code}
{code}
+ # make a base image, if it isn't available
+ dockercmd build -t "${baseimagename}" "${BINDIR}"
+
+ # using the base image, make one that is patch specific
{code}
Can we add some timing in here so we know how much time patch-tester is
spending on docker maintenance?
> run test-patch.sh in a docker container under Jenkins
> -
>
> Key: HADOOP-11933
> URL: https://issues.apache.org/jira/browse/HADOOP-11933
> Project: Hadoop Common
> Issue Type: Test
>Reporter: Allen Wittenauer
>Assignee: Allen Wittenauer
> Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch,
> HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch
>
>
> because of how hard it is to control the content of the Jenkins environment,
> it would be beneficial to run it in a docker container so that we can have
> tight control of the environment
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[
https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552477#comment-14552477
]
Sean Busbey commented on HADOOP-11933:
--
{code}
+ --build-url=*)
+BUILD_URL=${i#*=}
+ ;;
{code}
no help for this option?
> run test-patch.sh in a docker container under Jenkins
> -
>
> Key: HADOOP-11933
> URL: https://issues.apache.org/jira/browse/HADOOP-11933
> Project: Hadoop Common
> Issue Type: Test
>Reporter: Allen Wittenauer
>Assignee: Allen Wittenauer
> Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch,
> HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch
>
>
> because of how hard it is to control the content of the Jenkins environment,
> it would be beneficial to run it in a docker container so that we can have
> tight control of the environment
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Assigned] (HADOOP-12004) test-patch breaks with reexec in certain situations
[
https://issues.apache.org/jira/browse/HADOOP-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey reassigned HADOOP-12004:
Assignee: Sean Busbey
> test-patch breaks with reexec in certain situations
> ---
>
> Key: HADOOP-12004
> URL: https://issues.apache.org/jira/browse/HADOOP-12004
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Allen Wittenauer
>Assignee: Sean Busbey
>Priority: Critical
>
> Looks like HADOOP-11911 forgot the equal sign:
> {code}
> exec "${PATCH_DIR}/dev-support-test/test-patch.sh" \
> --reexec \
> --branch "${PATCH_BRANCH}" \
> --patch-dir="${PATCH_DIR}" \
> "${USER_PARAMS[@]}"
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-12004) test-patch breaks with reexec in certain situations
[
https://issues.apache.org/jira/browse/HADOOP-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552483#comment-14552483
]
Sean Busbey commented on HADOOP-12004:
--
shoot.
> test-patch breaks with reexec in certain situations
> ---
>
> Key: HADOOP-12004
> URL: https://issues.apache.org/jira/browse/HADOOP-12004
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Allen Wittenauer
>Priority: Critical
>
> Looks like HADOOP-11911 forgot the equal sign:
> {code}
> exec "${PATCH_DIR}/dev-support-test/test-patch.sh" \
> --reexec \
> --branch "${PATCH_BRANCH}" \
> --patch-dir="${PATCH_DIR}" \
> "${USER_PARAMS[@]}"
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552518#comment-14552518 ] Allen Wittenauer commented on HADOOP-11933: --- Woops, yes, I must have missed that in my rebase. > run test-patch.sh in a docker container under Jenkins > - > > Key: HADOOP-11933 > URL: https://issues.apache.org/jira/browse/HADOOP-11933 > Project: Hadoop Common > Issue Type: Test >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch, > HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch > > > because of how hard it is to control the content of the Jenkins environment, > it would be beneficial to run it in a docker container so that we can have > tight control of the environment -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552522#comment-14552522 ] Allen Wittenauer commented on HADOOP-11933: --- Technically, it's meant to be private for test-patch since the API for Jenkins to set it was always via an env var. But documenting it wouldn't be bad I guess in case we want to switch Jenkins over to be parameterized too. > run test-patch.sh in a docker container under Jenkins > - > > Key: HADOOP-11933 > URL: https://issues.apache.org/jira/browse/HADOOP-11933 > Project: Hadoop Common > Issue Type: Test >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch, > HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch > > > because of how hard it is to control the content of the Jenkins environment, > it would be beneficial to run it in a docker container so that we can have > tight control of the environment -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552526#comment-14552526 ] Allen Wittenauer commented on HADOOP-11933: --- Good idea. Do we want a global time or a per-step time? Global is certainly going to be easier. > run test-patch.sh in a docker container under Jenkins > - > > Key: HADOOP-11933 > URL: https://issues.apache.org/jira/browse/HADOOP-11933 > Project: Hadoop Common > Issue Type: Test >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch, > HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch > > > because of how hard it is to control the content of the Jenkins environment, > it would be beneficial to run it in a docker container so that we can have > tight control of the environment -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12000) cannot use --java-home in test-patch
[ https://issues.apache.org/jira/browse/HADOOP-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552551#comment-14552551 ] Hudson commented on HADOOP-12000: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #201 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/201/]) HADOOP-12000. cannot use --java-home in test-patch (aw) (aw: rev 12d6c5ce4f78bc0e9464522715920866abe1f727) * dev-support/test-patch.sh * hadoop-common-project/hadoop-common/CHANGES.txt > cannot use --java-home in test-patch > > > Key: HADOOP-12000 > URL: https://issues.apache.org/jira/browse/HADOOP-12000 > Project: Hadoop Common > Issue Type: Test > Components: scripts >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 2.8.0 > > Attachments: HADOOP-12000.patch > > > Trivial bug, but breaks the docker patch: --java-home=blah doesn't work > because the case statement is broken. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552546#comment-14552546 ] Hudson commented on HADOOP-11698: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #201 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/201/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11995) Make jetty version configurable from the maven command line
[ https://issues.apache.org/jira/browse/HADOOP-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552550#comment-14552550 ] Hudson commented on HADOOP-11995: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #201 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/201/]) HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. (wheat9: rev ce53c8eb0ccc582957ba1f4c0b7938db00f6ca31) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-project/pom.xml > Make jetty version configurable from the maven command line > --- > > Key: HADOOP-11995 > URL: https://issues.apache.org/jira/browse/HADOOP-11995 > Project: Hadoop Common > Issue Type: Improvement > Components: build, ld >Reporter: sriharsha devineni >Assignee: sriharsha devineni >Priority: Trivial > Fix For: 2.8.0 > > Attachments: patch.txt > > > Variablize jetty version, which can be overwritten from maven command line > while building. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11970) Replace uses of ThreadLocal with JDK7 ThreadLocalRandom
[ https://issues.apache.org/jira/browse/HADOOP-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552552#comment-14552552 ] Hudson commented on HADOOP-11970: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #201 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/201/]) HADOOP-11970. Replace uses of ThreadLocal with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) (cmccabe: rev 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080) * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestAppendSnapshotTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryPolicies.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/sharedcache/SharedCacheUploader.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/Host2NodesMap.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestByteArrayManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestDNFencing.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java > Replace uses of ThreadLocal with JDK7 ThreadLocalRandom > --- > > Key: HADOOP-11970 > URL: https://issues.apache.org/jira/browse/HADOOP-11970 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.8.0 > > Attachments: HADOOP-11970.1.patch, HADOOP-11970.2.patch, > HADOOP-11970.3.patch > > > ThreadLocalRandom should be used when available in place of > ThreadLocal. For JDK7 the difference is minimal, but JDK8 starts > including optimizations for ThreadLocalRandom. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11963) Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
[
https://issues.apache.org/jira/browse/HADOOP-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552560#comment-14552560
]
Hudson commented on HADOOP-11963:
-
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #201 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/201/])
HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer. (cnauroth: rev
e422e76fcaaa04fc22384d978a2abae967d801b6)
* hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
* hadoop-common-project/hadoop-common/CHANGES.txt
> Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
> -
>
> Key: HADOOP-11963
> URL: https://issues.apache.org/jira/browse/HADOOP-11963
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.7.0
>Reporter: Chris Nauroth
>Assignee: Anu Engineer
>Priority: Trivial
> Labels: newbie
> Fix For: 2.8.0
>
> Attachments: HADOOP-11963.001.patch
>
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Metrics.html#FSNamesystem
> {quote}
> PendingDataNodeMessageCourt (HA-only) Current number of pending
> block-related messages for later processing in the standby NameNode
> {quote}
> This needs to be changed to "PendingDataNodeMessageCount".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11973) Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs
[ https://issues.apache.org/jira/browse/HADOOP-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552547#comment-14552547 ] Hudson commented on HADOOP-11973: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #201 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/201/]) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) (Arun Suresh: rev fd3cb533d2495ea220ab2e468835a43a784d7532) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/ZKDelegationTokenSecretManager.java > Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs > > > Key: HADOOP-11973 > URL: https://issues.apache.org/jira/browse/HADOOP-11973 > Project: Hadoop Common > Issue Type: Bug > Components: security >Affects Versions: 2.6.0 >Reporter: Gregory Chanan >Assignee: Gregory Chanan > Fix For: 2.7.1 > > Attachments: HADOOP-11973.patch, HADOOP-11973v2.patch, > HADOOP-11973v3.patch > > > I recently added an ACL Provider to the curator framework instance I pass to > the ZkDelegationTokenSecretManager, and notice some strangeness around ACLs. > I set: "zk-dt-secret-manager.znodeWorkingPath" to: > "solr/zkdtsm" > and notice that > /solr/zkdtsm/ > /solr/zkdtsm/ZKDTSMRoot > do not have ACLs > but all the znodes under /solr/zkdtsm/ZKDTSMRoot have ACLs. From adding some > logging, it looks like the ACLProvider is never called for /solr/zkdtsm and > /solr/zkdtsm/ZKDTSMRoot. I don't know if that's a Curator or > ZkDelegationTokenSecretManager issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11973) Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs
[ https://issues.apache.org/jira/browse/HADOOP-11973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552590#comment-14552590 ] Hudson commented on HADOOP-11973: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2149 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2149/]) HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh) (Arun Suresh: rev fd3cb533d2495ea220ab2e468835a43a784d7532) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestZKDelegationTokenSecretManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/ZKDelegationTokenSecretManager.java > Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs > > > Key: HADOOP-11973 > URL: https://issues.apache.org/jira/browse/HADOOP-11973 > Project: Hadoop Common > Issue Type: Bug > Components: security >Affects Versions: 2.6.0 >Reporter: Gregory Chanan >Assignee: Gregory Chanan > Fix For: 2.7.1 > > Attachments: HADOOP-11973.patch, HADOOP-11973v2.patch, > HADOOP-11973v3.patch > > > I recently added an ACL Provider to the curator framework instance I pass to > the ZkDelegationTokenSecretManager, and notice some strangeness around ACLs. > I set: "zk-dt-secret-manager.znodeWorkingPath" to: > "solr/zkdtsm" > and notice that > /solr/zkdtsm/ > /solr/zkdtsm/ZKDTSMRoot > do not have ACLs > but all the znodes under /solr/zkdtsm/ZKDTSMRoot have ACLs. From adding some > logging, it looks like the ACLProvider is never called for /solr/zkdtsm and > /solr/zkdtsm/ZKDTSMRoot. I don't know if that's a Curator or > ZkDelegationTokenSecretManager issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11963) Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
[
https://issues.apache.org/jira/browse/HADOOP-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552604#comment-14552604
]
Hudson commented on HADOOP-11963:
-
SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2149 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2149/])
HADOOP-11963. Metrics documentation for FSNamesystem misspells
PendingDataNodeMessageCount. Contributed by Anu Engineer. (cnauroth: rev
e422e76fcaaa04fc22384d978a2abae967d801b6)
* hadoop-common-project/hadoop-common/CHANGES.txt
* hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md
> Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.
> -
>
> Key: HADOOP-11963
> URL: https://issues.apache.org/jira/browse/HADOOP-11963
> Project: Hadoop Common
> Issue Type: Bug
> Components: documentation
>Affects Versions: 2.7.0
>Reporter: Chris Nauroth
>Assignee: Anu Engineer
>Priority: Trivial
> Labels: newbie
> Fix For: 2.8.0
>
> Attachments: HADOOP-11963.001.patch
>
>
> http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Metrics.html#FSNamesystem
> {quote}
> PendingDataNodeMessageCourt (HA-only) Current number of pending
> block-related messages for later processing in the standby NameNode
> {quote}
> This needs to be changed to "PendingDataNodeMessageCount".
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-12000) cannot use --java-home in test-patch
[ https://issues.apache.org/jira/browse/HADOOP-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552594#comment-14552594 ] Hudson commented on HADOOP-12000: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2149 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2149/]) HADOOP-12000. cannot use --java-home in test-patch (aw) (aw: rev 12d6c5ce4f78bc0e9464522715920866abe1f727) * dev-support/test-patch.sh * hadoop-common-project/hadoop-common/CHANGES.txt > cannot use --java-home in test-patch > > > Key: HADOOP-12000 > URL: https://issues.apache.org/jira/browse/HADOOP-12000 > Project: Hadoop Common > Issue Type: Test > Components: scripts >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Fix For: 2.8.0 > > Attachments: HADOOP-12000.patch > > > Trivial bug, but breaks the docker patch: --java-home=blah doesn't work > because the case statement is broken. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11970) Replace uses of ThreadLocal with JDK7 ThreadLocalRandom
[ https://issues.apache.org/jira/browse/HADOOP-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552595#comment-14552595 ] Hudson commented on HADOOP-11970: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2149 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2149/]) HADOOP-11970. Replace uses of ThreadLocal with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) (cmccabe: rev 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080) * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAAppend.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NamenodeFsck.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/Host2NodesMap.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/sharedcache/SharedCacheUploader.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryPolicies.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestAppendSnapshotTruncate.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/util/TestByteArrayManager.java * hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestDNFencing.java * hadoop-common-project/hadoop-common/CHANGES.txt > Replace uses of ThreadLocal with JDK7 ThreadLocalRandom > --- > > Key: HADOOP-11970 > URL: https://issues.apache.org/jira/browse/HADOOP-11970 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Sean Busbey >Assignee: Sean Busbey > Fix For: 2.8.0 > > Attachments: HADOOP-11970.1.patch, HADOOP-11970.2.patch, > HADOOP-11970.3.patch > > > ThreadLocalRandom should be used when available in place of > ThreadLocal. For JDK7 the difference is minimal, but JDK8 starts > including optimizations for ThreadLocalRandom. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11995) Make jetty version configurable from the maven command line
[ https://issues.apache.org/jira/browse/HADOOP-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552593#comment-14552593 ] Hudson commented on HADOOP-11995: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2149 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2149/]) HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. (wheat9: rev ce53c8eb0ccc582957ba1f4c0b7938db00f6ca31) * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-project/pom.xml > Make jetty version configurable from the maven command line > --- > > Key: HADOOP-11995 > URL: https://issues.apache.org/jira/browse/HADOOP-11995 > Project: Hadoop Common > Issue Type: Improvement > Components: build, ld >Reporter: sriharsha devineni >Assignee: sriharsha devineni >Priority: Trivial > Fix For: 2.8.0 > > Attachments: patch.txt > > > Variablize jetty version, which can be overwritten from maven command line > while building. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11698) Remove DistCpV1 and Logalyzer
[ https://issues.apache.org/jira/browse/HADOOP-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552589#comment-14552589 ] Hudson commented on HADOOP-11698: - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2149 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2149/]) HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. (aajisaka: rev 4aa730ce85d4c69c0ea8227c6c5276d96454c426) * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestCopyFiles.java * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/DistCpV1.java * hadoop-common-project/hadoop-common/CHANGES.txt * hadoop-tools/hadoop-extras/src/main/java/org/apache/hadoop/tools/Logalyzer.java * hadoop-tools/hadoop-extras/src/test/java/org/apache/hadoop/tools/TestLogalyzer.java > Remove DistCpV1 and Logalyzer > - > > Key: HADOOP-11698 > URL: https://issues.apache.org/jira/browse/HADOOP-11698 > Project: Hadoop Common > Issue Type: Improvement > Components: tools/distcp >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer >Assignee: Brahma Reddy Battula > Fix For: 3.0.0 > > Attachments: HADOOP-11698-002.patch, HADOOP-11698-branch2.patch, > HADOOP-11698.patch > > > distcpv1 is pretty much unsupported. we should just remove it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (HADOOP-11820) aw jira testing, ignore
[
https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer updated HADOOP-11820:
--
Comment: was deleted
(was: \\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | reexec | 0m 0s | dev-support patch detected. |
| {color:blue}0{color} | pre-patch | 0m 0s | Pre-patch trunk compilation is
healthy. |
| {color:blue}0{color} | @author | 0m 0s | Skipping @author checks as
test-patch has been patched. |
| {color:green}+1{color} | release audit | 0m 15s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | shellcheck | 0m 8s | There were no new shellcheck
(v0.3.7) issues. |
| {color:green}+1{color} | whitespace | 0m 1s | The patch has no lines that
end in whitespace. |
| | | 0m 28s | |
\\
\\
|| Subsystem || Report/Notes ||
| Java | 1.7.0_80 |
| uname | Linux 9aab768daeed 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Docker | C=1.6.1/S=1.6.1/I:test-patch-base-hadoop-date2015-05-20-03 |
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734055/HADOOP-11933.04.patch |
| git revision | trunk / ce53c8e |
| Optional Tests | shellcheck |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6780/console |
This message was automatically generated.)
> aw jira testing, ignore
> ---
>
> Key: HADOOP-11820
> URL: https://issues.apache.org/jira/browse/HADOOP-11820
> Project: Hadoop Common
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
> Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch,
> HADOOP-11933.04.patch, HADOOP-11933.05.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Attachment: HADOOP-11933.05.patch > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Comment: was deleted (was: (!) A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6780/console in case of problems.) > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Attachment: HADOOP-11933.05.patch > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Attachment: (was: HADOOP-11933.05.patch) > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552684#comment-14552684 ] Hadoop QA commented on HADOOP-11820: (!) A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6787/console in case of problems. > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[
https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552694#comment-14552694
]
Hadoop QA commented on HADOOP-11820:
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | reexec | 0m 0s | dev-support patch detected. |
| {color:blue}0{color} | docker | 0m 0s | docker mode |
| {color:blue}0{color} | pre-patch | 0m 0s | Pre-patch trunk compilation is
healthy. |
| {color:blue}0{color} | @author | 0m 0s | Skipping @author checks as
test-patch has been patched. |
| {color:green}+1{color} | release audit | 0m 17s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | shellcheck | 0m 9s | There were no new shellcheck
(v0.3.7) issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| | | 9m 21s | |
\\
\\
|| Subsystem || Report/Notes ||
| Java | 1.7.0_80 |
| uname | Linux cdbf55875cfd 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Docker | C=1.6.1/S=1.6.1/I:test-patch-base-hadoop-date2015-05-20-17 |
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734161/HADOOP-11933.05.patch |
| git revision | trunk / 4aa730c |
| Optional Tests | shellcheck |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6787/console |
This message was automatically generated.
> aw jira testing, ignore
> ---
>
> Key: HADOOP-11820
> URL: https://issues.apache.org/jira/browse/HADOOP-11820
> Project: Hadoop Common
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
> Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch,
> HADOOP-11933.04.patch, HADOOP-11933.05.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-12002) test-patch.sh needs to verify all of the findbugs tools exist
[
https://issues.apache.org/jira/browse/HADOOP-12002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer updated HADOOP-12002:
--
Summary: test-patch.sh needs to verify all of the findbugs tools exist
(was: test-patch.sh incorrectly reports findbugs failure(s) as a 'success' on
Mac OS X)
> test-patch.sh needs to verify all of the findbugs tools exist
> -
>
> Key: HADOOP-12002
> URL: https://issues.apache.org/jira/browse/HADOOP-12002
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Sidharta Seethana
>
> {{test-patch.sh}} was used with {{FINDBUGS_HOME}} set. See below for an
> example - there were 4 findbugs warnings generated - however,
> {{test-patch.sh}} doesn't seem to realize that there are missing findbugs
> tools and +1s the finbugs check.
> {quote}
> Running findbugs in
> hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager
> mvn clean test findbugs:findbugs -DskipTests -DhadoopPatchProcess >
> /private/tmp/hadoop-test-patch/71089/patchFindBugsOutputhadoop-yarn-server-nodemanager.txt
> 2>&1
> hadoop/dev-support/test-patch.sh: line 1907:
> /usr/local/Cellar/findbugs/3.0.0/bin/setBugDatabaseInfo: No such file or
> directory
> hadoop/dev-support/test-patch.sh: line 1915:
> /usr/local/Cellar/findbugs/3.0.0/bin/filterBugs: No such file or directory
> Found Findbugs warnings
> (hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/findbugsXml.xml)
> hadoop/dev-support/test-patch.sh: line 1921:
> /usr/local/Cellar/findbugs/3.0.0/bin/convertXmlToText: No such file or
> directory
> [Mon May 18 18:08:52 PDT 2015 DEBUG]: Stop clock
> Elapsed time: 0m 38s
> {quote}
> Findbugs check reported as successful :
> {quote}
> | +1 | findbugs | 0m 38s| The patch does not introduce any
> | | || new Findbugs (version 3.0.0)
> | | || warnings.
> | | | 23m 51s |
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Issue Comment Deleted] (HADOOP-11820) aw jira testing, ignore
[
https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer updated HADOOP-11820:
--
Comment: was deleted
(was: \\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | reexec | 0m 0s | dev-support patch detected. |
| {color:blue}0{color} | docker | 0m 0s | docker mode |
| {color:blue}0{color} | pre-patch | 0m 0s | Pre-patch trunk compilation is
healthy. |
| {color:blue}0{color} | @author | 0m 0s | Skipping @author checks as
test-patch has been patched. |
| {color:green}+1{color} | release audit | 0m 17s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | shellcheck | 0m 9s | There were no new shellcheck
(v0.3.7) issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| | | 9m 21s | |
\\
\\
|| Subsystem || Report/Notes ||
| Java | 1.7.0_80 |
| uname | Linux cdbf55875cfd 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Docker | C=1.6.1/S=1.6.1/I:test-patch-base-hadoop-date2015-05-20-17 |
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734161/HADOOP-11933.05.patch |
| git revision | trunk / 4aa730c |
| Optional Tests | shellcheck |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6787/console |
This message was automatically generated.)
> aw jira testing, ignore
> ---
>
> Key: HADOOP-11820
> URL: https://issues.apache.org/jira/browse/HADOOP-11820
> Project: Hadoop Common
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
> Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch,
> HADOOP-11933.04.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Attachment: (was: HADOOP-11933.05.patch) > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Comment: was deleted (was: (!) A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6787/console in case of problems.) > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552780#comment-14552780 ] Sean Busbey commented on HADOOP-11933: -- If the two steps are "time spent cleaning up" and "time spent getting to a build-specific image", then per step. I don't think how long each of the implementation bits for those two categories are useful for now. > run test-patch.sh in a docker container under Jenkins > - > > Key: HADOOP-11933 > URL: https://issues.apache.org/jira/browse/HADOOP-11933 > Project: Hadoop Common > Issue Type: Test >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch, > HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch > > > because of how hard it is to control the content of the Jenkins environment, > it would be beneficial to run it in a docker container so that we can have > tight control of the environment -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11820: -- Attachment: HADOOP-11933.05.patch > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552796#comment-14552796 ] Hadoop QA commented on HADOOP-11820: (!) A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6788/console in case of problems. > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[
https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552799#comment-14552799
]
Hadoop QA commented on HADOOP-11820:
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | reexec | 0m 0s | dev-support patch detected. |
| {color:blue}0{color} | docker | 0m 9s | docker mode |
| {color:blue}0{color} | pre-patch | 0m 0s | Pre-patch trunk compilation is
healthy. |
| {color:blue}0{color} | @author | 0m 0s | Skipping @author checks as
test-patch has been patched. |
| {color:green}+1{color} | release audit | 0m 16s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | shellcheck | 0m 9s | There were no new shellcheck
(v0.3.7) issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| | | 0m 42s | |
\\
\\
|| Subsystem || Report/Notes ||
| Java | 1.7.0_80 |
| uname | Linux c138ca63ae99 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Docker | C=1.6.1/S=1.6.1/I:test-patch-base-hadoop-date2015-05-20-18 |
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734183/HADOOP-11933.05.patch |
| git revision | trunk / 4aa730c |
| Optional Tests | shellcheck |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6788/console |
This message was automatically generated.
> aw jira testing, ignore
> ---
>
> Key: HADOOP-11820
> URL: https://issues.apache.org/jira/browse/HADOOP-11820
> Project: Hadoop Common
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
> Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch,
> HADOOP-11933.04.patch, HADOOP-11933.05.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552802#comment-14552802 ] Hadoop QA commented on HADOOP-11820: (!) A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6789/console in case of problems. > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[
https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552803#comment-14552803
]
Hadoop QA commented on HADOOP-11820:
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | reexec | 0m 0s | dev-support patch detected. |
| {color:blue}0{color} | docker | 0m 3s | docker mode |
| {color:blue}0{color} | pre-patch | 0m 0s | Pre-patch trunk compilation is
healthy. |
| {color:blue}0{color} | @author | 0m 0s | Skipping @author checks as
test-patch has been patched. |
| {color:green}+1{color} | release audit | 0m 16s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | shellcheck | 0m 9s | There were no new shellcheck
(v0.3.7) issues. |
| {color:green}+1{color} | whitespace | 0m 1s | The patch has no lines that
end in whitespace. |
| | | 0m 40s | |
\\
\\
|| Subsystem || Report/Notes ||
| Java | 1.7.0_80 |
| uname | Linux a574b5dc9832 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Docker | C=1.6.1/S=1.6.1/I:test-patch-base-hadoop-date2015-05-20-18 |
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734183/HADOOP-11933.05.patch |
| git revision | trunk / 4aa730c |
| Optional Tests | shellcheck |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6789/console |
This message was automatically generated.
> aw jira testing, ignore
> ---
>
> Key: HADOOP-11820
> URL: https://issues.apache.org/jira/browse/HADOOP-11820
> Project: Hadoop Common
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
> Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch,
> HADOOP-11933.04.patch, HADOOP-11933.05.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[ https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552807#comment-14552807 ] Hadoop QA commented on HADOOP-11820: (!) A patch to test-patch or smart-apply-patch has been detected. Re-executing against the patched versions to perform further tests. The console is at https://builds.apache.org/job/PreCommit-HADOOP-Build/6790/console in case of problems. > aw jira testing, ignore > --- > > Key: HADOOP-11820 > URL: https://issues.apache.org/jira/browse/HADOOP-11820 > Project: Hadoop Common > Issue Type: Task >Affects Versions: 3.0.0 >Reporter: Allen Wittenauer > Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch, > HADOOP-11933.04.patch, HADOOP-11933.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11820) aw jira testing, ignore
[
https://issues.apache.org/jira/browse/HADOOP-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552810#comment-14552810
]
Hadoop QA commented on HADOOP-11820:
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | reexec | 0m 0s | dev-support patch detected. |
| {color:blue}0{color} | docker | 0m 4s | docker mode |
| {color:blue}0{color} | pre-patch | 0m 0s | Pre-patch trunk compilation is
healthy. |
| {color:blue}0{color} | @author | 0m 0s | Skipping @author checks as
test-patch has been patched. |
| {color:green}+1{color} | release audit | 0m 16s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | shellcheck | 0m 9s | There were no new shellcheck
(v0.3.7) issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| | | 0m 38s | |
\\
\\
|| Subsystem || Report/Notes ||
| Java | 1.7.0_80 |
| uname | Linux efd4c4a681c1 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed
Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Docker | C=1.6.1/S=1.6.1/I:test-patch-base-hadoop-date2015-05-20-18 |
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12734183/HADOOP-11933.05.patch |
| git revision | trunk / 4aa730c |
| Optional Tests | shellcheck |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/6790/console |
This message was automatically generated.
> aw jira testing, ignore
> ---
>
> Key: HADOOP-11820
> URL: https://issues.apache.org/jira/browse/HADOOP-11820
> Project: Hadoop Common
> Issue Type: Task
>Affects Versions: 3.0.0
>Reporter: Allen Wittenauer
> Attachments: HADOOP-11820.patch, HADOOP-11933.03.patch,
> HADOOP-11933.04.patch, HADOOP-11933.05.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552828#comment-14552828 ] Allen Wittenauer commented on HADOOP-11933: --- I wired up timing and learned the following: * docker image clean up takes less than a second unless there are a lot in play. * docker image creation only takes up more than a minute if the cache is completely empty. So I'm going to return one time for the whole docker launch bit, since the cleanup is miniscule. > run test-patch.sh in a docker container under Jenkins > - > > Key: HADOOP-11933 > URL: https://issues.apache.org/jira/browse/HADOOP-11933 > Project: Hadoop Common > Issue Type: Test >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch, > HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch > > > because of how hard it is to control the content of the Jenkins environment, > it would be beneficial to run it in a docker container so that we can have > tight control of the environment -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HADOOP-11933) run test-patch.sh in a docker container under Jenkins
[ https://issues.apache.org/jira/browse/HADOOP-11933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-11933: -- Attachment: HADOOP-11933.05.patch -05: * Cover Sean's feedback * rexec time is now accurate, using the same trick > run test-patch.sh in a docker container under Jenkins > - > > Key: HADOOP-11933 > URL: https://issues.apache.org/jira/browse/HADOOP-11933 > Project: Hadoop Common > Issue Type: Test >Reporter: Allen Wittenauer >Assignee: Allen Wittenauer > Attachments: HADOOP-11933.00.patch, HADOOP-11933.01.patch, > HADOOP-11933.02.patch, HADOOP-11933.03.patch, HADOOP-11933.04.patch, > HADOOP-11933.05.patch > > > because of how hard it is to control the content of the Jenkins environment, > it would be beneficial to run it in a docker container so that we can have > tight control of the environment -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11998) Jenkins has race conditions when reading the maven repo
[
https://issues.apache.org/jira/browse/HADOOP-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14552967#comment-14552967
]
Haohui Mai commented on HADOOP-11998:
-
My understanding is that the Jenkins machine is set up to run one job
exclusively at a time. Can anyone confirm that?
bq. it means a fresh repo stored in the workspace directory, which also means
you've added 5-10 minutes to redownload the dependency tree every time.
Is it possible to set up a HTTP proxy to cache most of the downloads?
> Jenkins has race conditions when reading the maven repo
> ---
>
> Key: HADOOP-11998
> URL: https://issues.apache.org/jira/browse/HADOOP-11998
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Haohui Mai
>
> Jenkins builds have race conditions when accessing the directory of the maven
> repo:
> {noformat}
> Error Message
> org.xml.sax.SAXParseException; systemId:
> jar:file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/3.0.0-SNAPSHOT/hadoop-common-3.0.0-SNAPSHOT.jar!/core-default.xml;
> lineNumber: 1; columnNumber: 1; Content is not allowed in prolog.
> Stacktrace
> java.lang.RuntimeException: org.xml.sax.SAXParseException; systemId:
> jar:file:/home/jenkins/.m2/repository/org/apache/hadoop/hadoop-common/3.0.0-SNAPSHOT/hadoop-common-3.0.0-SNAPSHOT.jar!/core-default.xml;
> lineNumber: 1; columnNumber: 1; Content is not allowed in prolog.
> {noformat}
> More details can be found in
> https://builds.apache.org/job/PreCommit-HDFS-Build/11050/testReport/org.apache.hadoop.hdfs.server.datanode/TestDataNodeHotSwapVolumes/testAddOneNewVolume/
> What it looks like here is that there is another build that triggers {{mvn
> clean}} when {{mvn test}} is still running.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
