Re: wiki.apache.org is no longer editable
Was there some announcement about the MoinMoin wiki going read-only? It looks like most of the content hasn't been migrated to cwiki yet, and the home page of our Hadoop space is a placeholder right now. On Fri, Jun 2, 2017 at 4:12 AM, Steve Loughran wrote: > > > On 1 Jun 2017, at 06:15, Akira Ajisaka wrote: > > > > Hi folks, > > > > https://wiki.apache.org/hadoop/ is no longer editable. > > If you want to edit a wiki page in wiki.apache.org, > > you need to migrate the page to > > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Home. > > > > If you want to edit the wiki, please tell me your account > > for cwiki.apache.org. > > > > There are some error messages refer to the wiki page. > > We need to update the error messages when the page is migrated. > > > > yes, that's in NetUtils > > Coiuld we put redirects in the existing pages? > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >
[jira] [Created] (HADOOP-14501) aalto-xml cannot handle some odd XML features
Andrew Wang created HADOOP-14501:
Summary: aalto-xml cannot handle some odd XML features
Key: HADOOP-14501
URL: https://issues.apache.org/jira/browse/HADOOP-14501
Project: Hadoop Common
Issue Type: Bug
Components: conf
Affects Versions: 2.9.0, 3.0.0-alpha4
Reporter: Andrew Wang
Priority: Blocker
[~hgadre] tried testing solr with a Hadoop 3 client. He saw various test case
failures due to what look like functionality gaps in the new aalto-xml stax
implementation pulled in by HADOOP-14216:
{noformat}
[junit4]> Throwable #1: com.fasterxml.aalto.WFCException: Illegal XML
character ('ΓΌ' (code 252))
[junit4]> Caused by: com.fasterxml.aalto.WFCException: General entity
reference (&bar;) encountered in entity expanding mode: operation not (yet)
implemented
...
[junit4]> Throwable #1: org.apache.solr.common.SolrException: General
entity reference (&wacky;) encountered in entity expanding mode: operation not
(yet) implemented
{noformat}
These were from the following test case executions:
{noformat}
NOTE: reproduce with: ant test -Dtestcase=DocumentAnalysisRequestHandlerTest
-Dtests.method=testCharsetOutsideDocument -Dtests.seed=2F739D88D9C723CA
-Dtests.slow=true -Dtests.locale=und -Dtests.timezone=Atlantic/Faeroe
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
NOTE: reproduce with: ant test -Dtestcase=MBeansHandlerTest
-Dtests.method=testXMLDiffWithExternalEntity -Dtests.seed=2F739D88D9C723CA
-Dtests.slow=true -Dtests.locale=en-US -Dtests.timezone=US/Aleutian
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
NOTE: reproduce with: ant test -Dtestcase=XmlUpdateRequestHandlerTest
-Dtests.method=testExternalEntities -Dtests.seed=2F739D88D9C723CA
-Dtests.slow=true -Dtests.locale=hr -Dtests.timezone=America/Barbados
-Dtests.asserts=true -Dtests.file.encoding=US-ASCII
NOTE: reproduce with: ant test -Dtestcase=XmlUpdateRequestHandlerTest
-Dtests.method=testNamedEntity -Dtests.seed=2F739D88D9C723CA -Dtests.slow=true
-Dtests.locale=hr -Dtests.timezone=America/Barbados -Dtests.asserts=true
-Dtests.file.encoding=US-ASCII
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14500) Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails
Mingliang Liu created HADOOP-14500:
--
Summary: Azure:
TestFileSystemOperationExceptionHandling{,MultiThreaded} fails
Key: HADOOP-14500
URL: https://issues.apache.org/jira/browse/HADOOP-14500
Project: Hadoop Common
Issue Type: Bug
Components: fs/azure, test
Reporter: Mingliang Liu
The following test fails:
{code}
TestFileSystemOperationExceptionHandling.testSingleThreadBlockBlobSeekScenario
Expected exception:
java.io.FileNotFoundExceptionTestFileSystemOperationsExceptionHandlingMultiThreaded.testMultiThreadBlockBlobSeekScenario
Expected exception: java.io.FileNotFoundException
{code}
I did early analysis and found [HADOOP-14478] maybe the reason. I think we can
fix the test itself here.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-13474) Add more details in the log when a token is expired
[
https://issues.apache.org/jira/browse/HADOOP-13474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Chen resolved HADOOP-13474.
Resolution: Won't Fix
With more understanding around this area, I think this jira is not necessary.
This is because AuthenticationFilter is usually passing the authentication
further down to the authentication handler, and that's where we should log more.
Will cover that in HADOOP-13174, so closing this one.
> Add more details in the log when a token is expired
> ---
>
> Key: HADOOP-13474
> URL: https://issues.apache.org/jira/browse/HADOOP-13474
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: security
>Affects Versions: 2.6.0
>Reporter: Xiao Chen
>Assignee: Xiao Chen
> Attachments: HADOOP-13474.01.patch
>
>
> Currently when there's an expired token, we see this from the log:
> {noformat}
> 2016-08-06 07:13:20,807 WARN
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> AuthenticationToken ignored: AuthenticationToken expired
> 2016-08-06 09:55:48,665 WARN
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> AuthenticationToken ignored: AuthenticationToken expired
> 2016-08-06 10:01:41,452 WARN
> org.apache.hadoop.security.authentication.server.AuthenticationFilter:
> AuthenticationToken ignored: AuthenticationToken expired
> {noformat}
> We should log a better
> [message|https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/server/AuthenticationFilter.java#L456],
> to include more details (e.g. token type, username, tokenid) for
> trouble-shooting purpose.
> I don't think the additional information exposed will lead to any security
> concern, since the token is expired anyways.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14499) Findbufs warning in LocalMetadataStore
Sean Mackrory created HADOOP-14499:
--
Summary: Findbufs warning in LocalMetadataStore
Key: HADOOP-14499
URL: https://issues.apache.org/jira/browse/HADOOP-14499
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Sean Mackrory
Assignee: Sean Mackrory
First saw this raised by Yetus on HADOOP-14433:
{code}
Bug type UC_USELESS_OBJECT (click for details)
In class org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
In method org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore.prune(long)
Value ancestors
Type java.util.LinkedList
At LocalMetadataStore.java:[line 300]
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14498) HADOOP_OPTIONAL_TOOLS not parsed correctly
Mingliang Liu created HADOOP-14498:
--
Summary: HADOOP_OPTIONAL_TOOLS not parsed correctly
Key: HADOOP-14498
URL: https://issues.apache.org/jira/browse/HADOOP-14498
Project: Hadoop Common
Issue Type: Bug
Components: build
Affects Versions: 3.0.0-alpha1
Reporter: Mingliang Liu
# This will make hadoop-azure not show up in the hadoop classpath, though both
hadoop-aws and hadoop-azure-datalake are in the
classpath.{code:title=hadoop-env.sh}
export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws,hadoop-azure-datalake"
{code}
# And if we put only hadoop-azure and hadoop-aws, both of them are shown in the
classpath.
{code:title=hadoop-env.sh}
export HADOOP_OPTIONAL_TOOLS="hadoop-azure,hadoop-aws"
{code}
This makes me guess that, while parsing the {{HADOOP_OPTIONAL_TOOLS}}, we make
some assumptions that hadoop tool modules have a single "-" in names, and the
_hadoop-azure-datalake_ overrides the _hadoop-azure_. Or any other assumptions
about the {{${project.artifactId\}}}?
Ping [~aw].
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-14496) Logs for KMS delegation token lifecycle
[ https://issues.apache.org/jira/browse/HADOOP-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14496. Resolution: Duplicate > Logs for KMS delegation token lifecycle > --- > > Key: HADOOP-14496 > URL: https://issues.apache.org/jira/browse/HADOOP-14496 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Yongjun Zhang > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14496) Logs for KMS delegation token lifecycle
Yongjun Zhang created HADOOP-14496: -- Summary: Logs for KMS delegation token lifecycle Key: HADOOP-14496 URL: https://issues.apache.org/jira/browse/HADOOP-14496 Project: Hadoop Common Issue Type: Improvement Reporter: Yongjun Zhang -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14495) Add set options interface to FSDataOutputStreamBuilder
Lei (Eddy) Xu created HADOOP-14495: -- Summary: Add set options interface to FSDataOutputStreamBuilder Key: HADOOP-14495 URL: https://issues.apache.org/jira/browse/HADOOP-14495 Project: Hadoop Common Issue Type: Sub-task Affects Versions: 3.0.0-alpha3 Reporter: Lei (Eddy) Xu Assignee: Lei (Eddy) Xu -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/337/ [Jun 5, 2017 4:21:03 PM] (brahma) HADOOP-14440. Add metrics for connections dropped. Contributed by Eric [Jun 5, 2017 6:26:56 PM] (liuml07) HADOOP-14428. s3a: mkdir appears to be broken. Contributed by Mingliang [Jun 5, 2017 8:16:57 PM] (jianhe) YARN-6683. Invalid event: COLLECTOR_UPDATE at KILLED. Contributed by [Jun 5, 2017 8:18:27 PM] (kihwal) HDFS-10816. TestComputeInvalidateWork#testDatanodeReRegistration fails [Jun 5, 2017 8:21:22 PM] (arp) HDFS-11928. Segment overflow in FileDistributionCalculator. Contributed [Jun 5, 2017 10:56:43 PM] (liuml07) HADOOP-14478. Optimize NativeAzureFsInputStream for positional reads. [Jun 5, 2017 11:31:03 PM] (yzhang) HDFS-11914. Add more diagnosis info for fsimage transfer failure. [Jun 6, 2017 4:31:40 AM] (brahma) HADOOP-14431. ModifyTime of FileStatus returned by SFTPFileSystem's [Error replacing 'FILE' - Workspace is not accessible] - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/426/ [Jun 5, 2017 4:21:03 PM] (brahma) HADOOP-14440. Add metrics for connections dropped. Contributed by Eric [Jun 5, 2017 6:26:56 PM] (liuml07) HADOOP-14428. s3a: mkdir appears to be broken. Contributed by Mingliang [Jun 5, 2017 8:16:57 PM] (jianhe) YARN-6683. Invalid event: COLLECTOR_UPDATE at KILLED. Contributed by [Jun 5, 2017 8:18:27 PM] (kihwal) HDFS-10816. TestComputeInvalidateWork#testDatanodeReRegistration fails [Jun 5, 2017 8:21:22 PM] (arp) HDFS-11928. Segment overflow in FileDistributionCalculator. Contributed [Jun 5, 2017 10:56:43 PM] (liuml07) HADOOP-14478. Optimize NativeAzureFsInputStream for positional reads. [Jun 5, 2017 11:31:03 PM] (yzhang) HDFS-11914. Add more diagnosis info for fsimage transfer failure. [Jun 6, 2017 4:31:40 AM] (brahma) HADOOP-14431. ModifyTime of FileStatus returned by SFTPFileSystem's -1 overall The following subsystems voted -1: findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-common-project/hadoop-minikdc Possible null pointer dereference in org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value of called method Dereferenced at MiniKdc.java:org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value of called method Dereferenced at MiniKdc.java:[line 368] FindBugs : module:hadoop-common-project/hadoop-auth org.apache.hadoop.security.authentication.server.MultiSchemeAuthenticationHandler.authenticate(HttpServletRequest, HttpServletResponse) makes inefficient use of keySet iterator instead of entrySet iterator At MultiSchemeAuthenticationHandler.java:of keySet iterator instead of entrySet iterator At MultiSchemeAuthenticationHandler.java:[line 192] FindBugs : module:hadoop-common-project/hadoop-common org.apache.hadoop.crypto.CipherSuite.setUnknownValue(int) unconditionally sets the field unknownValue At CipherSuite.java:unknownValue At CipherSuite.java:[line 44] org.apache.hadoop.crypto.CryptoProtocolVersion.setUnknownValue(int) unconditionally sets the field unknownValue At CryptoProtocolVersion.java:unknownValue At CryptoProtocolVersion.java:[line 67] Possible null pointer dereference in org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to return value of called method Dereferenced at FileUtil.java:org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to return value of called method Dereferenced at FileUtil.java:[line 118] Possible null pointer dereference in org.apache.hadoop.fs.RawLocalFileSystem.handleEmptyDstDirectoryOnWindows(Path, File, Path, File) due to return value of called method Dereferenced at RawLocalFileSystem.java:org.apache.hadoop.fs.RawLocalFileSystem.handleEmptyDstDirectoryOnWindows(Path, File, Path, File) due to return value of called method Dereferenced at RawLocalFileSystem.java:[line 387] Return value of org.apache.hadoop.fs.permission.FsAction.or(FsAction) ignored, but method has no side effect At FTPFileSystem.java:but method has no side effect At FTPFileSystem.java:[line 421] Useless condition:lazyPersist == true at this point At CommandWithDestination.java:[line 502] org.apache.hadoop.io.DoubleWritable.compareTo(DoubleWritable) incorrectly handles double value At DoubleWritable.java: At DoubleWritable.java:[line 78] org.apache.hadoop.io.DoubleWritable$Comparator.compare(byte[], int, int, byte[], int, int) incorrectly handles double value At DoubleWritable.java:int) incorrectly handles double value At DoubleWritable.java:[line 97] org.apache.hadoop.io.FloatWritable.compareTo(FloatWritable) incorrectly handles float value At FloatWritable.java: At FloatWritable.java:[line 71] org.apache.hadoop.io.FloatWritable$Comparator.compare(byte[], int, int, byte[], int, int) incorrectly handles float value At FloatWritable.java:int) incorrectly handles float value At FloatWritable.java:[line 89] Possible null pointer dereference in org.apache.hadoop.io.IOUtils.listDirectory(File, FilenameFilter) due to return value of called method Dereferenced at IOUtils.java:org.apache.hadoop.io.IOUtils.listDirectory(File, FilenameFilter) due to return value of called method Dereferenced at IOUtils.java:[line 351] org.apache.hadoop.io.erasurecode.ECSchema.toString() makes inefficient use of keySet iterator instead of entrySet iterator At ECSchema.java:keySet iterator instead of entrySet iterator At ECSchema.java:[line 193] Possible bad parsing of shift operation in org.apache.hadoop.io.file.tfile.Utils$Version.hashCode() At Utils.java:operation in org.apache.hadoop.io.file.tfile
[jira] [Created] (HADOOP-14494) ITestJets3tNativeS3FileSystemContract tests NPEs in teardown if store undefined
Steve Loughran created HADOOP-14494:
---
Summary: ITestJets3tNativeS3FileSystemContract tests NPEs in
teardown if store undefined
Key: HADOOP-14494
URL: https://issues.apache.org/jira/browse/HADOOP-14494
Project: Hadoop Common
Issue Type: Bug
Components: fs/s3, test
Affects Versions: 3.0.0-alpha3
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Minor
the move to junit 4 causes the {{.ITestJets3tNativeS3FileSystemContract} tests
to NPE in teardown if you don't actually declare an s3n test bucket.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
