[jira] [Updated] (HADOOP-12231) setXIncludeAware errror keep logged while calling get from Configuration
[ https://issues.apache.org/jira/browse/HADOOP-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishnamoorthy Dharmalingam updated HADOOP-12231: - Description: [junit] [ERROR] Configuration - Failed to set setXIncludeAware(true) for parser oracle.xml.jaxp.JXDocumentBuilderFactory@14673fc2:java.lang.UnsupportedOperationException: setXIncludeAware is not supported on this JAXP implementation or earlier: class oracle.xml.jaxp.JXDocumentBuilderFactory java.lang.UnsupportedOperationException: setXIncludeAware is not supported on this JAXP implementation or earlier: class oracle.xml.jaxp.JXDocumentBuilderFactory [junit] at javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:584) [junit] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2216) [junit] at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185) [junit] at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102) [junit] at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) was: [junit] [ERROR] Configuration - Failed to set setXIncludeAware(true) for parser oracle.xml.jaxp.JXDocumentBuilderFactory@14673fc2:java.lang.UnsupportedOperationException: setXIncludeAware is not supported on this JAXP implementation or earlier: class oracle.xml.jaxp.JXDocumentBuilderFactory java.lang.UnsupportedOperationException: setXIncludeAware is not supported on this JAXP implementation or earlier: class oracle.xml.jaxp.JXDocumentBuilderFactory [junit] at javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:584) [junit] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2216) [junit] at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185) [junit] at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102) [junit] at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) [junit] at oracle.odi.hdfs.client.api.impl.OdiHDFSClient.(OdiHDFSClient.java:137) [junit] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) [junit] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) [junit] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [junit] at java.lang.reflect.Constructor.newInstance(Constructor.java:422) [junit] at oracle.odi.hdfs.client.api.OdiHadoopClasspathHelper.getNewInstance(OdiHadoopClasspathHelper.java:243) > setXIncludeAware errror keep logged while calling get from Configuration > > > Key: HADOOP-12231 > URL: https://issues.apache.org/jira/browse/HADOOP-12231 > Project: Hadoop Common > Issue Type: Bug > Components: fs > Environment: Oracle XDK parser >Reporter: Krishnamoorthy Dharmalingam >Priority: Trivial > > [junit] [ERROR] Configuration - Failed to set setXIncludeAware(true) for > parser > oracle.xml.jaxp.JXDocumentBuilderFactory@14673fc2:java.lang.UnsupportedOperationException: > setXIncludeAware is not supported on this JAXP implementation or earlier: > class oracle.xml.jaxp.JXDocumentBuilderFactory > on this JAXP implementation or earlier: class > oracle.xml.jaxp.JXDocumentBuilderFactory>java.lang.UnsupportedOperationException: > setXIncludeAware is not supported on this JAXP implementation or earlier: > class oracle.xml.jaxp.JXDocumentBuilderFactory > [junit] at > javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:584) > [junit] at > org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2216) > [junit] at > org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185) > [junit] at > org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102) > [junit] at > org.apache.hadoop.conf.Configuration.get(Configuration.java:851) > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-12231) setXIncludeAware errror keep logged while calling get from Configuration
[
https://issues.apache.org/jira/browse/HADOOP-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14626018#comment-14626018
]
Krishnamoorthy Dharmalingam commented on HADOOP-12231:
--
the code in Hadoop, UnSupportedOperationException they do expect while calling
setXIncludeAware() method, get logged as error with full trace.
Hadoop code didn’t throw that to the caller(getConfiguration() call).
If we have application which calls Configuration.get() 100 times, this
exception trace get logged 100times,
Better it can be printed only once, that too warning message is enough, not
necessary to log complete trace.
try {
docBuilderFactory.setXIncludeAware(true);
} catch (UnsupportedOperationException e) {
LOG.error("Failed to set setXIncludeAware(true) for parser " +
docBuilderFactory + ":" + e, e);
}
The above LOG.error() stmt suppose to be fixed.
> setXIncludeAware errror keep logged while calling get from Configuration
>
>
> Key: HADOOP-12231
> URL: https://issues.apache.org/jira/browse/HADOOP-12231
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Environment: Oracle XDK parser
>Reporter: Krishnamoorthy Dharmalingam
>Priority: Trivial
>
> [junit] [ERROR] Configuration - Failed to set setXIncludeAware(true) for
> parser
> oracle.xml.jaxp.JXDocumentBuilderFactory@14673fc2:java.lang.UnsupportedOperationException:
> setXIncludeAware is not supported on this JAXP implementation or earlier:
> class oracle.xml.jaxp.JXDocumentBuilderFactory
> on this JAXP implementation or earlier: class
> oracle.xml.jaxp.JXDocumentBuilderFactory>java.lang.UnsupportedOperationException:
> setXIncludeAware is not supported on this JAXP implementation or earlier:
> class oracle.xml.jaxp.JXDocumentBuilderFactory
> [junit] at
> javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:584)
> [junit] at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2216)
> [junit] at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185)
> [junit] at
> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102)
> [junit] at
> org.apache.hadoop.conf.Configuration.get(Configuration.java:851)
> [junit] at
> oracle.odi.hdfs.client.api.impl.OdiHDFSClient.(OdiHDFSClient.java:137)
> [junit] at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> [junit] at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> [junit] at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> [junit] at
> java.lang.reflect.Constructor.newInstance(Constructor.java:422)
> [junit] at
> oracle.odi.hdfs.client.api.OdiHadoopClasspathHelper.getNewInstance(OdiHadoopClasspathHelper.java:243)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HADOOP-12231) setXIncludeAware errror keep logged while calling get from Configuration
Krishnamoorthy Dharmalingam created HADOOP-12231: Summary: setXIncludeAware errror keep logged while calling get from Configuration Key: HADOOP-12231 URL: https://issues.apache.org/jira/browse/HADOOP-12231 Project: Hadoop Common Issue Type: Bug Components: fs Environment: Oracle XDK parser Reporter: Krishnamoorthy Dharmalingam Priority: Trivial [junit] [ERROR] Configuration - Failed to set setXIncludeAware(true) for parser oracle.xml.jaxp.JXDocumentBuilderFactory@14673fc2:java.lang.UnsupportedOperationException: setXIncludeAware is not supported on this JAXP implementation or earlier: class oracle.xml.jaxp.JXDocumentBuilderFactory java.lang.UnsupportedOperationException: setXIncludeAware is not supported on this JAXP implementation or earlier: class oracle.xml.jaxp.JXDocumentBuilderFactory [junit] at javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:584) [junit] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2216) [junit] at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2185) [junit] at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2102) [junit] at org.apache.hadoop.conf.Configuration.get(Configuration.java:851) [junit] at oracle.odi.hdfs.client.api.impl.OdiHDFSClient.(OdiHDFSClient.java:137) [junit] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) [junit] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) [junit] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [junit] at java.lang.reflect.Constructor.newInstance(Constructor.java:422) [junit] at oracle.odi.hdfs.client.api.OdiHadoopClasspathHelper.getNewInstance(OdiHadoopClasspathHelper.java:243) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11774) listStatus in FTPFileSystem fails with connection reset
[ https://issues.apache.org/jira/browse/HADOOP-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386225#comment-14386225 ] Krishnamoorthy Dharmalingam commented on HADOOP-11774: -- FTPFileSystem.disconnect() API is not handling the exception raised by FTPClient by commons-net-3.1.jar > listStatus in FTPFileSystem fails with connection reset > --- > > Key: HADOOP-11774 > URL: https://issues.apache.org/jira/browse/HADOOP-11774 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.3.0 > Environment: Remote FTP located in Windows NT FTP >Reporter: Krishnamoorthy Dharmalingam > > Following exception trace raised when FTPFileSystem.listStatus() called in > Passive/active mode. > Caused by: java.net.SocketException: Connection reset > at java.net.SocketInputStream.read(SocketInputStream.java:196) > at java.net.SocketInputStream.read(SocketInputStream.java:122) > at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283) > at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) > at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) > at java.io.InputStreamReader.read(InputStreamReader.java:184) > at java.io.BufferedReader.fill(BufferedReader.java:154) > at java.io.BufferedReader.read(BufferedReader.java:175) > at > org.apache.commons.net.io.CRLFLineReader.readLine(CRLFLineReader.java:58) > at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:310) > at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:290) > at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:479) > at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:552) > at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:601) > at org.apache.commons.net.ftp.FTP.quit(FTP.java:809) > at org.apache.commons.net.ftp.FTPClient.logout(FTPClient.java:979) > at > org.apache.hadoop.fs.ftp.FTPFileSystem.disconnect(FTPFileSystem.java:151) > at > org.apache.hadoop.fs.ftp.FTPFileSystem.getFileStatus(FTPFileSystem.java:395) > at org.apache.hadoop.fs.FileSystem.isFile(FileSystem.java:1424) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-11774) listStatus in FTPFileSystem fails with connection reset
[ https://issues.apache.org/jira/browse/HADOOP-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386223#comment-14386223 ] Krishnamoorthy Dharmalingam commented on HADOOP-11774: -- anonymous FTP call made on Windows NT > listStatus in FTPFileSystem fails with connection reset > --- > > Key: HADOOP-11774 > URL: https://issues.apache.org/jira/browse/HADOOP-11774 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.3.0 > Environment: Remote FTP located in Windows NT FTP >Reporter: Krishnamoorthy Dharmalingam > > Following exception trace raised when FTPFileSystem.listStatus() called in > Passive/active mode. > Caused by: java.net.SocketException: Connection reset > at java.net.SocketInputStream.read(SocketInputStream.java:196) > at java.net.SocketInputStream.read(SocketInputStream.java:122) > at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283) > at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) > at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) > at java.io.InputStreamReader.read(InputStreamReader.java:184) > at java.io.BufferedReader.fill(BufferedReader.java:154) > at java.io.BufferedReader.read(BufferedReader.java:175) > at > org.apache.commons.net.io.CRLFLineReader.readLine(CRLFLineReader.java:58) > at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:310) > at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:290) > at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:479) > at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:552) > at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:601) > at org.apache.commons.net.ftp.FTP.quit(FTP.java:809) > at org.apache.commons.net.ftp.FTPClient.logout(FTPClient.java:979) > at > org.apache.hadoop.fs.ftp.FTPFileSystem.disconnect(FTPFileSystem.java:151) > at > org.apache.hadoop.fs.ftp.FTPFileSystem.getFileStatus(FTPFileSystem.java:395) > at org.apache.hadoop.fs.FileSystem.isFile(FileSystem.java:1424) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11774) listStatus in FTPFileSystem fails with connection reset
Krishnamoorthy Dharmalingam created HADOOP-11774: Summary: listStatus in FTPFileSystem fails with connection reset Key: HADOOP-11774 URL: https://issues.apache.org/jira/browse/HADOOP-11774 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.3.0 Environment: Remote FTP located in Windows NT FTP Reporter: Krishnamoorthy Dharmalingam Following exception trace raised when FTPFileSystem.listStatus() called in Passive/active mode. Caused by: java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:196) at java.net.SocketInputStream.read(SocketInputStream.java:122) at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) at java.io.InputStreamReader.read(InputStreamReader.java:184) at java.io.BufferedReader.fill(BufferedReader.java:154) at java.io.BufferedReader.read(BufferedReader.java:175) at org.apache.commons.net.io.CRLFLineReader.readLine(CRLFLineReader.java:58) at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:310) at org.apache.commons.net.ftp.FTP.__getReply(FTP.java:290) at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:479) at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:552) at org.apache.commons.net.ftp.FTP.sendCommand(FTP.java:601) at org.apache.commons.net.ftp.FTP.quit(FTP.java:809) at org.apache.commons.net.ftp.FTPClient.logout(FTPClient.java:979) at org.apache.hadoop.fs.ftp.FTPFileSystem.disconnect(FTPFileSystem.java:151) at org.apache.hadoop.fs.ftp.FTPFileSystem.getFileStatus(FTPFileSystem.java:395) at org.apache.hadoop.fs.FileSystem.isFile(FileSystem.java:1424) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11100) Support to configure ftpClient.setControlKeepAliveTimeout
Krishnamoorthy Dharmalingam created HADOOP-11100:
Summary: Support to configure
ftpClient.setControlKeepAliveTimeout
Key: HADOOP-11100
URL: https://issues.apache.org/jira/browse/HADOOP-11100
Project: Hadoop Common
Issue Type: Improvement
Components: fs
Affects Versions: 2.3.0
Reporter: Krishnamoorthy Dharmalingam
Priority: Minor
In FTPFilesystem or Configuration, timeout is not possible to configure.
It is very straight forward to configure, in FTPFilesystem.connect() method.
ftpClient.setControlKeepAliveTimeout
Like
private FTPClient connect() throws IOException {
...
String timeout = conf.get("fs.ftp.timeout." + host);
...
ftpClient.setControlKeepAliveTimeout(new Integer(300));
}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
