[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877371#comment-15877371
 ] 

Tian Hong Wang commented on HAWQ-1346:
--

[~shivram]
Thanks for your great help. I know how to change it.

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Comment Edited] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877371#comment-15877371
 ] 

Tian Hong Wang edited comment on HAWQ-1346 at 2/22/17 3:11 AM:
---

[~shivram]
Thanks for your great help. I know how to change it now.


was (Author: tianhonglouis):
[~shivram]
Thanks for your great help. I know how to change it.

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877291#comment-15877291
 ] 

Tian Hong Wang commented on HAWQ-1346:
--

[~shivram]
Thanks for your help. Could you tell me how to configure pxf profile to enable 
LineBreakAccessor?

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Comment Edited] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877291#comment-15877291
 ] 

Tian Hong Wang edited comment on HAWQ-1346 at 2/22/17 2:14 AM:
---

[~shivram]
Thanks for your help. Could you tell me how to configure pxf profile to 
LineRecordReader?


was (Author: tianhonglouis):
[~shivram]
Thanks for your help. Could you tell me how to configure pxf profile to enable 
LineBreakAccessor?

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Comment Edited] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877291#comment-15877291
 ] 

Tian Hong Wang edited comment on HAWQ-1346 at 2/22/17 2:14 AM:
---

[~shivram]
Thanks for your help. Could you tell me how to configure pxf profile to enable 
LineRecordReader?


was (Author: tianhonglouis):
[~shivram]
Thanks for your help. Could you tell me how to configure pxf profile to 
LineRecordReader?

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875586#comment-15875586
 ] 

Tian Hong Wang commented on HAWQ-1346:
--

[~shivram]
Could you help me to have a look at this issue? Thanks.

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Shivram Mani
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875275#comment-15875275
 ] 

Tian Hong Wang commented on HAWQ-1346:
--

Does hawq pxf support WebHdfsFileSystem now?

> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception
> --
>
> Key: HAWQ-1346
> URL: https://issues.apache.org/jira/browse/HAWQ-1346
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Tian Hong Wang
>Assignee: Ed Espino
>Priority: Critical
>
> In 
> incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:
> private DFSInputStream getInputStream() {
>   return (DFSInputStream) (fileIn.getWrappedStream());
>  }
> If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
> exception from WebHdfsInputStream to DFSInputStream.
> The following is detailed exception.
> java.lang.ClassCastException: 
> org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be 
> cast to org.apache.hadoop.hdfs.DFSInputStream
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
> at 
> org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
> at 
> org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
> at 
> org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
> at 
> org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
> at 
> org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
> at 
> com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
> at 
> com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
> at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at 
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
> at 
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
> at 
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tian Hong Wang updated HAWQ-1346:
-
Description: 
In 
incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:

private DFSInputStream getInputStream() {
  return (DFSInputStream) (fileIn.getWrappedStream());
 }

If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
exception from WebHdfsInputStream to DFSInputStream.

The following is detailed exception.
java.lang.ClassCastException: 
org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be cast 
to org.apache.hadoop.hdfs.DFSInputStream
at 
org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
at 
org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
at 
org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
at 
org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
at 
org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
at 
org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
at 
org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
at 
com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
at 
com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
at 
com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)

  was:
In 
incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:

private DFSInputStream getInputStream() {
  return (DFSInputStream) (fileIn.getWrappedStream());
 }

If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
exception from WebHdfsInputStream to DFSInputStream.

java.lang.ClassCastException: 
org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be cast 
to org.apache.hadoop.hdfs.DFSInputStream
at 
org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
at 
org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
at 
org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
at 
org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
at 
org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
at 
org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
at 
org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
at 
com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
at 
com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
at 

[jira] [Created] (HAWQ-1346) If using WebHdfsFileSystem as default Filesytem, it will cause cast type exception

[Tian Hong Wang (JIRA)]

Tian Hong Wang created HAWQ-1346:


 Summary: If using WebHdfsFileSystem as default Filesytem, it will 
cause cast type exception
 Key: HAWQ-1346
 URL: https://issues.apache.org/jira/browse/HAWQ-1346
 Project: Apache HAWQ
  Issue Type: Bug
  Components: PXF
Reporter: Tian Hong Wang
Assignee: Ed Espino


In 
incubator-hawq/pxf/pxf-hdfs/src/main/java/org/apache/hawq/pxf/plugins/hdfs/ChunkRecordReader.java:

private DFSInputStream getInputStream() {
  return (DFSInputStream) (fileIn.getWrappedStream());
 }

If using WebHdfsFileSystem as default Filesytem, it will cause cast type 
exception;

java.lang.ClassCastException: 
org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream cannot be cast 
to org.apache.hadoop.hdfs.DFSInputStream
at 
org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.getInputStream(ChunkRecordReader.java:76)
at 
org.apache.hawq.pxf.plugins.hdfs.ChunkRecordReader.(ChunkRecordReader.java:112)
at 
org.apache.hawq.pxf.plugins.hdfs.LineBreakAccessor.getReader(LineBreakAccessor.java:64)
at 
org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.getNextSplit(HdfsSplittableDataAccessor.java:114)
at 
org.apache.hawq.pxf.plugins.hdfs.HdfsSplittableDataAccessor.openForRead(HdfsSplittableDataAccessor.java:83)
at 
org.apache.hawq.pxf.service.ReadBridge.beginIteration(ReadBridge.java:73)
at 
org.apache.hawq.pxf.service.rest.BridgeResource$1.write(BridgeResource.java:132)
at 
com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:71)
at 
com.sun.jersey.core.impl.provider.entity.StreamingOutputProvider.writeTo(StreamingOutputProvider.java:57)
at 
com.sun.jersey.spi.container.ContainerResponse.write(ContainerResponse.java:306)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1437)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)