[jira] [Closed] (ARROW-5318) [Python] pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Dimitrov closed ARROW-5318. Resolution: Fixed > [Python] pyarrow hdfs reader overrequests > -

[jira] [Created] (ARROW-5432) [Python] Add 'read_at' method to pyarrow.NativeFile

Ivan Dimitrov created ARROW-5432: Summary: [Python] Add 'read_at' method to pyarrow.NativeFile Key: ARROW-5432 URL: https://issues.apache.org/jira/browse/ARROW-5432 Project: Apache Arrow Issu

[jira] [Commented] (ARROW-5318) [Python] pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850190#comment-16850190 ] Ivan Dimitrov commented on ARROW-5318: -- Resolution at https://issues.apache.org/jira

[jira] [Commented] (ARROW-5318) [Python] pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846106#comment-16846106 ] Ivan Dimitrov commented on ARROW-5318: -- Ticket Resolution:  The culprit was caching

[jira] [Commented] (ARROW-5318) [Python] pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842663#comment-16842663 ] Ivan Dimitrov commented on ARROW-5318: -- Update on the ticket. When using pyhdfs (a

[jira] [Updated] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Dimitrov updated ARROW-5318: - Description: I am using pyarrow's HdfsFilesystem interface. When I call a read on n bytes, I oft

[jira] [Updated] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Dimitrov updated ARROW-5318: - Description: I am using pyarrow's HdfsFilesystem interface. When I call a read on n bytes, I oft

[jira] [Updated] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Dimitrov updated ARROW-5318: - Description: I am using pyarrow's HdfsFilesystem interface. When I call a read on n bytes, I oft

[jira] [Commented] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841732#comment-16841732 ] Ivan Dimitrov commented on ARROW-5318: -- [~wesmckinn] Hey thanks for responding on st

[jira] [Comment Edited] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841732#comment-16841732 ] Ivan Dimitrov edited comment on ARROW-5318 at 5/16/19 9:20 PM:

[jira] [Updated] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Dimitrov updated ARROW-5318: - Description: When reading using HdfsFilesystem's read method, the amount is not constant and fla

[jira] [Commented] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840647#comment-16840647 ] Ivan Dimitrov commented on ARROW-5318: -- @[pitrou|https://github.com/apache/arrow/com

[jira] [Commented] (ARROW-5318) pyarrow hdfs reader overrequests

[ https://issues.apache.org/jira/browse/ARROW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839714#comment-16839714 ] Ivan Dimitrov commented on ARROW-5318: -- Maybe this is some eager caching? > pyarrow

[jira] [Created] (ARROW-5318) pyarrow hdfs reader overrequests

Ivan Dimitrov created ARROW-5318: Summary: pyarrow hdfs reader overrequests Key: ARROW-5318 URL: https://issues.apache.org/jira/browse/ARROW-5318 Project: Apache Arrow Issue Type: Bug