[jira] [Comment Edited] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331639#comment-17331639 ] Yordan Pavlov edited comment on ARROW-11897 at 4/25/21, 8:59 PM: -

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331639#comment-17331639 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: I have now added the ArrayConverter trait,

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326954#comment-17326954 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: I have now implemented the level decoder iterator

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324597#comment-17324597 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: over the past few days I managed to finish the

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320550#comment-17320550 ] Yordan Pavlov commented on ARROW-11897: --- I have finally been able to assemble enough code to

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315037#comment-17315037 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: after spending the past few weeks figuring out

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311291#comment-17311291 ] Yordan Pavlov commented on ARROW-11897: --- [~jorgecarleitao] I would be happy to have a chat in

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310522#comment-17310522 ] Yordan Pavlov commented on ARROW-11897: --- [~jorgecarleitao] thank you for looking into the parquet

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310301#comment-17310301 ] Yordan Pavlov commented on ARROW-11897: --- Hi [~Dandandan], apologies I should have updated on my

[jira] [Comment Edited] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296838#comment-17296838 ] Yordan Pavlov edited comment on ARROW-11897 at 3/7/21, 11:01 AM: -

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296838#comment-17296838 ] Yordan Pavlov commented on ARROW-11897: --- [~Dandandan] regarding the count values, yes you are

[jira] [Updated] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yordan Pavlov updated ARROW-11897: -- Description: The overall goal is to create an efficient pipeline from Parquet page data into 

[jira] [Created] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

Yordan Pavlov created ARROW-11897: - Summary: [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays Key: ARROW-11897 URL: https://issues.apache.org/jira/browse/ARROW-11897

[jira] [Created] (ARROW-11799) [Rust] String and Binary arrays created with incorrect length from unbound iterator

Yordan Pavlov created ARROW-11799: - Summary: [Rust] String and Binary arrays created with incorrect length from unbound iterator Key: ARROW-11799 URL: https://issues.apache.org/jira/browse/ARROW-11799

[jira] [Created] (ARROW-11074) [Rust][DataFusion] Implement predicate push-down for parquet tables

Yordan Pavlov created ARROW-11074: - Summary: [Rust][DataFusion] Implement predicate push-down for parquet tables Key: ARROW-11074 URL: https://issues.apache.org/jira/browse/ARROW-11074 Project:

[jira] [Updated] (ARROW-10759) [Rust][DataFusion] Implement support for casting string to date in sql expressions

[ https://issues.apache.org/jira/browse/ARROW-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yordan Pavlov updated ARROW-10759: -- Description: If DataFusion had support for creating date literals using a cast expression

[jira] [Created] (ARROW-10759) [Rust][DataFusion] Implement support for casting string to date in sql expressions

Yordan Pavlov created ARROW-10759: - Summary: [Rust][DataFusion] Implement support for casting string to date in sql expressions Key: ARROW-10759 URL: https://issues.apache.org/jira/browse/ARROW-10759

[jira] [Commented] (ARROW-8908) [Rust][DataFusion] improve performance of building literal arrays

[ https://issues.apache.org/jira/browse/ARROW-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17234942#comment-17234942 ] Yordan Pavlov commented on ARROW-8908: -- direct comparison to scalar values was implemented in

[jira] [Comment Edited] (ARROW-10173) [Rust][DataFusion] Improve performance of equality to a constant predicate support

[ https://issues.apache.org/jira/browse/ARROW-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230223#comment-17230223 ] Yordan Pavlov edited comment on ARROW-10173 at 11/12/20, 9:42 PM: -- I

[jira] [Commented] (ARROW-10173) [Rust][DataFusion] Improve performance of equality to a constant predicate support

[ https://issues.apache.org/jira/browse/ARROW-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230223#comment-17230223 ] Yordan Pavlov commented on ARROW-10173: --- I have an initial implementation of direct comparison

[jira] [Commented] (ARROW-10173) [Rust][DataFusion] Improve performance of equality to a constant predicate support

[ https://issues.apache.org/jira/browse/ARROW-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219936#comment-17219936 ] Yordan Pavlov commented on ARROW-10173: --- this issue is related to:

[jira] [Created] (ARROW-9523) [Rust] improve performance of filter kernel

Yordan Pavlov created ARROW-9523: Summary: [Rust] improve performance of filter kernel Key: ARROW-9523 URL: https://issues.apache.org/jira/browse/ARROW-9523 Project: Apache Arrow Issue Type: