[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-26 Thread Andrew Lamb (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17332232#comment-17332232 ] Andrew Lamb commented on ARROW-11897: - Migrated to github:

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-25 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331639#comment-17331639 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: I have now added the ArrayConverter trait,

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-21 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326954#comment-17326954 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: I have now implemented the level decoder iterator

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-18 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324597#comment-17324597 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: over the past few days I managed to finish the

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-13 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320550#comment-17320550 ] Yordan Pavlov commented on ARROW-11897: --- I have finally been able to assemble enough code to

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-04-05 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315037#comment-17315037 ] Yordan Pavlov commented on ARROW-11897: --- UPDATE: after spending the past few weeks figuring out

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-30 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311401#comment-17311401 ] Jorge Leitão commented on ARROW-11897: -- I see. To understand: is there a reason why this should be

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-30 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311356#comment-17311356 ] Daniël Heres commented on ARROW-11897: -- [~yordan-pavlov] you can join the apache slack here:

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-30 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311291#comment-17311291 ] Yordan Pavlov commented on ARROW-11897: --- [~jorgecarleitao] I would be happy to have a chat in

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-30 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311165#comment-17311165 ] Jorge Leitão commented on ARROW-11897: -- Ok, so, just to give a heads up: I have been experimenting

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-29 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310522#comment-17310522 ] Yordan Pavlov commented on ARROW-11897: --- [~jorgecarleitao] thank you for looking into the parquet

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-28 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310433#comment-17310433 ] Jorge Leitão commented on ARROW-11897: -- FWIW, I started going through the parquet crate and

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-28 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310301#comment-17310301 ] Yordan Pavlov commented on ARROW-11897: --- Hi [~Dandandan], apologies I should have updated on my

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-27 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309934#comment-17309934 ] Daniël Heres commented on ARROW-11897: -- [~yordan-pavlov] just checking - any updates to share and

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-07 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296986#comment-17296986 ] Daniël Heres commented on ARROW-11897: -- [~yordan-pavlov] makes sense, thanks! > [Rust][Parquet]

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-07 Thread Yordan Pavlov (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296838#comment-17296838 ] Yordan Pavlov commented on ARROW-11897: --- [~Dandandan] regarding the count values, yes you are

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-07 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296818#comment-17296818 ] Daniël Heres commented on ARROW-11897: -- That sounds like a cool idea. I like the idea of a very

[jira] [Commented] (ARROW-11897) [Rust][Parquet] Use iterators to increase performance of creating Arrow arrays

2021-03-06 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-11897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296636#comment-17296636 ] Jorge Leitão commented on ARROW-11897: -- Not much to say other than AWESOME! Look very nuch forward