[jira] [Commented] (ARROW-14730) [C++][R][Python] Support reading from Delta Lake tables

2022-01-07 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470951#comment-17470951 ] QP Hou commented on ARROW-14730: Sounds good to me Will. Please feel free to ping me if you need

[jira] [Commented] (ARROW-14730) [C++][R][Python] Support reading from Delta Lake tables

2021-12-15 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459717#comment-17459717 ] QP Hou commented on ARROW-14730: Yeah, I think the best way to share code between rust and c++ would be

[jira] [Commented] (ARROW-14730) [C++][R][Python] Support reading from Delta Lake tables

2021-12-12 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458096#comment-17458096 ] QP Hou commented on ARROW-14730: I think the main question we need to answer is whether the C++ core is

[jira] [Comment Edited] (ARROW-14730) [C++][R][Python] Support reading from Delta Lake tables

2021-11-18 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446049#comment-17446049 ] QP Hou edited comment on ARROW-14730 at 11/18/21, 5:09 PM: --- > From that's it's

[jira] [Comment Edited] (ARROW-14730) [C++][R][Python] Support reading from Delta Lake tables

2021-11-18 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446049#comment-17446049 ] QP Hou edited comment on ARROW-14730 at 11/18/21, 5:09 PM: --- > From that's it's

[jira] [Commented] (ARROW-14730) [C++][R][Python] Support reading from Delta Lake tables

2021-11-18 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446049#comment-17446049 ] QP Hou commented on ARROW-14730: > From that's it's simply a matter of reading parquet files. In fact

[jira] [Commented] (ARROW-14122) [C++] interval comparison kernels

2021-09-28 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421853#comment-17421853 ] QP Hou commented on ARROW-14122: > So then, if I understand correctly, the point on hashing comes down

[jira] [Commented] (ARROW-14122) [C++] interval comparison kernels

2021-09-28 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421849#comment-17421849 ] QP Hou commented on ARROW-14122: Awesome, looks like we have a consensus here :) +1 on making arrow

[jira] [Comment Edited] (ARROW-14122) [C++] interval comparison kernels

2021-09-26 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420213#comment-17420213 ] QP Hou edited comment on ARROW-14122 at 9/26/21, 6:09 AM: -- [~westonpace] my dev

[jira] [Comment Edited] (ARROW-14122) [C++] interval comparison kernels

2021-09-26 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420213#comment-17420213 ] QP Hou edited comment on ARROW-14122 at 9/26/21, 6:09 AM: -- [~westonpace] my dev

[jira] [Commented] (ARROW-14122) [C++] interval comparison kernels

2021-09-26 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420214#comment-17420214 ] QP Hou commented on ARROW-14122: I think [~jorgecarleitao]'s idea of letting users perform duration

[jira] [Comment Edited] (ARROW-14122) [C++] interval comparison kernels

2021-09-26 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420213#comment-17420213 ] QP Hou edited comment on ARROW-14122 at 9/26/21, 5:59 AM: -- [~westonpace] my dev

[jira] [Comment Edited] (ARROW-14122) [C++] interval comparison kernels

2021-09-25 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420213#comment-17420213 ] QP Hou edited comment on ARROW-14122 at 9/26/21, 5:58 AM: -- [~westonpace] my dev

[jira] [Commented] (ARROW-14122) [C++] interval comparison kernels

2021-09-25 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420213#comment-17420213 ] QP Hou commented on ARROW-14122: [~westonpace] my dev list thread was proposing that we should make

[jira] [Comment Edited] (ARROW-14122) [C++] interval comparison kernels

2021-09-25 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420213#comment-17420213 ] QP Hou edited comment on ARROW-14122 at 9/26/21, 5:54 AM: -- [~westonpace] my dev

[jira] [Resolved] (ARROW-13977) [Format] Clarify leap seconds and leap days for interval type

2021-09-25 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou resolved ARROW-13977. Fix Version/s: 6.0.0 Resolution: Fixed Issue resolved by pull request 11138

[jira] [Updated] (ARROW-13977) [Format] Clarify leap seconds and leap days for interval type

2021-09-11 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou updated ARROW-13977: --- Component/s: Format > [Format] Clarify leap seconds and leap days for interval type >

[jira] [Created] (ARROW-13977) [Format] Clarify leap seconds and leap days for interval type

2021-09-11 Thread QP Hou (Jira)
QP Hou created ARROW-13977: -- Summary: [Format] Clarify leap seconds and leap days for interval type Key: ARROW-13977 URL: https://issues.apache.org/jira/browse/ARROW-13977 Project: Apache Arrow

[jira] [Updated] (ARROW-11721) json schema inference should return Schema type instead of SchemaRef

2021-02-20 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou updated ARROW-11721: --- Summary: json schema inference should return Schema type instead of SchemaRef (was: json schame inference

[jira] [Created] (ARROW-11721) json schame inference should return Schema type instead of SchemaRef

2021-02-20 Thread QP Hou (Jira)
QP Hou created ARROW-11721: -- Summary: json schame inference should return Schema type instead of SchemaRef Key: ARROW-11721 URL: https://issues.apache.org/jira/browse/ARROW-11721 Project: Apache Arrow

[jira] [Created] (ARROW-11719) Support merged schema for memory table

2021-02-20 Thread QP Hou (Jira)
QP Hou created ARROW-11719: -- Summary: Support merged schema for memory table Key: ARROW-11719 URL: https://issues.apache.org/jira/browse/ARROW-11719 Project: Apache Arrow Issue Type: Task

[jira] [Commented] (ARROW-11017) [Rust] [DataFusion] Add support for Parquet schema merging

2021-02-20 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287787#comment-17287787 ] QP Hou commented on ARROW-11017: The Schema struct does have a try_merge method defined, should we just

[jira] [Created] (ARROW-11708) Clean up Rust 2021 linting warning

2021-02-20 Thread QP Hou (Jira)
QP Hou created ARROW-11708: -- Summary: Clean up Rust 2021 linting warning Key: ARROW-11708 URL: https://issues.apache.org/jira/browse/ARROW-11708 Project: Apache Arrow Issue Type: Task

[jira] [Updated] (ARROW-11707) Support CSV schema inference without IO

2021-02-20 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou updated ARROW-11707: --- Summary: Support CSV schema inference without IO (was: Decouple CSV schema inference from IO) > Support

[jira] [Updated] (ARROW-11707) Decouple CSV schema inference from IO

2021-02-20 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou updated ARROW-11707: --- Summary: Decouple CSV schema inference from IO (was: Support CSV schema inference without seek) >

[jira] [Created] (ARROW-11707) Support CSV schema inference without seek

2021-02-20 Thread QP Hou (Jira)
QP Hou created ARROW-11707: -- Summary: Support CSV schema inference without seek Key: ARROW-11707 URL: https://issues.apache.org/jira/browse/ARROW-11707 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-11542) [Rust] json reader should not crash when reading nested list

2021-02-06 Thread QP Hou (Jira)
QP Hou created ARROW-11542: -- Summary: [Rust] json reader should not crash when reading nested list Key: ARROW-11542 URL: https://issues.apache.org/jira/browse/ARROW-11542 Project: Apache Arrow

[jira] [Created] (ARROW-11491) support json schema inference for nested list and struct

2021-02-03 Thread QP Hou (Jira)
QP Hou created ARROW-11491: -- Summary: support json schema inference for nested list and struct Key: ARROW-11491 URL: https://issues.apache.org/jira/browse/ARROW-11491 Project: Apache Arrow Issue

[jira] [Created] (ARROW-11435) Allow creating ParquetPartition from external crate

2021-01-30 Thread QP Hou (Jira)
QP Hou created ARROW-11435: -- Summary: Allow creating ParquetPartition from external crate Key: ARROW-11435 URL: https://issues.apache.org/jira/browse/ARROW-11435 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-11366) Support boolean literal in equality expression

2021-01-24 Thread QP Hou (Jira)
QP Hou created ARROW-11366: -- Summary: Support boolean literal in equality expression Key: ARROW-11366 URL: https://issues.apache.org/jira/browse/ARROW-11366 Project: Apache Arrow Issue Type: Task

[jira] [Closed] (ARROW-11295) bump tokio to 1.x

2021-01-21 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou closed ARROW-11295. -- Resolution: Duplicate > bump tokio to 1.x > - > > Key: ARROW-11295 >

[jira] [Commented] (ARROW-7396) [Format] Register media types (MIME types) for Apache Arrow formats to IANA

2021-01-18 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267660#comment-17267660 ] QP Hou commented on ARROW-7396: --- Any update on this task? Should we start a vote for what

[jira] [Created] (ARROW-11310) implement arrow JSON writer

2021-01-18 Thread QP Hou (Jira)
QP Hou created ARROW-11310: -- Summary: implement arrow JSON writer Key: ARROW-11310 URL: https://issues.apache.org/jira/browse/ARROW-11310 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-11295) bump tokio to 1.x

2021-01-17 Thread QP Hou (Jira)
QP Hou created ARROW-11295: -- Summary: bump tokio to 1.x Key: ARROW-11295 URL: https://issues.apache.org/jira/browse/ARROW-11295 Project: Apache Arrow Issue Type: Task Components: Rust

[jira] [Created] (ARROW-11113) [Rust] support as_struct_array cast

2021-01-02 Thread QP Hou (Jira)
QP Hou created ARROW-3: -- Summary: [Rust] support as_struct_array cast Key: ARROW-3 URL: https://issues.apache.org/jira/browse/ARROW-3 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-11110) [Rust] [Datafusion] context.table should not take a mutable self reference

2021-01-02 Thread QP Hou (Jira)
QP Hou created ARROW-0: -- Summary: [Rust] [Datafusion] context.table should not take a mutable self reference Key: ARROW-0 URL: https://issues.apache.org/jira/browse/ARROW-0 Project: Apache Arrow

[jira] [Created] (ARROW-10876) [Rust] json reader should validate value type

2020-12-10 Thread QP Hou (Jira)
QP Hou created ARROW-10876: -- Summary: [Rust] json reader should validate value type Key: ARROW-10876 URL: https://issues.apache.org/jira/browse/ARROW-10876 Project: Apache Arrow Issue Type: Bug

[jira] [Assigned] (ARROW-10876) [Rust] json reader should validate value type

2020-12-10 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou reassigned ARROW-10876: -- Assignee: QP Hou > [Rust] json reader should validate value type >

[jira] [Created] (ARROW-10875) simplify simd cfg check

2020-12-10 Thread QP Hou (Jira)
QP Hou created ARROW-10875: -- Summary: simplify simd cfg check Key: ARROW-10875 URL: https://issues.apache.org/jira/browse/ARROW-10875 Project: Apache Arrow Issue Type: Bug Components:

[jira] [Created] (ARROW-10842) [Rust] decouple IO from json schema inference code

2020-12-07 Thread QP Hou (Jira)
QP Hou created ARROW-10842: -- Summary: [Rust] decouple IO from json schema inference code Key: ARROW-10842 URL: https://issues.apache.org/jira/browse/ARROW-10842 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-10830) [Rust] json reader should not hard crash on invalid json

2020-12-06 Thread QP Hou (Jira)
QP Hou created ARROW-10830: -- Summary: [Rust] json reader should not hard crash on invalid json Key: ARROW-10830 URL: https://issues.apache.org/jira/browse/ARROW-10830 Project: Apache Arrow Issue

[jira] [Assigned] (ARROW-10822) [Rust] [Datafusion] support compiling datafusion with simd support

2020-12-05 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou reassigned ARROW-10822: -- Assignee: QP Hou > [Rust] [Datafusion] support compiling datafusion with simd support >

[jira] [Created] (ARROW-10822) [Rust] [Datafusion] support compiling datafusion with simd support

2020-12-05 Thread QP Hou (Jira)
QP Hou created ARROW-10822: -- Summary: [Rust] [Datafusion] support compiling datafusion with simd support Key: ARROW-10822 URL: https://issues.apache.org/jira/browse/ARROW-10822 Project: Apache Arrow

[jira] [Created] (ARROW-10821) [Rust] [Datafusion] implement negative expression

2020-12-05 Thread QP Hou (Jira)
QP Hou created ARROW-10821: -- Summary: [Rust] [Datafusion] implement negative expression Key: ARROW-10821 URL: https://issues.apache.org/jira/browse/ARROW-10821 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-10458) [Rust] [Datafusion] context.create_logical_plan should not take a mutable self reference

2020-11-01 Thread QP Hou (Jira)
QP Hou created ARROW-10458: -- Summary: [Rust] [Datafusion] context.create_logical_plan should not take a mutable self reference Key: ARROW-10458 URL: https://issues.apache.org/jira/browse/ARROW-10458

[jira] [Created] (ARROW-10454) [Rust][Datafusion] support creating ParquetExec from externally resolved file list and schema

2020-10-31 Thread QP Hou (Jira)
QP Hou created ARROW-10454: -- Summary: [Rust][Datafusion] support creating ParquetExec from externally resolved file list and schema Key: ARROW-10454 URL: https://issues.apache.org/jira/browse/ARROW-10454

[jira] [Created] (ARROW-9327) Fix all clippy errors for arrow crate

2020-07-05 Thread QP Hou (Jira)
QP Hou created ARROW-9327: - Summary: Fix all clippy errors for arrow crate Key: ARROW-9327 URL: https://issues.apache.org/jira/browse/ARROW-9327 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-9192) [Rust] Enable clippy linting for arrow crate in CI pipeline

2020-06-19 Thread QP Hou (Jira)
QP Hou created ARROW-9192: - Summary: [Rust] Enable clippy linting for arrow crate in CI pipeline Key: ARROW-9192 URL: https://issues.apache.org/jira/browse/ARROW-9192 Project: Apache Arrow Issue

[jira] [Updated] (ARROW-9157) [Rust][Datafusion] execution context's create_physical_plan should take self as immutable reference

2020-06-18 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou updated ARROW-9157: -- Component/s: Rust - DataFusion > [Rust][Datafusion] execution context's create_physical_plan should take self

[jira] [Created] (ARROW-9184) [Rust][Datafusion] table scan without projection should return all columns

2020-06-18 Thread QP Hou (Jira)
QP Hou created ARROW-9184: - Summary: [Rust][Datafusion] table scan without projection should return all columns Key: ARROW-9184 URL: https://issues.apache.org/jira/browse/ARROW-9184 Project: Apache Arrow

[jira] [Updated] (ARROW-9158) [Rust][Datafusion] Projection physical plan compilation should preserve nullability

2020-06-18 Thread QP Hou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QP Hou updated ARROW-9158: -- Component/s: Rust - DataFusion > [Rust][Datafusion] Projection physical plan compilation should preserve >

[jira] [Created] (ARROW-9158) [Rust][Datafusion] Projection physical plan compilation should preserve nullability

2020-06-17 Thread QP Hou (Jira)
QP Hou created ARROW-9158: - Summary: [Rust][Datafusion] Projection physical plan compilation should preserve nullability Key: ARROW-9158 URL: https://issues.apache.org/jira/browse/ARROW-9158 Project: Apache

[jira] [Created] (ARROW-9157) [Rust][Datafusion] execution context's create_physical_plan should take self as immutable reference

2020-06-16 Thread QP Hou (Jira)
QP Hou created ARROW-9157: - Summary: [Rust][Datafusion] execution context's create_physical_plan should take self as immutable reference Key: ARROW-9157 URL: https://issues.apache.org/jira/browse/ARROW-9157