[jira] [Updated] (ARROW-18360) [Python] Incorrectly passing schema=None to do_put crashes

2022-11-17 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-18360: - Priority: Minor (was: Major) > [Python] Incorrectly passing schema=None to do_put crashes > ---

[jira] [Created] (ARROW-18360) [Python] Incorrectly passing schema=None to do_put crashes

2022-11-17 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-18360: Summary: [Python] Incorrectly passing schema=None to do_put crashes Key: ARROW-18360 URL: https://issues.apache.org/jira/browse/ARROW-18360 Project: Apache Arrow

[jira] [Created] (ARROW-18360) [Python] Incorrectly passing schema=None to do_put crashes

2022-11-17 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-18360: Summary: [Python] Incorrectly passing schema=None to do_put crashes Key: ARROW-18360 URL: https://issues.apache.org/jira/browse/ARROW-18360 Project: Apache Arrow

[jira] [Assigned] (SPARK-38098) Add support for ArrayType of nested StructType to arrow-based conversion

2022-09-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-38098: Assignee: Luca Canali > Add support for ArrayType of nested StructType to arrow-based con

[jira] [Resolved] (SPARK-38098) Add support for ArrayType of nested StructType to arrow-based conversion

2022-09-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-38098. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35391 [https://gi

[jira] [Resolved] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-39160. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36518 [https://gi

[jira] [Assigned] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-39160: Assignee: Cheng Pan > Remove workaround for ARROW-1948 >

[jira] [Assigned] (ARROW-15778) [Java] Endianness field not emitted in IPC stream

2022-04-05 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-15778: Assignee: Kazuaki Ishizaki > [Java] Endianness field not emitted in IPC stream >

[jira] [Resolved] (ARROW-15778) [Java] Endianness field not emitted in IPC stream

2022-04-05 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-15778. -- Resolution: Fixed Issue resolved by pull request 12777 [https://github.com/apache/arrow/pull/1

[jira] [Commented] (ARROW-15778) [Java] Endianness field not emitted in IPC stream

2022-03-24 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512169#comment-17512169 ] Bryan Cutler commented on ARROW-15778: -- [~kiszk] since your patch looks to be prett

[jira] [Commented] (ARROW-15954) [Java][Packaging] Nigthly build is broken due dependencies problems for flight-core module

2022-03-16 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507812#comment-17507812 ] Bryan Cutler commented on ARROW-15954: -- I think after the grpc and netty upgrade, s

[jira] [Assigned] (ARROW-15954) [Java][Packaging] Nigthly build is broken due dependencies problems for flight-core module

2022-03-16 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-15954: Assignee: Bryan Cutler > [Java][Packaging] Nigthly build is broken due dependencies probl

[jira] [Updated] (ARROW-15795) Add a getter for the timeZone in TimeStampMicroTZVector

2022-03-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-15795: - Fix Version/s: 7.0.1 > Add a getter for the timeZone in TimeStampMicroTZVector > ---

[jira] [Assigned] (ARROW-15795) Add a getter for the timeZone in TimeStampMicroTZVector

2022-03-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-15795: Assignee: Fabien > Add a getter for the timeZone in TimeStampMicroTZVector >

[jira] [Resolved] (ARROW-15795) Add a getter for the timeZone in TimeStampMicroTZVector

2022-03-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-15795. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 12521 [https://gi

[jira] [Created] (ARROW-15831) [Java] Upgrade Flight dependencies

2022-03-02 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-15831: Summary: [Java] Upgrade Flight dependencies Key: ARROW-15831 URL: https://issues.apache.org/jira/browse/ARROW-15831 Project: Apache Arrow Issue Type: Improve

[jira] [Created] (ARROW-15831) [Java] Upgrade Flight dependencies

2022-03-02 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-15831: Summary: [Java] Upgrade Flight dependencies Key: ARROW-15831 URL: https://issues.apache.org/jira/browse/ARROW-15831 Project: Apache Arrow Issue Type: Improve

[jira] [Resolved] (ARROW-11396) [JAVA] Update the access permission from private to protected

2022-02-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-11396. -- Resolution: Won't Fix > [JAVA] Update the access permission from private to protected > --

[jira] [Assigned] (ARROW-14665) [Java] JdbcToArrowUtils ResultSet iteration bug

2022-02-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-14665: Assignee: Zac > [Java] JdbcToArrowUtils ResultSet iteration bug > ---

[jira] [Assigned] (ARROW-15272) [Java] ArrowVectorIterator eats initialization exceptions when close fails

2022-02-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-15272: Assignee: Andrew Higgins > [Java] ArrowVectorIterator eats initialization exceptions when

[jira] [Resolved] (ARROW-15272) [Java] ArrowVectorIterator eats initialization exceptions when close fails

2022-02-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-15272. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 12094 [https://gi

[jira] [Comment Edited] (ARROW-14549) VectorSchemaRoot is not refreshed when value is null

2022-02-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498249#comment-17498249 ] Bryan Cutler edited comment on ARROW-14549 at 2/25/22, 6:22 PM: --

[jira] [Resolved] (ARROW-14549) VectorSchemaRoot is not refreshed when value is null

2022-02-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-14549. -- Resolution: Not A Problem > VectorSchemaRoot is not refreshed when value is null > ---

[jira] [Commented] (ARROW-14549) VectorSchemaRoot is not refreshed when value is null

2022-02-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498249#comment-17498249 ] Bryan Cutler commented on ARROW-14549: -- [~hu6360567] Calling `allocateNew()` will c

[jira] [Resolved] (ARROW-14665) [Java] JdbcToArrowUtils ResultSet iteration bug

2022-02-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-14665. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 11667 [https://gi

[jira] [Resolved] (ARROW-15722) [Java] Improve error message for ListVector with wrong number of children

2022-02-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-15722. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 12456 [https://gi

[jira] [Created] (ARROW-15746) [Java] Add arrow-flight pom to list of artifacts to deploy

2022-02-21 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-15746: Summary: [Java] Add arrow-flight pom to list of artifacts to deploy Key: ARROW-15746 URL: https://issues.apache.org/jira/browse/ARROW-15746 Project: Apache Arrow

[jira] [Created] (ARROW-15746) [Java] Add arrow-flight pom to list of artifacts to deploy

2022-02-21 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-15746: Summary: [Java] Add arrow-flight pom to list of artifacts to deploy Key: ARROW-15746 URL: https://issues.apache.org/jira/browse/ARROW-15746 Project: Apache Arrow

[jira] [Updated] (ARROW-15486) [Release][Java] Verify staged maven artifacts

2022-02-17 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-15486: - Summary: [Release][Java] Verify staged maven artifacts (was: [Relase][Java] Verify staged maven

[jira] [Created] (ARROW-15722) [Java] Improve error message for ListVector with wrong number of children

2022-02-17 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-15722: Summary: [Java] Improve error message for ListVector with wrong number of children Key: ARROW-15722 URL: https://issues.apache.org/jira/browse/ARROW-15722 Project: Ap

[jira] [Created] (ARROW-15722) [Java] Improve error message for ListVector with wrong number of children

2022-02-17 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-15722: Summary: [Java] Improve error message for ListVector with wrong number of children Key: ARROW-15722 URL: https://issues.apache.org/jira/browse/ARROW-15722 Project: Ap

[jira] [Assigned] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

2021-12-16 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-34521: Assignee: Nicolas Azrak > spark.createDataFrame does not support Pandas StringDtype exten

[jira] [Resolved] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

2021-12-15 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-34521. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34509 [https://gi

[jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2021-10-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-21187: - Attachment: (was: 0--1172099527-254246775-1412485878) > Complete support for remaining Spark

[jira] [Resolved] (ARROW-13814) [CI] Nightly integration build with spark master failing to compile spark

2021-10-05 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-13814. -- Resolution: Fixed Issue resolved by pull request 11282 [https://github.com/apache/arrow/pull/1

[jira] [Resolved] (ARROW-14014) FlightClient.ClientStreamListener not notified on error when parsing invalid trailers

2021-10-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-14014. -- Fix Version/s: 6.0.0 Resolution: Fixed Issue resolved by pull request 11311 [https://gi

[jira] [Assigned] (ARROW-14014) FlightClient.ClientStreamListener not notified on error when parsing invalid trailers

2021-10-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-14014: Assignee: Bryan Cutler > FlightClient.ClientStreamListener not notified on error when par

[jira] [Resolved] (ARROW-14198) [Java] Upgrade Netty and gRPC dependencies

2021-10-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-14198. -- Fix Version/s: 6.0.0 Resolution: Fixed Issue resolved by pull request 11293 [https://gi

[jira] [Commented] (ARROW-14014) FlightClient.ClientStreamListener not notified on error when parsing invalid trailers

2021-10-01 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423442#comment-17423442 ] Bryan Cutler commented on ARROW-14014: -- I've run into this a couple times [~manudeb

[jira] [Created] (ARROW-14198) [Java] Upgrade Netty and gRPC dependencies

2021-10-01 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-14198: Summary: [Java] Upgrade Netty and gRPC dependencies Key: ARROW-14198 URL: https://issues.apache.org/jira/browse/ARROW-14198 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-14198) [Java] Upgrade Netty and gRPC dependencies

2021-10-01 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-14198: Summary: [Java] Upgrade Netty and gRPC dependencies Key: ARROW-14198 URL: https://issues.apache.org/jira/browse/ARROW-14198 Project: Apache Arrow Issue Type:

[jira] [Resolved] (ARROW-9647) [Java] Cannot install arrow-memory 1.0.0 from maven central

2021-10-01 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-9647. - Resolution: Not A Problem > [Java] Cannot install arrow-memory 1.0.0 from maven central > ---

[jira] [Assigned] (ARROW-13814) [CI] Nightly integration build with spark master failing to compile spark

2021-09-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-13814: Assignee: Bryan Cutler > [CI] Nightly integration build with spark master failing to comp

[jira] [Created] (ARROW-13872) [Java] ExtensionTypeVector does not work with RangeEqualsVisitor

2021-09-02 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-13872: Summary: [Java] ExtensionTypeVector does not work with RangeEqualsVisitor Key: ARROW-13872 URL: https://issues.apache.org/jira/browse/ARROW-13872 Project: Apache Arro

[jira] [Created] (ARROW-13872) [Java] ExtensionTypeVector does not work with RangeEqualsVisitor

2021-09-02 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-13872: Summary: [Java] ExtensionTypeVector does not work with RangeEqualsVisitor Key: ARROW-13872 URL: https://issues.apache.org/jira/browse/ARROW-13872 Project: Apache Arro

[jira] [Commented] (ARROW-13814) [CI] Nightly integration build with spark master failing to compile spark

2021-08-31 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407801#comment-17407801 ] Bryan Cutler commented on ARROW-13814: -- Not sure why compilation would fail like th

[jira] [Assigned] (ARROW-12679) [Java] JDBC adapter does not preserve SQL-nullability

2021-07-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-12679: Assignee: Joris Peeters (was: Bryan Cutler) > [Java] JDBC adapter does not preserve SQL-

[jira] [Assigned] (ARROW-12679) [Java] JDBC adapter does not preserve SQL-nullability

2021-07-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned ARROW-12679: Assignee: Bryan Cutler (was: Joris Peeters) > [Java] JDBC adapter does not preserve SQL-

[jira] [Resolved] (ARROW-13044) [Java] Union vectors should extend ValueVector

2021-06-14 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-13044. -- Fix Version/s: 5.0.0 Resolution: Fixed Issue resolved by pull request 10513 [https://gi

[jira] [Created] (ARROW-13076) [Java] Enable ExtensionType to use StructVector and UnionVector for underlying storage

2021-06-14 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-13076: Summary: [Java] Enable ExtensionType to use StructVector and UnionVector for underlying storage Key: ARROW-13076 URL: https://issues.apache.org/jira/browse/ARROW-13076

[jira] [Created] (ARROW-13076) [Java] Enable ExtensionType to use StructVector and UnionVector for underlying storage

2021-06-14 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-13076: Summary: [Java] Enable ExtensionType to use StructVector and UnionVector for underlying storage Key: ARROW-13076 URL: https://issues.apache.org/jira/browse/ARROW-13076

[jira] [Updated] (ARROW-13044) [Java] Union vectors should extend ValueVector

2021-06-14 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-13044: - Description: I was going to try using a DenseUnionVector as the underlying vector of an extensi

[jira] [Updated] (ARROW-13044) [Java] Union vectors should extend ValueVector

2021-06-14 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-13044: - Summary: [Java] Union vectors should extend ValueVector (was: [Java] Union vectors should exten

[jira] [Created] (ARROW-13044) [Java] Union vectors should extend BaseValueVector

2021-06-10 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-13044: Summary: [Java] Union vectors should extend BaseValueVector Key: ARROW-13044 URL: https://issues.apache.org/jira/browse/ARROW-13044 Project: Apache Arrow Iss

[jira] [Created] (ARROW-13044) [Java] Union vectors should extend BaseValueVector

2021-06-10 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-13044: Summary: [Java] Union vectors should extend BaseValueVector Key: ARROW-13044 URL: https://issues.apache.org/jira/browse/ARROW-13044 Project: Apache Arrow Iss

[jira] [Commented] (ARROW-8666) [Java] DenseUnionVector has no way to set offset/validity directly

2021-06-10 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361229#comment-17361229 ] Bryan Cutler commented on ARROW-8666: - [~lidavidm] can this be closed then, or are th

[jira] [Comment Edited] (SPARK-34463) toPandas failed with error: buffer source array is read-only when Arrow with self-destruct is enabled

2021-03-02 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293893#comment-17293893 ] Bryan Cutler edited comment on SPARK-34463 at 3/2/21, 6:11 PM: ---

[jira] [Commented] (SPARK-34463) toPandas failed with error: buffer source array is read-only when Arrow with self-destruct is enabled

2021-03-02 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293893#comment-17293893 ] Bryan Cutler commented on SPARK-34463: -- As David said, it depends on what is done i

[jira] [Resolved] (ARROW-11223) [Java] BaseVariableWidthVector/BaseLargeVariableWidthVector setNull and getBufferSizeFor is buggy

2021-02-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-11223. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9187 [https://git

[jira] [Updated] (ARROW-11739) [Java] Add API for getBufferSizeFor() with density to BaseVariableWidthVector

2021-02-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-11739: - Description: Following the discussion on https://github.com/apache/arrow/pull/9187. Proposed AP

[jira] [Updated] (ARROW-11739) [Java] Add API for getBufferSize() with density to BaseVariableWidthVector

2021-02-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-11739: - Description: Following the discussion on https://github.com/apache/arrow/pull/9187. The current

[jira] [Updated] (ARROW-11739) [Java] Add API for getBufferSizeFor() with density to BaseVariableWidthVector

2021-02-22 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-11739: - Summary: [Java] Add API for getBufferSizeFor() with density to BaseVariableWidthVector (was: [J

[jira] [Created] (ARROW-11739) [Java] Add API for getBufferSize() with density to BaseVariableWidthVector

2021-02-22 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-11739: Summary: [Java] Add API for getBufferSize() with density to BaseVariableWidthVector Key: ARROW-11739 URL: https://issues.apache.org/jira/browse/ARROW-11739 Project: A

[jira] [Created] (ARROW-11739) [Java] Add API for getBufferSize() with density to BaseVariableWidthVector

2021-02-22 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-11739: Summary: [Java] Add API for getBufferSize() with density to BaseVariableWidthVector Key: ARROW-11739 URL: https://issues.apache.org/jira/browse/ARROW-11739 Project: A

[jira] [Assigned] (SPARK-32953) Lower memory usage in toPandas with Arrow self_destruct

2021-02-10 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-32953: Assignee: David Li > Lower memory usage in toPandas with Arrow self_destruct > --

[jira] [Resolved] (SPARK-32953) Lower memory usage in toPandas with Arrow self_destruct

2021-02-10 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32953. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 29818 [https://gi

[jira] [Created] (ARROW-11382) [Java] NullVector field name can't be set

2021-01-25 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-11382: Summary: [Java] NullVector field name can't be set Key: ARROW-11382 URL: https://issues.apache.org/jira/browse/ARROW-11382 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-11382) [Java] NullVector field name can't be set

2021-01-25 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-11382: Summary: [Java] NullVector field name can't be set Key: ARROW-11382 URL: https://issues.apache.org/jira/browse/ARROW-11382 Project: Apache Arrow Issue Type:

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

2020-12-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255712#comment-17255712 ] Bryan Cutler commented on SPARK-24632: -- Ping [~huaxingao] in case you have some tim

[jira] [Resolved] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

2020-12-11 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-33576. -- Resolution: Duplicate Going to resolve as a duplicate, but please reopen if you find it is dif

[jira] [Commented] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

2020-12-11 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248064#comment-17248064 ] Bryan Cutler commented on SPARK-33576: -- [~darshats] I believe the only current work

[jira] [Commented] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

2020-12-01 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241769#comment-17241769 ] Bryan Cutler commented on SPARK-33576: -- Is this due to the 2GB limit? As in https:

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

2020-11-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241092#comment-17241092 ] Bryan Cutler commented on SPARK-33489: -- Great, thanks [~cactice] ! Please feel free

[jira] [Created] (SPARK-33613) [Python][Tests] Replace calls to deprecated test APIs

2020-11-30 Thread Bryan Cutler (Jira)
Bryan Cutler created SPARK-33613: Summary: [Python][Tests] Replace calls to deprecated test APIs Key: SPARK-33613 URL: https://issues.apache.org/jira/browse/SPARK-33613 Project: Spark Issue T

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

2020-11-25 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238950#comment-17238950 ] Bryan Cutler commented on SPARK-33489: -- Yes, Arrow supports null type. Should be pr

[jira] [Resolved] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2020-11-20 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-21187. -- Fix Version/s: 3.1.0 Resolution: Fixed With MapType now added, all basic types are supp

[jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

2020-11-20 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-21187: - Description: This is to track adding the remaining type support in Arrow Converters. Currently,

[jira] [Updated] (SPARK-32285) Add PySpark support for nested timestamps with arrow

2020-11-20 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-32285: - Parent: (was: SPARK-21187) Issue Type: Improvement (was: Sub-task) > Add PySpark su

[jira] [Comment Edited] (ARROW-3850) [Python] Support MapType and StructType for enhanced PySpark integration

2020-11-20 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236400#comment-17236400 ] Bryan Cutler edited comment on ARROW-3850 at 11/20/20, 7:47 PM: ---

[jira] [Resolved] (ARROW-3850) [Python] Support MapType and StructType for enhanced PySpark integration

2020-11-20 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-3850. - Resolution: Fixed MapType has been added to PySpark, I think we can close this now. > [Python] S

[jira] [Resolved] (ARROW-9862) Throw an exception in UnsafeDirectLittleEndian on Big-Endian platform

2020-11-13 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-9862. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 8057 [https://github

[jira] [Created] (ARROW-10512) [Python] Arrow to Pandas conversion promotes child array to float for NULL values

2020-11-06 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-10512: Summary: [Python] Arrow to Pandas conversion promotes child array to float for NULL values Key: ARROW-10512 URL: https://issues.apache.org/jira/browse/ARROW-10512 Pro

[jira] [Created] (ARROW-10512) [Python] Arrow to Pandas conversion promotes child array to float for NULL values

2020-11-06 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-10512: Summary: [Python] Arrow to Pandas conversion promotes child array to float for NULL values Key: ARROW-10512 URL: https://issues.apache.org/jira/browse/ARROW-10512 Pro

[jira] [Resolved] (ARROW-9861) [Java] Failed Arrow Vector on big-endian platform

2020-11-04 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-9861. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 8056 [https://github

[jira] [Resolved] (ARROW-10478) [Dev][Release] Correct Java versions to 3.0.0-SNAPSHOT

2020-11-03 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-10478. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 8577 [https://git

[jira] [Resolved] (ARROW-9709) [Java] Test cases in arrow-vector assume little-endian platform

2020-11-02 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved ARROW-9709. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 7944 [https://github

[jira] [Updated] (ARROW-9709) [Java] Test cases in arrow-vector assume little-endian platform

2020-11-02 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-9709: Component/s: Java > [Java] Test cases in arrow-vector assume little-endian platform > -

[jira] [Comment Edited] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

2020-11-01 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224420#comment-17224420 ] Bryan Cutler edited comment on SPARK-33279 at 11/2/20, 5:21 AM: --

[jira] [Created] (ARROW-10457) [CI] Fix Spark branch-3.0 integration tests

2020-11-01 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-10457: Summary: [CI] Fix Spark branch-3.0 integration tests Key: ARROW-10457 URL: https://issues.apache.org/jira/browse/ARROW-10457 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-10457) [CI] Fix Spark branch-3.0 integration tests

2020-11-01 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-10457: Summary: [CI] Fix Spark branch-3.0 integration tests Key: ARROW-10457 URL: https://issues.apache.org/jira/browse/ARROW-10457 Project: Apache Arrow Issue Type

[jira] [Commented] (SPARK-33279) Spark 3.0 failure due to lack of Arrow dependency

2020-11-01 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224420#comment-17224420 ] Bryan Cutler commented on SPARK-33279: -- [~fan_li_ya] we should change the Arrow-Spa

[jira] [Commented] (ARROW-1614) [C++] Add a Tensor logical value type with constant shape, implemented using ExtensionType

2020-10-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223839#comment-17223839 ] Bryan Cutler commented on ARROW-1614: - Great, [~rokm] , looking forward to it. I also

[jira] [Updated] (ARROW-1614) [C++] Add a Tensor logical value type with constant shape, implemented using ExtensionType

2020-10-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-1614: Description: In an Arrow table, we would like to add support for a column that has values cells eac

[jira] [Updated] (ARROW-1614) [C++] Add a Tensor logical value type with constant shape, implemented using ExtensionType

2020-10-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated ARROW-1614: Summary: [C++] Add a Tensor logical value type with constant shape, implemented using ExtensionType

[jira] [Commented] (ARROW-8714) [C++] Add a Tensor logical value type with varying dimensions, implemented using ExtensionType

2020-10-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223832#comment-17223832 ] Bryan Cutler commented on ARROW-8714: - Sorry, I mistyped dimension when I meant shape

[jira] [Comment Edited] (ARROW-8714) [C++] Add a Tensor logical value type with varying dimensions, implemented using ExtensionType

2020-10-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222490#comment-17222490 ] Bryan Cutler edited comment on ARROW-8714 at 10/30/20, 6:19 PM: ---

[jira] [Comment Edited] (ARROW-8714) [C++] Add a Tensor logical value type with varying dimensions, implemented using ExtensionType

2020-10-30 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222490#comment-17222490 ] Bryan Cutler edited comment on ARROW-8714 at 10/30/20, 6:13 PM: ---

[jira] [Comment Edited] (ARROW-1614) [C++] Add a Tensor logical value type with constant dimensions, implemented using ExtensionType

2020-10-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222496#comment-17222496 ] Bryan Cutler edited comment on ARROW-1614 at 10/28/20, 9:29 PM: ---

[jira] [Commented] (ARROW-1614) [C++] Add a Tensor logical value type with constant dimensions, implemented using ExtensionType

2020-10-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222496#comment-17222496 ] Bryan Cutler commented on ARROW-1614: - [~rokm] I had an idea for making a single exte

[jira] [Commented] (ARROW-8714) [C++] Add a Tensor logical value type with varying dimensions, implemented using ExtensionType

2020-10-28 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222490#comment-17222490 ] Bryan Cutler commented on ARROW-8714: - +1 on the proposal of having a list array for

  1   2   3   4   5   6   7   8   9   10   >