[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/19284 Thanks @ueshin ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19284 Thanks! merging to master. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19284 LGTM. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19284 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19284 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81952/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19284 **[Test build #81952 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81952/testReport)** for PR 19284 at commit [`5ac572d`](https://github.com/apache/spark/commit/5ac572d3cb2422f57e101fa2cbc761f4b748daa6). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/19284 Ooops, I reference the wrong JIRA, it was ARROW-1443 PR: https://github.com/apache/arrow/pull/1022 ArrowBuf.setBytes was not using the destination buffer properly --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/19284 LGTM. What's the Arrow bug you mentioned? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/19284 @ueshin and @icexellos this came up while testing with Arrow 0.7.0. It seems that when Spark gets row data as a UTF8String ByteBuffer, the data can start at an offset which becomes the ByteBuffer position when this line is called https://github.com/apache/spark/blob/master/common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java#L171 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19284: [SPARK-22067][SQL] ArrowWriter should use position when ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19284 **[Test build #81952 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81952/testReport)** for PR 19284 at commit [`5ac572d`](https://github.com/apache/spark/commit/5ac572d3cb2422f57e101fa2cbc761f4b748daa6). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org