Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18468
`ArrowColumnVector` is also a wrapper for arrow vector, and it doesn't
introduce vector type stuff.
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/18468
@cloud-fan Thank you for your comments. Based on [this
discussion](https://github.com/apache/spark/pull/18468#discussion_r125395003),
I introduced `VectorType`.
I have just seen @ueshin 's
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18487#discussion_r127885748
--- Diff:
core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala
---
@@ -277,11 +290,13 @@ final class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18654
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79694/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18654
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18654
**[Test build #79694 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79694/testReport)**
for PR 18654 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18649
cc @jerryshao
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18468
I think this PR doesn't have a good abstraction of the problem. For table
cache, our goal is not making the comressed data a `ColumnVector`, but having
an efficient way to convert the compressed
Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/18634
@cloud-fan @jiangxb1987
Thanks for help! I will refine and post the result of manual test late
today :)
---
If your project is set up for it, you can reply to this email and have your
reply
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18634#discussion_r127882623
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/SQLWindowFunctionSuite.scala
---
@@ -356,6 +356,42 @@ class SQLWindowFunctionSuite
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18634
@jinxing64 I think this patch is straightforward, can you do a manual test,
which OOM before and works after this PR? We can put the test in PR description
so that other people can try it out.
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18634#discussion_r127882430
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/SQLWindowFunctionSuite.scala
---
@@ -356,6 +356,42 @@ class SQLWindowFunctionSuite
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18634#discussion_r127882358
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/SQLWindowFunctionSuite.scala
---
@@ -356,6 +356,42 @@ class SQLWindowFunctionSuite
Github user debugger87 commented on the issue:
https://github.com/apache/spark/pull/18649
@cloud-fan Any suggestions?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/18655
Thank you for your comments.
I agree that we should split this into smaller PRs. I'll push another
commit to remove `ArrowColumnVector` from this as soon as possible.
---
If your project is set
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/18468
ping @ueshin @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18655
yea let's put `ArrowColumnVector` and its tests in a new PR and merge that
first.
`ArrowWriter` will also be used for pandas UDF, see
https://issues.apache.org/jira/browse/SPARK-21190
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/18660
Also merged to branch-2.2
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/18660
thanks @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18667
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user fxbonnet opened a pull request:
https://github.com/apache/spark/pull/18667
Fix the simpleString used in error messages
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r127879502
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/arrow/ArrowConvertersSuite.scala
---
@@ -792,6 +793,76 @@ class ArrowConvertersSuite
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18660
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18660
thanks, merging to master!
@brkyvz I think it's fine, this bug is very obvious.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/18660
I couldn't write an easy reproduction for the bug :(
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18583
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18583
Thanks! Merging to master/2.2/2.1/2.0
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127876852
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ * Licensed
Github user JoshRosen commented on the issue:
https://github.com/apache/spark/pull/18662
Merged to master. Thanks for the quick reviews.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18662
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18652#discussion_r127875986
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -1912,6 +1913,26 @@ class Analyzer(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18666
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user yaooqinn opened a pull request:
https://github.com/apache/spark/pull/18666
[SPARK-21449][SQL][Hive]Close HiveClient's SessionState to delete residual
dirs
## What changes were proposed in this pull request?
When sparkSession.stop() is called, close the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18663
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18663
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79692/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18663
**[Test build #79692 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79692/testReport)**
for PR 18663 at commit
Github user facaiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/18305#discussion_r127874833
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/optim/loss/DifferentiableRegularization.scala
---
@@ -32,40 +34,45 @@ private[ml] trait
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18665
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user DFFuture opened a pull request:
https://github.com/apache/spark/pull/18665
[SPARK-21446] [SQL] Fix setAutoCommit never executed
## What changes were proposed in this pull request?
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-21446
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18652#discussion_r127874260
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -1912,6 +1913,26 @@ class Analyzer(
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18652#discussion_r127874213
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -1912,6 +1913,26 @@ class Analyzer(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18662
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79691/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18662
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18662
**[Test build #79691 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79691/testReport)**
for PR 18662 at commit
Github user facaiy commented on a diff in the pull request:
https://github.com/apache/spark/pull/18305#discussion_r127873828
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala
---
@@ -598,8 +598,23 @@ class LogisticRegression
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18654
**[Test build #79694 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79694/testReport)**
for PR 18654 at commit
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127872988
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ *
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18660
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18660
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79689/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18660
**[Test build #79689 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79689/testReport)**
for PR 18660 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18664
**[Test build #79693 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79693/testReport)**
for PR 18664 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18664
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18664
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79693/
Test FAILed.
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18661
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/18661
Merging to master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127869754
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18661
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79690/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18661
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18661
**[Test build #79690 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79690/testReport)**
for PR 18661 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18654
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79687/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127868378
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18654
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18654
**[Test build #79687 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79687/testReport)**
for PR 18654 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18631
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18631
thanks, merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127867549
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127867486
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127867380
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127867341
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127867290
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala
---
@@ -236,7 +236,10 @@ object FileFormatWriter
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127867254
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileFormatWriter.scala
---
@@ -236,7 +236,10 @@ object FileFormatWriter
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/18632#discussion_r127866899
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java
---
@@ -51,6 +51,7 @@ public
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18633
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79684/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18633
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18632
OK to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18633
**[Test build #79684 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79684/testReport)**
for PR 18633 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r127866465
--- Diff:
sql/core/src/test/java/test/org/apache/spark/sql/JavaUDFSuite.java ---
@@ -121,4 +122,29 @@ public void udf6Test() {
Row result =
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r127866406
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala
---
@@ -103,4 +110,19 @@ case class UserDefinedFunction
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/17848#discussion_r127866355
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/SQLContextSuite.scala ---
@@ -69,7 +69,7 @@ class SQLContextSuite extends SparkFunSuite with
Github user gczsjdy commented on the issue:
https://github.com/apache/spark/pull/18632
@cloud-fan @viirya @gatorsmile Could you please help me review this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127865091
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ *
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/18654
Yep, empty result dir need this meta, otherwise will throw the exception:
```
org.apache.spark.sql.AnalysisException: Unable to infer schema for Parquet.
It must be specified manually.;
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r127864419
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/arrow/ArrowConvertersSuite.scala
---
@@ -792,6 +793,76 @@ class ArrowConvertersSuite
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18654
schema and the footer in case of Parquet. There is more context here -
https://github.com/apache/spark/pull/17395#discussion_r107611325.
For example, if we don't write out the empty
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18627
thanks, merging to 2.1!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18657
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18657
LGTM, merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18654
> leaving the first partition for meta writing
What is the meta we need to write?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/18664#discussion_r127861741
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/arrow/ArrowConvertersSuite.scala
---
@@ -792,6 +793,76 @@ class ArrowConvertersSuite
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18664
**[Test build #79693 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79693/testReport)**
for PR 18664 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18658
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18658
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79683/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18658
**[Test build #79683 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79683/testReport)**
for PR 18658 at commit
GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/18664
[SPARK-21375][PYSPARK][SQL][WIP] Add Date and Timestamp support to
ArrowConverters for toPandas() Conversion
## What changes were proposed in this pull request?
WIP started with
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16630
**[Test build #79688 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79688/testReport)**
for PR 16630 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16630
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16630
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79688/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18654#discussion_r127860788
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileFormatWriterSuite.scala
---
@@ -0,0 +1,52 @@
+/*
+ * Licensed
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16630
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79686/
Test PASSed.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/18660
good catch! LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
1 - 100 of 389 matches
Mail list logo
