Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16282
**[Test build #70443 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70443/testReport)**
for PR 16282 at commit
[`13b7d43`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16282
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70443/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16282
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16296
**[Test build #70447 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70447/testReport)**
for PR 16296 at commit
[`7b5f226`](https://github.com/apache/spark/commit/7b
Github user bravo-zhang commented on the issue:
https://github.com/apache/spark/pull/16365
Thanks for the review @HyukjinKwon !
Are your stacktrace of Before and After swapped?
Do you mean the message is confusing? How about correcting it to `Failed to
merge field longcol: inc
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16361
**[Test build #70433 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70433/testReport)**
for PR 16361 at commit
[`c2de5ee`](https://github.com/apache/spark/commit/c
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16361
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70433/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16361
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/16304#discussion_r93364798
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala
---
@@ -387,7 +387,7 @@ class StreamExecution(
la
GitHub user felixcheung opened a pull request:
https://github.com/apache/spark/pull/16367
[SPARK-18903][SPARKR] Add API to get SparkUI URL
## What changes were proposed in this pull request?
API for SparkUI URL from SparkContext
## How was this patch tested?
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16367
**[Test build #70448 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70448/testReport)**
for PR 16367 at commit
[`027528f`](https://github.com/apache/spark/commit/02
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16304
**[Test build #70449 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70449/testReport)**
for PR 16304 at commit
[`29f0037`](https://github.com/apache/spark/commit/29
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16253
**[Test build #70436 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70436/testReport)**
for PR 16253 at commit
[`a6b1bb9`](https://github.com/apache/spark/commit/a
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16253
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16253
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70436/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16363
**[Test build #70437 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70437/testReport)**
for PR 16363 at commit
[`b05d768`](https://github.com/apache/spark/commit/b
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16363
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16363
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70437/
Test PASSed.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16365
Dho, yeap, I just edited. I just simply meant I support this PR :).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your projec
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16330
**[Test build #70435 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70435/testReport)**
for PR 16330 at commit
[`0ce9905`](https://github.com/apache/spark/commit/0
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16330
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70435/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16330
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16360
**[Test build #70450 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70450/testReport)**
for PR 16360 at commit
[`628c6c2`](https://github.com/apache/spark/commit/62
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16360
**[Test build #70441 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70441/testReport)**
for PR 16360 at commit
[`8887340`](https://github.com/apache/spark/commit/8
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16360
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70441/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16360
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16367
**[Test build #70448 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70448/testReport)**
for PR 16367 at commit
[`027528f`](https://github.com/apache/spark/commit/0
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16367
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16367
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70448/
Test PASSed.
---
GitHub user felixcheung opened a pull request:
https://github.com/apache/spark/pull/16368
[SPARK-18958][SPARKR] R API toJSON on DataFrame
## What changes were proposed in this pull request?
It would make it easier to integrate with other component expecting JSON
format.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16368
**[Test build #70451 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70451/testReport)**
for PR 16368 at commit
[`e2031ea`](https://github.com/apache/spark/commit/e2
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/16314
Merging this master and 2.1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16314
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/16343
Why didnt `eventually` and assert on the size of the collected data work?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/16362
LGTM. Did you run it many times?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and w
Github user ericl commented on the issue:
https://github.com/apache/spark/pull/16350
yeah, i don't think we need the unit test for 2.0
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fea
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16366
**[Test build #70442 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70442/testReport)**
for PR 16366 at commit
[`4e5d5f2`](https://github.com/apache/spark/commit/4
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16366
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70442/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16366
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/16323#discussion_r93370436
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
---
@@ -198,6 +200,10 @@ case class CatalogTable(
loca
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16368
**[Test build #70451 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70451/testReport)**
for PR 16368 at commit
[`e2031ea`](https://github.com/apache/spark/commit/e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16368
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70451/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16368
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/15018
@neggert I am fine for throwing an error.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
en
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16282
**[Test build #70439 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70439/testReport)**
for PR 16282 at commit
[`7c789e8`](https://github.com/apache/spark/commit/7
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16282
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16282
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70439/
Test FAILed.
---
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16366
One question: should we do the same thing for `WorkerState.DECOMMISSIONED`
and `WorkerState.UNKNOWN` ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16350
**[Test build #70452 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70452/consoleFull)**
for PR 16350 at commit
[`8dd0169`](https://github.com/apache/spark/commit/8
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/16366
We also show worker info in `driverRow`. Although it doesn't show worker
state, I am wondering if we can also check worker state, and disable the link
and add a suffix like `(DEAD)` if a worker is de
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/16350
Delete the UT and metrics done. :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16352
**[Test build #70446 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70446/testReport)**
for PR 16352 at commit
[`1f69b38`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16352
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16352
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70446/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16359
**[Test build #70445 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70445/testReport)**
for PR 16359 at commit
[`c502aeb`](https://github.com/apache/spark/commit/c
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16359
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70445/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16359
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/16369
[SPARK-18956][SQL][PySpark] Reuse existing SparkSession while creating new
SQLContext instances
## What changes were proposed in this pull request?
To reuse existing SparkSession while crea
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16369
**[Test build #70453 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70453/testReport)**
for PR 16369 at commit
[`651ce53`](https://github.com/apache/spark/commit/65
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16296
**[Test build #70447 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70447/testReport)**
for PR 16296 at commit
[`7b5f226`](https://github.com/apache/spark/commit/7
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16296
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16296
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70447/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16356
**[Test build #3511 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3511/testReport)**
for PR 16356 at commit
[`451ab05`](https://github.com/apache/spark/commit/4
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16304
**[Test build #70449 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70449/testReport)**
for PR 16304 at commit
[`29f0037`](https://github.com/apache/spark/commit/2
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16304
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16304
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70449/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15212
**[Test build #70454 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70454/testReport)**
for PR 15212 at commit
[`83a429e`](https://github.com/apache/spark/commit/83
Github user wzhfy commented on a diff in the pull request:
https://github.com/apache/spark/pull/16323#discussion_r93376249
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
---
@@ -198,6 +200,10 @@ case class CatalogTable(
locat
Github user wzhfy commented on the issue:
https://github.com/apache/spark/pull/16323
Since adding a switch for cbo is not a trivial one, I want to do it in a
separate pr, and let this one only deal with decoupling Statistics from
CatalogTable. Do you agree? @cloud-fan
---
If your p
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16369
**[Test build #70453 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70453/testReport)**
for PR 16369 at commit
[`651ce53`](https://github.com/apache/spark/commit/6
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16369
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16369
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70453/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16360
**[Test build #70450 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70450/testReport)**
for PR 16360 at commit
[`628c6c2`](https://github.com/apache/spark/commit/6
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16360
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16360
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70450/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16350
**[Test build #70452 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70452/consoleFull)**
for PR 16350 at commit
[`8dd0169`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16350
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16282
**[Test build #70444 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70444/testReport)**
for PR 16282 at commit
[`9080acd`](https://github.com/apache/spark/commit/9
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16350
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70452/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16282
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70444/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16282
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15996
**[Test build #70455 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70455/testReport)**
for PR 15996 at commit
[`7481150`](https://github.com/apache/spark/commit/74
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/16323
SGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the fea
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15212
**[Test build #70454 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70454/testReport)**
for PR 15212 at commit
[`83a429e`](https://github.com/apache/spark/commit/8
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15212
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70454/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15212
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user lirui-intel commented on the issue:
https://github.com/apache/spark/pull/12775
I don't think the failure is related, and it can't be reproduced locally.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/16240
How about we assign priority to implicit rules like
http://stackoverflow.com/questions/1886953/is-there-a-way-to-control-which-implicit-conversion-will-be-the-default-used
?
I think we sh
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16351#discussion_r93381049
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala
---
@@ -215,84 +215,133 @@ private[csv] object CSVIn
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16351#discussion_r93381128
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala
---
@@ -215,84 +215,133 @@ private[csv] object CSVIn
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/16351
mostly LGTM, do you have some performance numbers about this optimization?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your p
GitHub user uncleGen opened a pull request:
https://github.com/apache/spark/pull/16370
[SPARK-18960][SQL][SS] Avoid double reading file which is being copied.
## What changes were proposed in this pull request?
In HDFS, when we copy a file into target directory, there will a
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/16370
cc @zsxwing
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user wangmiao1981 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16367#discussion_r93381426
--- Diff: R/pkg/R/sparkR.R ---
@@ -410,6 +410,30 @@ sparkR.session <- function(
sparkSession
}
+#' Get the URL of the SparkUI insta
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16370
**[Test build #70456 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70456/testReport)**
for PR 16370 at commit
[`1d248c3`](https://github.com/apache/spark/commit/1d
Github user wangmiao1981 commented on the issue:
https://github.com/apache/spark/pull/16355
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user wangmiao1981 commented on the issue:
https://github.com/apache/spark/pull/16355
@imatiach-msft Can you add a test case?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this featur
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16337
**[Test build #70457 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70457/testReport)**
for PR 16337 at commit
[`9c584fb`](https://github.com/apache/spark/commit/9c
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16367#discussion_r93384251
--- Diff: R/pkg/R/sparkR.R ---
@@ -410,6 +410,30 @@ sparkR.session <- function(
sparkSession
}
+#' Get the URL of the SparkUI instan
Github user kevinyu98 commented on the issue:
https://github.com/apache/spark/pull/16337
Hello All:
I have divided the test case to small groups based the discussion, and this
pr will be the first pr for the IN subquery, it covers the simple and group-by
cases.
This the
301 - 400 of 429 matches
Mail list logo
