Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19631
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user akopich commented on the issue:
https://github.com/apache/spark/pull/19565
@WeichenXu123, in a case of large dataset this "adjustment" would have
infinitesimal effect. (IMO, no adjustment is needed -- the expected number of
non-empty docs in the same and does not depend
GitHub user animenon opened a pull request:
https://github.com/apache/spark/pull/19632
Added description
## What changes were proposed in this pull request?
Description added to better understand example.
## How was this patch tested?
Not required as only
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19623
**[Test build #83300 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83300/testReport)**
for PR 19623 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19633
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19635
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/19635
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19631
**[Test build #83299 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83299/testReport)**
for PR 19631 at commit
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/19624
Maybe but it will say
Version mismatch between Spark JVM and SparkR package. JVM version was
2.3.0-SNAPSHOT, while R package version was 2.1.2
I think it will be clear the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19208
**[Test build #3972 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3972/testReport)**
for PR 19208 at commit
Github user vgankidi commented on the issue:
https://github.com/apache/spark/pull/19633
ping @davies
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user vgankidi opened a pull request:
https://github.com/apache/spark/pull/19634
[SPARK-22412][SQL] Fix incorrect comment in DataSourceScanExec
## What changes were proposed in this pull request?
Next fit decreasing bin packing algorithm is used to combine splits in
Github user CodingCat commented on the issue:
https://github.com/apache/spark/pull/16578
made a simple test in a single-node spark environment
I used a synthetic dataset which is generated as: (thatâs 20M)
```scala
import spark.implicits._
import
GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/19635
[SPARK-22413][SQL] Type coercion for IN is not coherent between Literals
and subquery
## What changes were proposed in this pull request?
Now, type coercion for IN is not coherent
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19635
**[Test build #83304 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83304/testReport)**
for PR 19635 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19631
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19629
**[Test build #3971 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3971/testReport)**
for PR 19629 at commit
Github user akopich commented on the issue:
https://github.com/apache/spark/pull/19565
Okay... any idea why tests failed? It says
```ERROR: Step ?Publish JUnit test result report? failed: No test report
files were found. Configuration error?```
---
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/19208
taking a look...
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19631
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19631
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83302/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19439
**[Test build #83303 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83303/testReport)**
for PR 19439 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19632
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19631
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/19636
[SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `sql/core`
## What changes were proposed in this pull request?
According to the
GitHub user vgankidi opened a pull request:
https://github.com/apache/spark/pull/19633
[SPARK-22411][SQL] Disable the heuristic to calculate max partition size
when dynamic allocation is enabled and use the value specified by the property
spark.sql.files.maxPartitionBytes instead
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/19632#discussion_r148370955
--- Diff: examples/src/main/python/pi.py ---
@@ -27,12 +27,16 @@
if __name__ == "__main__":
"""
Usage: pi [partitions]
+
Github user vgankidi commented on the issue:
https://github.com/apache/spark/pull/19633
How about using spark.dynamicAllocation.maxExecutors for calculating
bytesPerCore when dynamic allocation is enabled?
---
-
To
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19634
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/19635
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/19635
@mgaido91 Can you update the PR and describe there what you exactly changed?
---
-
To unsubscribe, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/19582
@squito
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19439
**[Test build #83303 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83303/testReport)**
for PR 19439 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19439
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19468
**[Test build #83309 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83309/testReport)**
for PR 19468 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19636#discussion_r148420534
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcOptions.scala
---
@@ -27,7 +27,7 @@ import
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/19636
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dakirsa commented on a diff in the pull request:
https://github.com/apache/spark/pull/19439#discussion_r148404466
--- Diff: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala
---
@@ -0,0 +1,236 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19628
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19208
**[Test build #3972 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3972/testReport)**
for PR 19208 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19433
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83310/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19433
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19629
**[Test build #3971 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3971/testReport)**
for PR 19629 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19635
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83304/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19635
**[Test build #83304 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83304/testReport)**
for PR 19635 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19635
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19439
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83303/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19628
**[Test build #83311 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83311/testReport)**
for PR 19628 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19628
**[Test build #83312 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83312/testReport)**
for PR 19628 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19636#discussion_r148423575
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcOptions.scala
---
@@ -27,7 +27,7 @@ import
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19623
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83300/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19623
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/19459
I made [SPARK-22417](https://issues.apache.org/jira/browse/SPARK-22417) for
fixing reading from timestamps without arrow
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19625
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16578
Thanks @CodingCat
+1 on config switch. I think that would be a good idea.
---
-
To unsubscribe, e-mail:
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/19439
Quick comment: I see that data are being added under
mllib/src/test/resources/ That appears to be a new directory, created
recently. The standard directory is
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/18538
@yanboliang @mgaido91 I just saw this PR. It creates a new test data
directory. Could you please send a quite update to move the data to the
existing data directory:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19439
@jkbradley, BTW, mind checking the API structure please? I reviewed this to
be consistent with other components and codes at my best but, to be honest, my
ML knowledge and familiarity are
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19637
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19636
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19636
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83307/
Test FAILed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19439#discussion_r148405401
--- Diff: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala
---
@@ -0,0 +1,236 @@
+/*
+ * Licensed to the Apache Software
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19628
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19628
**[Test build #83311 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83311/testReport)**
for PR 19628 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19628
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83311/
Test PASSed.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19628
BTW, the test was passed for 5e1bbf0. It triggered again against the same
commit after adding it to whitelist somehow.
---
Github user pralabhkumar commented on the issue:
https://github.com/apache/spark/pull/18118
@sethah please find some time to look into the changes .
Please let me know if further changes are required.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19636
**[Test build #83306 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83306/testReport)**
for PR 19636 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19636
**[Test build #83308 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83308/testReport)**
for PR 19636 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19623
**[Test build #83300 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83300/testReport)**
for PR 19623 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19628
add to whitelist
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/19628
Merged to mater, branch-2.2 and branch-2.1.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19628
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user ChenjunZou commented on the issue:
https://github.com/apache/spark/pull/19637
add spark.yarn.jars to the checkpoint reload configs.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
GitHub user ChenjunZou opened a pull request:
https://github.com/apache/spark/pull/19637
[SPARK-22243][DStream]spark.yarn.jars should reload from config when
checkpoint recovery
the previous pr branch is deleted by mistake
You can merge this pull request into a Git repository by
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/19637
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/19527#discussion_r148193102
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/feature/OneHotEncoderEstimator.scala
---
@@ -0,0 +1,456 @@
+/*
+ * Licensed to the Apache
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/19624#discussion_r148192869
--- Diff: R/pkg/R/sparkR.R ---
@@ -420,6 +420,18 @@ sparkR.session <- function(
enableHiveSupport)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19607
**[Test build #83286 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83286/testReport)**
for PR 19607 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19618
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83281/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18805
**[Test build #83282 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83282/testReport)**
for PR 18805 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19618
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
cc @gatorsmile @dongjoon-hyun
Is it ok now?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19622
**[Test build #83287 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83287/testReport)**
for PR 19622 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19607
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zengxy commented on the issue:
https://github.com/apache/spark/pull/16722
@sethah Hi thanks for your working on it and would you have any plan to
make it on 2.3 ?
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19607
**[Test build #83280 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83280/testReport)**
for PR 19607 at commit
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19396
OK, let me merge to master branch.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user ConeyLiu commented on the issue:
https://github.com/apache/spark/pull/19586
Currently, I use it directly. Maybe this is suitable for some special case
which has same type data, such as ml or else.
---
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/19623#discussion_r148227459
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/DataReader.java
---
@@ -34,11 +34,17 @@
/**
* Proceed
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19396
we should update PR description too, but it's too late now...
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19618
**[Test build #83281 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83281/testReport)**
for PR 19618 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19618
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19618
Merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/19396
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19586
For these cases, they can write their own serializer and set it via
`spark.serializer`. I don't think Spark should have built-in support for them
because it's not general.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/19583
instead of piggybacking the heartbeat, can we just let the driver send an
event to all executors asynchronously about the node failure?
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19479
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83285/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19479
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19622#discussion_r148219682
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala ---
@@ -295,7 +297,7 @@ private[spark] class
1 - 100 of 279 matches
Mail list logo
