Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r208449418
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/AggregateInPandasExec.scala
---
@@ -137,13 +135,12 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22033
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22033
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94399/
Test PASSed.
---
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/21939
@shaneknapp I think we would be better off just upping the minimum version
of arrow to 0.10.0 here since it's pretty involved to get a test matrix up and
running and the project is still in a
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/22033
Thanks! merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22020
cc @ueshin @HyukjinKwon @srowen
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21984#discussion_r208138182
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -92,7 +92,7 @@ class AvroSerializer(rootCatalystType:
GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/22021
[SPARK-24948][SHS] Delegate check access permissions to the file system
## What changes were proposed in this pull request?
In `SparkHadoopUtil. checkAccessPermission`, we consider only
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22021
cc @jerryshao @mridulm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20611
**[Test build #94359 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94359/testReport)**
for PR 20611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21933
**[Test build #94358 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94358/testReport)**
for PR 21933 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22022
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22022
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21984
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22013#discussion_r208159784
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala
---
@@ -365,3 +365,69 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21986
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21986
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21986
**[Test build #94363 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94363/testReport)**
for PR 21986 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22004
I'd like to merge this as it resolves one class of issues the 2.12 build,
and I don't think the adjustments to Spark are wrong per se. It may be that
something else happens on the Scala side or
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21977
**[Test build #94386 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94386/testReport)**
for PR 21977 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22004
**[Test build #4235 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4235/testReport)**
for PR 22004 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r208317741
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala
---
@@ -270,11 +269,11 @@ private[kafka010]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r208325737
--- Diff: python/pyspark/worker.py ---
@@ -259,6 +260,26 @@ def main(infile, outfile):
"PYSPARK_DRIVER_PYTHON are
Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/21199
@HyukjinKwon this has been open for a while, would you mind taking this
forward?
---
-
To unsubscribe, e-mail:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/22030#discussion_r208326382
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/RelationalGroupedDataset.scala ---
@@ -403,20 +415,29 @@ class RelationalGroupedDataset
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/21977
Awesome, thanks for taking the time @rdblue to dig into that. Really
excited to get these limits in soon! (maybe this Friday during my weekly live
code review time if it happens to line up :)).
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r208334273
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/BatchReadSupportProvider.java
---
@@ -19,18 +19,18 @@
import
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r208336624
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/MicroBatchReadSupportProvider.java
---
@@ -20,23 +20,29 @@
import java.util.Optional;
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r208336499
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/DataSourceV2.java ---
@@ -23,8 +23,9 @@
* The base interface for data source v2.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22008
**[Test build #94378 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94378/testReport)**
for PR 22008 at commit
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r208342404
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/PartitionReaderFactory.java
---
@@ -0,0 +1,66 @@
+/*
+ * Licensed to the
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r208383579
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2ScanExec.scala
---
@@ -93,21 +81,17 @@ case class
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21733
@tdas
Done running perf. test with 4 more tests:
> BenchmarkMovingAggregationsListenerKeyMuchBigger
rate: 16
version | input rows per second | processed rows
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22019
Empty string should be treated as null for all non string types?
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21845
Ideally we should figure out which tests take abnormal long time and fix
them. But I'd like to increase the timeout first, if #21898 keeps hitting
timeout. #21898 is an important feature to Spark
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94333/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21845
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21845
I think we still intermediately meet this limit issue. For instance:
https://github.com/apache/spark/pull/22001#issuecomment-410809387
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21403
LGTM, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22019
> Empty string should be treated as null for all non string types?
I would exclude complex types.
---
-
To
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21980
thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21898
**[Test build #94333 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94333/testReport)**
for PR 21898 at commit
Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/21596
I've rebased, just to check if all the tests are still ok against latest
master.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19045
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21932
**[Test build #94348 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94348/testReport)**
for PR 21932 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21933
**[Test build #94346 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94346/testReport)**
for PR 21933 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #94343 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94343/testReport)**
for PR 21860 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21932
**[Test build #94348 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94348/testReport)**
for PR 21932 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21933
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94346/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94344/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21845
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21721#discussion_r208109148
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala
---
@@ -196,6 +237,18 @@ trait ProgressReporter
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #94347 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94347/testReport)**
for PR 21596 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21845
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r208120759
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -60,14 +61,26 @@ private[spark] object PythonEvalType {
*/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21845
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21845
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21927#discussion_r208123913
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1946,4 +1990,11 @@ private[spark] object DAGScheduler {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #94350 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94350/testReport)**
for PR 21596 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21305
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/17185
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21932
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21932
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vackosar commented on a diff in the pull request:
https://github.com/apache/spark/pull/21919#discussion_r208107058
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala
---
@@ -46,6 +46,9 @@ case class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22019
**[Test build #94342 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94342/testReport)**
for PR 22019 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21845
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20611
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21932
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94348/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17185
**[Test build #94335 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94335/testReport)**
for PR 17185 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94340/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21932
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21898
**[Test build #94344 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94344/testReport)**
for PR 21898 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17185
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94343/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21845
**[Test build #94345 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94345/testReport)**
for PR 21845 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21898
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94341/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20611
**[Test build #94334 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94334/testReport)**
for PR 20611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21845
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94345/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21305
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21933
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22019
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94342/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21305
**[Test build #94339 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94339/testReport)**
for PR 21305 at commit
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/21988
we always open against master and backport if agreed upon.
this is documented here https://spark.apache.org/contributing.html
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22019
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21898
**[Test build #94341 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94341/testReport)**
for PR 21898 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22009
**[Test build #94340 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94340/testReport)**
for PR 22009 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #94347 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94347/testReport)**
for PR 21596 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94347/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21305
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94339/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22009
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94334/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17185
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94335/
Test FAILed.
---
1 - 100 of 683 matches
Mail list logo
