Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21357
**[Test build #93278 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93278/testReport)**
for PR 21357 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203665364
--- Diff:
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala
---
@@ -766,6 +774,14 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21733
**[Test build #93277 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93277/testReport)**
for PR 21733 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21789#discussion_r203664631
--- Diff:
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/Column.java ---
@@ -349,7 +349,7 @@ public void addValue(Type type, Object
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21803
> Does the alternative code I posted above work in that case?
> You can use struct.map(field => s"${quoteIdentifier(field.name)}
${field.dataType.sql}").mkString(",") in the application code
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21804
**[Test build #93276 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93276/testReport)**
for PR 21804 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21804
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21804
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21804#discussion_r203656238
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/types/AbstractDataType.scala
---
@@ -145,7 +145,7 @@ abstract class NumericType extends
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21803
Does the alternative code I posted above work in that case? If so, sounds
we are adding an API just for consistency
---
-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21814
**[Test build #93275 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93275/testReport)**
for PR 21814 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21803
> is the purpose of this API is to have a int instead of struct
Basically, yes. All those methods `simpleString()`, `catalogString()`,
`sql()` return `struct< ... : ...>` which is
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21816
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21816
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21816
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user bsikander opened a pull request:
https://github.com/apache/spark/pull/21816
[SPARK-24794][CORE] Driver launched through rest should use all masters
## What changes were proposed in this pull request?
In standalone cluster mode, one could launch driver with
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21584
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1123/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21803
We should reduce APIs exposed .. there are already a hell of a lot..
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21584
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1123/
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21814#discussion_r203638620
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -384,12 +385,10 @@ class
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21814#discussion_r203638199
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -384,12 +385,10 @@ class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93273/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93272/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21584
**[Test build #93274 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93274/testReport)**
for PR 21584 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21584
**[Test build #93273 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93273/testReport)**
for PR 21584 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21103
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21584
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21103
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21815
**[Test build #93271 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93271/testReport)**
for PR 21815 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21584
**[Test build #93272 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93272/testReport)**
for PR 21584 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21103
**[Test build #93270 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93270/testReport)**
for PR 21103 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21815
**[Test build #93269 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93269/testReport)**
for PR 21815 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21815
@cloud-fan and @mgaido91, mind if I ask to take a look please?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21815
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/21815
[SPARK-23731][SQL] Make FileSourceScanExec canonicalizable in executor side
## What changes were proposed in this pull request?
### What's problem?
In some cases, sub scalar
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21754#discussion_r203630277
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/Exchange.scala
---
@@ -85,14 +85,20 @@ case class ReusedExchangeExec(override
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/21782
Teradata has `PARTITION BY RANGE_N` option in CREATE TABLE SQL statement.
But SELECT SQL statement not seen in other systems.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21802
**[Test build #93268 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93268/testReport)**
for PR 21802 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21802
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21802
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21802
Jenkins, retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21772
**[Test build #93267 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93267/testReport)**
for PR 21772 at commit
Github user liutang123 commented on the issue:
https://github.com/apache/spark/pull/21772
@viirya Yes, absolutely right. :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21774#discussion_r203625426
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/package.scala ---
@@ -36,4 +40,27 @@ package object avro {
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21782#discussion_r203623597
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/FilterPushdownBenchmark.scala
---
@@ -394,6 +394,41 @@ class
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21782
This is a PR to add a new SQL syntax for partitionByRange, which already
have a DataFrame version. We should focus on the API itself instead of
performance. Is there a similar syntax for
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21700
My pleasure. Thanks for spending your time to review thoughtfully and merge
this!
---
-
To unsubscribe, e-mail:
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21814#discussion_r203622451
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -384,12 +385,10 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21813
**[Test build #93266 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93266/testReport)**
for PR 21813 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21813
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21814
**[Test build #93265 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93265/testReport)**
for PR 21814 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21813
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/21814#discussion_r203621872
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -384,12 +385,10 @@ class
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21732#discussion_r203621857
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala ---
@@ -183,6 +184,43 @@ case class OptionBooleanAggregator(colName:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21700
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203621395
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ---
@@ -1055,6 +1055,64 @@ class DAGSchedulerSuite extends SparkFunSuite
Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/21814#discussion_r203621554
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -384,12 +385,10 @@ class
Github user dilipbiswal commented on the issue:
https://github.com/apache/spark/pull/21813
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203621244
--- Diff: core/src/test/scala/org/apache/spark/SparkContextSuite.scala ---
@@ -627,6 +627,48 @@ class SparkContextSuite extends SparkFunSuite with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21814
**[Test build #93264 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93264/testReport)**
for PR 21814 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203620942
--- Diff: core/src/main/scala/org/apache/spark/scheduler/WorkerOffer.scala
---
@@ -21,4 +21,10 @@ package org.apache.spark.scheduler
* Represents
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203620642
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -274,7 +274,9 @@ private[spark] class TaskSchedulerImpl(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93263/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21813
**[Test build #93260 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93260/testReport)**
for PR 21813 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21608
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21802
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93261/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21608
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93262/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21813
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21802
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21608
**[Test build #93262 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93262/testReport)**
for PR 21608 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21813
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93260/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21814
**[Test build #93263 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93263/testReport)**
for PR 21814 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21802
**[Test build #93261 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93261/testReport)**
for PR 21802 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203619822
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -346,6 +354,7 @@ private[spark] class TaskSchedulerImpl(
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203619611
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala ---
@@ -50,6 +50,7 @@ private[spark] class TaskDescription(
val
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/21700
LGTM! I am merging it! Thank you for all the hard work. And my apologies
for not being able to give it time earlier to review it.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r203619016
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1386,29 +1418,90 @@ class DAGScheduler(
)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21814
**[Test build #93263 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93263/testReport)**
for PR 21814 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21803#discussion_r203618974
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala ---
@@ -436,6 +436,14 @@ object StructType extends AbstractDataType {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21814
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/21533
@jiangxb1987 Thanks for reminding, rephrase done.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21803
> (As I described in the jira) What's this func is used for?
@maropu I answered in JIRA, please, look at it.
---
-
To
401 - 500 of 524 matches
Mail list logo
