Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21837
**[Test build #93408 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93408/testReport)**
for PR 21837 at commit
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21699
> it's basically reverting Reynold's decision. is he okay with it?
As far as I know, yes. /cc @rxin
---
-
To
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21699
it's basically reverting Reynold's decision. is he okay with it?
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21837#discussion_r204243507
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -889,4 +889,30 @@ class AvroSuite extends QueryTest with
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17461
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/21840
Initial implementation of copy function
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
Github user MaxGekk closed the pull request at:
https://github.com/apache/spark/pull/21840
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user tengpeng commented on the issue:
https://github.com/apache/spark/pull/21123
Any updates on this PR? Yes, I know this is a temporary hack, but without
it being merged, it is not possible to migrate other data sources to V2
(experimentally).
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21839
**[Test build #93413 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93413/testReport)**
for PR 21839 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21839
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21839
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/21839
@gatorsmile @maropu This is the follow up PR for #21447, please have a look
when you have time, thanks.
---
-
To
GitHub user xuanyuanking opened a pull request:
https://github.com/apache/spark/pull/21839
[SPARK-24339][SQL] Prunes the unused columns from child of
ScriptTransformation
## What changes were proposed in this pull request?
Modify the strategy in ColumnPruning to add a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21758
**[Test build #93412 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93412/testReport)**
for PR 21758 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21758
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21758
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21821
shall we fix the non-idempotent analyzer rule for 2.3.2?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20861#discussion_r204242507
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
---
@@ -1994,6 +1996,20 @@ class Analyzer(
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21758
**[Test build #93411 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93411/testReport)**
for PR 21758 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21758
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21758
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/21447
I want to give a follow up PR and cc @gatorsmile @maropu for a review.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93403/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21822
**[Test build #93403 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93403/testReport)**
for PR 21822 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21837
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21837
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93405/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21837
**[Test build #93405 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93405/testReport)**
for PR 21837 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21838
**[Test build #93410 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93410/testReport)**
for PR 21838 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21838
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21838
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/21838
[SPARK-24811][SQL]Avro: add new function from_avro and to_avro
## What changes were proposed in this pull request?
1. Add a new function from_avro for parsing a binary column of avro
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21699
@gatorsmile The PR https://github.com/apache/spark/pull/21753 has been
merged already. Can we continue with this PR? @maryannxue I added the tests you
asked for in
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21775
**[Test build #93409 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93409/testReport)**
for PR 21775 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21837
**[Test build #93408 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93408/testReport)**
for PR 21837 at commit
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21837
jenkins, retest this, please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user sujith71955 commented on the issue:
https://github.com/apache/spark/pull/21775
@HyukjinKwon
seems to be a limitation as of now even from hive, better we can follow the
hive behavior unless the limitation has been resolved from hive.
>> Hive-2526 is the JIRA
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21775
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93407/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21775
**[Test build #93407 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93407/testReport)**
for PR 21775 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21775
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21775
**[Test build #93407 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93407/testReport)**
for PR 21775 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21775
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93406/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21775
**[Test build #93406 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93406/testReport)**
for PR 21775 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21775
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21775
**[Test build #93406 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93406/testReport)**
for PR 21775 at commit
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204236923
--- Diff: core/src/test/scala/org/apache/spark/rdd/RDDBarrierSuite.scala ---
@@ -0,0 +1,43 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204236759
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -359,20 +366,55 @@ private[spark] class TaskSchedulerImpl(
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204236692
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -359,20 +366,55 @@ private[spark] class TaskSchedulerImpl(
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204236526
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -359,20 +366,55 @@ private[spark] class TaskSchedulerImpl(
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204235875
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1426,6 +1506,18 @@ class DAGScheduler(
}
}
+
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204235813
--- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala
---
@@ -1411,6 +1420,77 @@ class DAGScheduler(
}
}
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21837
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21837
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93404/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21837
**[Test build #93404 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93404/testReport)**
for PR 21837 at commit
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21439#discussion_r204233840
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala
---
@@ -61,6 +61,7 @@ class JacksonParser(
dt match {
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21439
cc @mgaido91 sinceI found you are not cc'ed here.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21439
@HyukjinKwon I have a practical use case where I have json objects of any
types `struct`, `map` and `array of any types` in a column. I need the changes
to cover the use case fully.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21320
Seems few comments were not handled, for instance,
https://github.com/apache/spark/pull/21320#discussion_r203933307 and
https://github.com/apache/spark/pull/21320#discussion_r203931755
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21320
> What kind of examples would help?
For instance,
https://github.com/apache/spark/pull/21320#discussion_r204205744. I am a bit
confused which case it meant.
---
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/21439
> How does it relate to #19492?
In my PR, I supported arrays of ANY types.
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21439
How does it relate to https://github.com/apache/spark/pull/19492?
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21439#discussion_r204233568
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/JsonExpressionsSuite.scala
---
@@ -423,7 +423,9 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21837
**[Test build #93405 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93405/testReport)**
for PR 21837 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21837
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21837
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21837
**[Test build #93404 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93404/testReport)**
for PR 21837 at commit
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/21837
[SPARK-24881][SQL] New Avro options - compression and compressionLevel
## What changes were proposed in this pull request?
In the PR, I added new options for Avro datasource -
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21758#discussion_r204232986
--- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ---
@@ -434,6 +434,18 @@ private[spark] class MapOutputTrackerMaster(
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21822
**[Test build #93403 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93403/testReport)**
for PR 21822 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21822
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21822
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21439#discussion_r204232671
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala
---
@@ -61,6 +61,7 @@ class JacksonParser(
dt match
Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/21439#discussion_r204231723
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala
---
@@ -61,6 +61,7 @@ class JacksonParser(
dt match {
Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21439#discussion_r204231416
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JacksonParser.scala
---
@@ -61,6 +61,7 @@ class JacksonParser(
dt match
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/21584
@felixcheung the PRB isnât currently configured with capability to build
âr distributions. Waiting on @shaneknapp, which is why it is unable to build
the image. With an R supported
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/21584
looks like test failed
```
- Run SparkR on simple dataframe.R example *** FAILED ***
The code passed to eventually never returned normally. Attempted 70 times
over
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21584#discussion_r204229514
--- Diff: bin/docker-image-tool.sh ---
@@ -79,11 +80,16 @@ function build {
docker build $NOCACHEARG "${BINDING_BUILD_ARGS[@]}" \
-t
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21584#discussion_r204229713
--- Diff:
resource-managers/kubernetes/docker/src/main/dockerfiles/spark/bindings/R/Dockerfile
---
@@ -0,0 +1,29 @@
+#
+# Licensed to the
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21584#discussion_r204229663
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesDriverBuilder.scala
---
@@ -71,8 +75,9 @@
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21584#discussion_r204229518
--- Diff: bin/docker-image-tool.sh ---
@@ -79,11 +80,16 @@ function build {
docker build $NOCACHEARG "${BINDING_BUILD_ARGS[@]}" \
-t
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21835
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21835
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93402/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21835
**[Test build #93402 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93402/testReport)**
for PR 21835 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20350
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93401/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20350
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20350
**[Test build #93401 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93401/testReport)**
for PR 20350 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21764
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93400/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21764
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21764
**[Test build #93400 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93400/testReport)**
for PR 21764 at commit
201 - 290 of 290 matches
Mail list logo
