Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22001
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94716/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22001
**[Test build #94716 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94716/testReport)**
for PR 22001 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22001
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22085#discussion_r209835246
--- Diff: python/pyspark/taskcontext.py ---
@@ -95,3 +95,92 @@ def getLocalProperty(self, key):
Get a local property set upstream in the
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22085#discussion_r209834646
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -180,7 +183,42 @@ private[spark] abstract class
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22085#discussion_r209833972
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -180,7 +183,42 @@ private[spark] abstract class
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/21146
And if you bump up the kinesis client and AWS SDK version to 1.11.271,
those failures go away.
```
Run completed in 15 minutes, 28 seconds.
Total number of tests run: 59
Github user tnachen commented on the issue:
https://github.com/apache/spark/pull/22071
LGTM as well
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21698
I took a quick look at the shuffle writer and feel it will be hard to
insert a sort there.
I have a simpler proposal for the fix. To trigger this bug, there must be a
shuffle before the
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22096
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/22085#discussion_r209830941
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -180,7 +183,42 @@ private[spark] abstract class BasePythonRunner[IN,
Github user ajacques commented on a diff in the pull request:
https://github.com/apache/spark/pull/21889#discussion_r209830673
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaPruning.scala
---
@@ -0,0 +1,200 @@
+/*
+ *
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/21146
FYI, I just did a kinesis test run with this PR on a JVM with the unlimited
JCE installed (explicitly verified by shasum of the relevant JARs); failure
with cert errors.
```
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21221
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94715/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21221
Build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21221
**[Test build #94715 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94715/testReport)**
for PR 21221 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20313
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/20313
LGTM. I think to have transformer framework working properly, it's required
to have attributes in `CountVector`. Being said that, we should deal with the
issue of allocating big attributes for
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19633
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22094
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22094
Merged into master. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/22094#discussion_r209826949
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -72,62 +73,70 @@ class AvroSerializer(rootCatalystType:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21819
**[Test build #94726 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94726/testReport)**
for PR 21819 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21819
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94726/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21819
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21939
great! looking forward to seeing arrow 0.10.0 come out.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22096
**[Test build #94727 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94727/testReport)**
for PR 22096 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22096
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94724/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22096
**[Test build #94724 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94724/testReport)**
for PR 22096 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22009#discussion_r209823382
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
---
@@ -76,41 +76,43 @@ object
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21977#discussion_r209823163
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -60,14 +61,20 @@ private[spark] object PythonEvalType {
*/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21819
**[Test build #94726 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94726/testReport)**
for PR 21819 at commit
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/21698
@squito @tgravescs I am probably missing something about why hash
partitioner helps, can you please clarify ?
IIRC the partitioner for CoalescedRDD when shuffle is enabled is
HashPartitioner
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21819
cc @koeninger as well
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21819
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20637#discussion_r209822349
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala
---
@@ -43,25 +43,29 @@ object
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/22079
@jiangxb1987
Here are some of the differences from the original PR
- I also ported the follow up PR #20426
- I ported #20088 (for SPARK-22905) to get the tests to pass. I also
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22079#discussion_r209822194
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/execution/RecordBinaryComparator.java
---
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22065
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22065
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94714/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22065
**[Test build #94714 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94714/testReport)**
for PR 22065 at commit
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22017#discussion_r209820737
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala ---
@@ -2238,6 +2238,70 @@ class DataFrameFunctionsSuite extends
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22017#discussion_r209816384
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala
---
@@ -496,3 +496,195 @@ case class
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22017#discussion_r209820348
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala
---
@@ -496,3 +496,195 @@ case class
Github user zhengruifeng commented on the issue:
https://github.com/apache/spark/pull/22087
@felixcheung Testsuites is added. Thanks for reviewing!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/21698
@tgravescs I vaguely remember someone at y! labs telling me (more than a
decade back) about MR always doing a sort as part of its shuffle to avoid a
variant of this problem by design.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22087
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22087
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94723/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22087
**[Test build #94723 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94723/testReport)**
for PR 22087 at commit
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22075#discussion_r209816692
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/higherOrderFunctions.scala
---
@@ -422,45 +425,49 @@ case class
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22038
**Teradata**:
**Oracle**:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21561
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94718/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21561
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21561
**[Test build #94718 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94718/testReport)**
for PR 21561 at commit
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/22079#discussion_r209815627
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/execution/RecordBinaryComparator.java
---
@@ -0,0 +1,70 @@
+/*
+ * Licensed to the Apache
Github user squito commented on the issue:
https://github.com/apache/spark/pull/22079
overall I'm in favor of backporting this, and it looks like the only
changes to the original were very small, so I'm in favor of this.
---
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21698
I also think @tgravescs solution of using the HashPartitioner is an
acceptable one, though as you've noted it doesn't deal w/ skew (which may be a
lot of the existing use of `repartition()`). I
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21451
**[Test build #94725 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94725/testReport)**
for PR 21451 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21451
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21451
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21320
That's more work for @ajacques though on the other hand. Either way works
fine.
---
-
To unsubscribe, e-mail:
Github user xuejianbest commented on the issue:
https://github.com/apache/spark/pull/22048
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22096
**[Test build #94724 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94724/testReport)**
for PR 22096 at commit
Github user xuejianbest commented on the issue:
https://github.com/apache/spark/pull/22048
Below is the display effect I tested on Xshell5.
[https://issues.apache.org/jira/secure/attachment/12935462/show.bmp](url)
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22096
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22087
**[Test build #94723 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94723/testReport)**
for PR 22087 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22087
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22087
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22097
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94719/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22097
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22097
**[Test build #94719 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94719/testReport)**
for PR 22097 at commit
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22094#discussion_r209811887
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -72,62 +73,70 @@ class AvroSerializer(rootCatalystType:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22094
**[Test build #94720 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94720/testReport)**
for PR 22094 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22094
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94720/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94717/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22096
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22096
**[Test build #94717 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94717/testReport)**
for PR 22096 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22019
Let me reopen a PR and proceed this after 2.4.0 or the code freeze
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon closed the pull request at:
https://github.com/apache/spark/pull/22019
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user Gauravshah commented on the issue:
https://github.com/apache/spark/pull/21320
Or @ajacques can open a PR to Mallman's branch and he can merge it. Makes
it less work work for him
---
-
To unsubscribe,
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21912
cc @ueshin @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22098
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22098
**[Test build #94722 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94722/testReport)**
for PR 22098 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22098
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22098
cc @shaneknapp
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/22098
[SPARK-24886][INFRA] Fix the testing script to increase timeout for Jenkins
build (from 340m to 400m)
## What changes were proposed in this pull request?
This PR targets to increase
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22001
**[Test build #94721 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94721/testReport)**
for PR 22001 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22001
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22001
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22094#discussion_r209810245
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -850,6 +851,62 @@ class AvroSuite extends QueryTest with
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22094#discussion_r209810119
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroSerializer.scala ---
@@ -212,7 +222,7 @@ class AvroSerializer(rootCatalystType:
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/22001
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22094
**[Test build #94720 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94720/testReport)**
for PR 22094 at commit
1 - 100 of 633 matches
Mail list logo
