Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22168
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22168
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22168
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user sujithjay opened a pull request:
https://github.com/apache/spark/pull/22168
[SPARK-24985][SQL][WIP] Fix OOM in Full Outer Join in case of data skew
## What issue does this pull request address ?
JIRA:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22124
**[Test build #95006 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95006/testReport)**
for PR 22124 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22124
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22124
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22124
@wangyum please don't rush into code changes, it's more efficient to come
up with a good solution before doing any coding work.
> We need COL1#6L, but after some optimization ...
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #95005 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95005/testReport)**
for PR 22112 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22112
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22154
**[Test build #95004 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95004/testReport)**
for PR 22154 at commit
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/21469
@HeartSaVioR I think I agree with a second approach that you suggested. So
`memoryUsedBytes` => `size for total memory usage of loaded versions` and
`customMetric` => `size for memory usage of
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22154
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22154
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211506399
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGeneratorWithInterpretedFallbackSuite.scala
---
@@ -40,4 +55,13 @@
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22154
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/21733
Good point. That can be minor Pr.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22167
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21733
**[Test build #95003 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95003/testReport)**
for PR 21733 at commit
Github user HeartSaVioR commented on the issue:
https://github.com/apache/spark/pull/21733
@tdas Removed the .crc files. Thanks for reviewing!
Btw, it might be good to find the way to add `.crc` files to `.gitignore`
if `.crc` files are mostly useless all the times. Might worth to
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22167
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/21733
LGTM. Will merge when tests pass. :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22167
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user LucaCanali opened a pull request:
https://github.com/apache/spark/pull/22167
[SPARK-25170][DOC] Add list and short description of Spark Executor Task
Metrics to the documentation
## What changes were proposed in this pull request?
Add description of Task
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/21733
This looks good!! Only one comment, please don't add the .crc files. They
are useless and adds unnecessarily clutter.
---
-
To
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22159
Please add https://github.com/apache/spark/pull/18424, It has been fixed.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22166
**[Test build #95002 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95002/testReport)**
for PR 22166 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22166
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22166
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22158
**[Test build #95000 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95000/testReport)**
for PR 22158 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22133
**[Test build #95001 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95001/testReport)**
for PR 22133 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22133
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
GitHub user jiangxb1987 opened a pull request:
https://github.com/apache/spark/pull/22166
[2.3][SPARK-25114][Core][FOLLOWUP] Fix RecordBinaryComparatorSuite build
failure
## What changes were proposed in this pull request?
Fix RecordBinaryComparatorSuite build failure
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22133
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22158
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22158
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/22158
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22133
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21859
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21859
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94990/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22154
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22112
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94988/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22154
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94992/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22165
**[Test build #94994 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94994/testReport)**
for PR 22165 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22153
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94997/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22165
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17400
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22154
**[Test build #94992 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94992/testReport)**
for PR 22154 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22158
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94998/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22163
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22133
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94996/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22153
**[Test build #94997 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94997/testReport)**
for PR 22153 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21859
**[Test build #94990 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94990/testReport)**
for PR 21859 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22165
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94994/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22133
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22158
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22163
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94993/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22153
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22163
**[Test build #94993 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94993/testReport)**
for PR 22163 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17400
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94999/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22158
**[Test build #94998 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94998/testReport)**
for PR 22158 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22112
**[Test build #94988 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94988/testReport)**
for PR 22112 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22133
**[Test build #94996 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94996/testReport)**
for PR 22133 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17400
**[Test build #94999 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94999/testReport)**
for PR 17400 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21320
Add some test cases when turning on `spark.sql.caseSensitive`?
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22152#discussion_r211496317
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JsonInferSchema.scala
---
@@ -69,10 +70,17 @@ private[sql] object
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18146
@rajeshcode 2.1 branch is not actively maintained. Please use the 2.2 branch
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/17400
**[Test build #94999 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94999/testReport)**
for PR 17400 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17400
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/17400
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22112
> assuming the ordering from the source RDD is preserved
This is the problem we are resolving here. This assumption is incorrect,
and the RDD closure should handle it, or use what I
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/22079
@gatorsmile So I should include all the related PRs merged to master as a
single PR here? Just verifying.
---
-
To
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21320
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21320
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94987/
Test PASSed.
---
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22165
cc @jiangxb1987
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21320
**[Test build #94987 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94987/testReport)**
for PR 21320 at commit
Github user dilipbiswal commented on a diff in the pull request:
https://github.com/apache/spark/pull/22161#discussion_r211490349
--- Diff: R/pkg/tests/fulltests/test_sparkSQL.R ---
@@ -3613,11 +3613,11 @@ test_that("Collect on DataFrame when NAs exists at
the top of a timestamp
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22079
The PR https://github.com/apache/spark/pull/22101 has been merged. Please
merge the latest one to this PR. Thanks!
---
-
To
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/22112
Then it doesn't meet the requirements for those operations used by MLlib:
* sampling
* zipWithIndex, zipWithUniqueId
* we also use zip, assuming the ordering from the source RDD is
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22101
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/20838
Or that Bryan opens a PR on your branch? that usually would be easier to
get *this* PR through, just my 2c.
---
-
To
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22101
Thanks! Merged to master and 2.3
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211487231
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGeneratorWithInterpretedFallbackSuite.scala
---
@@ -40,4 +55,13 @@
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/22158
LGTM pending Jenkins. Thanks for finding those corner cases!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211484515
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala
---
@@ -180,7 +180,10 @@ object UnsafeProjection
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211485732
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGeneratorWithInterpretedFallbackSuite.scala
---
@@ -40,4 +55,13 @@
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211485314
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGeneratorWithInterpretedFallbackSuite.scala
---
@@ -40,4 +55,13 @@
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211485848
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/CodeGeneratorWithInterpretedFallback.scala
---
@@ -63,7 +49,10 @@
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211484616
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala
---
@@ -180,7 +180,10 @@ object UnsafeProjection
Github user rednaxelafx commented on a diff in the pull request:
https://github.com/apache/spark/pull/22154#discussion_r211484374
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGeneratorWithInterpretedFallbackSuite.scala
---
@@ -18,12 +18,27
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/22161#discussion_r211487544
--- Diff: R/pkg/tests/fulltests/test_sparkSQL.R ---
@@ -3613,11 +3613,11 @@ test_that("Collect on DataFrame when NAs exists at
the top of a timestamp
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22160
@dbtsai Have you tried to run it in scala 2.12? We still can do the upgrade
after Apache 2.4 RC.
---
-
To unsubscribe,
701 - 795 of 795 matches
Mail list logo
