Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91271510
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -316,62 +338,40 @@ object SizeEstimator extends Logging {
*/
pri
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91268937
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -89,7 +90,13 @@ object SizeEstimator extends Logging {
// A cache
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91270660
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -243,47 +253,59 @@ object SizeEstimator extends Logging {
arrSize +=
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91268810
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -119,8 +126,6 @@ object SizeEstimator extends Logging {
}
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16043
**[Test build #69788 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69788/consoleFull)**
for PR 16043 at commit
[`4fcbb4b`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16043
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69788/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16043
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16190
**[Test build #69790 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69790/consoleFull)**
for PR 16190 at commit
[`66e0edf`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16190
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69790/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16190
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16056
**[Test build #69794 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69794/consoleFull)**
for PR 16056 at commit
[`c83919e`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16056
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15722
**[Test build #69793 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69793/consoleFull)**
for PR 15722 at commit
[`e7ec5bf`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15722
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15722
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69793/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16056
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69794/
Test PASSed.
---
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/15722
LGTM. Merging to master/2.1. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user omuravskiy commented on the issue:
https://github.com/apache/spark/pull/16006
Tests added
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/15722
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16193#discussion_r91284534
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/python/BatchEvalPythonExecSuite.scala
---
@@ -0,0 +1,99 @@
+/*
+ * Licensed t
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/16177
LGTM. Merging to master/2.1. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
ena
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/16177
@aray could you open a backport for branch 2.0 if you feel that we should
also fix it there?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitH
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16177
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/16193#discussion_r91285472
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala
---
@@ -166,3 +174,40 @@ object ExtractPythonUDFs exte
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16196
**[Test build #69795 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69795/consoleFull)**
for PR 16196 at commit
[`50af8fc`](https://github.com/apache/spark/commit/
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/15664#discussion_r91287287
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala
---
@@ -112,7 +112,25 @@ object JdbcUtils extends Lo
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14638
Retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16196
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69795/
Test FAILed.
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/15987
Retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16196
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15987
**[Test build #69797 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69797/consoleFull)**
for PR 15987 at commit
[`c7c31e1`](https://github.com/apache/spark/commit/c
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14638
**[Test build #69796 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69796/consoleFull)**
for PR 14638 at commit
[`6f602ba`](https://github.com/apache/spark/commit/6
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14365
It seems to exist some cases like the following (on the current master).
On hive,
```sql
CREATE TABLE t1 (a string) PARTITIONED BY (b string) STORED AS ORC;
INSERT INTO TABL
Github user a-roberts commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91301705
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -89,7 +90,13 @@ object SizeEstimator extends Logging {
// A cach
Github user a-roberts commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91305043
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -243,47 +253,59 @@ object SizeEstimator extends Logging {
arrSize
GitHub user aray opened a pull request:
https://github.com/apache/spark/pull/16197
[SPARK-17760][SQL][Backport] AnalysisException with dataframe pivot when
groupBy column is not attribute
## What changes were proposed in this pull request?
Backport of #16177 to branch-2.0
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16197
**[Test build #69798 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69798/consoleFull)**
for PR 16197 at commit
[`05bb225`](https://github.com/apache/spark/commit/0
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91309138
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -89,7 +90,13 @@ object SizeEstimator extends Logging {
// A cache
Github user a-roberts commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91309585
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -89,7 +90,13 @@ object SizeEstimator extends Logging {
// A cach
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14638
**[Test build #69796 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69796/consoleFull)**
for PR 14638 at commit
[`6f602ba`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14638
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14638
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69796/
Test PASSed.
---
Github user yanboliang commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91310987
--- Diff: docs/sparkr.md ---
@@ -512,39 +512,33 @@ head(teenagers)
# Machine Learning
-SparkR supports the following machine learning
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/16196#discussion_r91309679
--- Diff: core/src/main/scala/org/apache/spark/util/SizeEstimator.scala ---
@@ -119,8 +126,6 @@ object SizeEstimator extends Logging {
}
}
Github user yanboliang commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91313338
--- Diff: examples/src/main/r/ml/glm.R ---
@@ -0,0 +1,56 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contrib
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16148
**[Test build #69799 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69799/consoleFull)**
for PR 16148 at commit
[`02d5ac9`](https://github.com/apache/spark/commit/0
Github user yanboliang commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91314970
--- Diff: examples/src/main/r/ml/ml.R ---
@@ -0,0 +1,63 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contribu
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16169
**[Test build #69800 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69800/consoleFull)**
for PR 16169 at commit
[`a355dde`](https://github.com/apache/spark/commit/a
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15987
**[Test build #69797 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69797/consoleFull)**
for PR 15987 at commit
[`c7c31e1`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15987
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15987
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69797/
Test PASSed.
---
Github user yanboliang commented on the issue:
https://github.com/apache/spark/pull/16169
@felixcheung This is a good question. It's reasonable to call
```.setProbabilityCol(probabilityCol)``` on a model or a pipeline model, and
this should be handled at model transformation step(afte
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16148
**[Test build #69799 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69799/consoleFull)**
for PR 16148 at commit
[`02d5ac9`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16148
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69799/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16148
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/16197
LGTM - pending jenkins.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wish
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16175#discussion_r91329867
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
---
@@ -1110,6 +1110,16 @@ class DatasetSuite extends QueryTest with
SharedSQLC
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/14638#discussion_r91331724
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala ---
@@ -113,6 +113,9 @@ class HadoopTableReader(
val tablePath =
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16169
**[Test build #69800 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69800/consoleFull)**
for PR 16169 at commit
[`a355dde`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16169
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69800/
Test PASSed.
---
Github user mridulm commented on a diff in the pull request:
https://github.com/apache/spark/pull/14638#discussion_r91332545
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala ---
@@ -122,10 +125,22 @@ class HadoopTableReader(
val attrsWithIndex
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16189#discussion_r91337585
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -432,6 +435,57 @@ private[spark] class Executor(
}
/**
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16189#discussion_r91337695
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -432,6 +435,57 @@ private[spark] class Executor(
}
/**
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16000
The API should be one; it doesn't belong to core or streaming, it belongs
to Spark. Parts of it would be coming from core, parts of it would be coming
from streaming. Just like the UI.
And y
Github user brkyvz commented on a diff in the pull request:
https://github.com/apache/spark/pull/16114#discussion_r91339332
--- Diff:
external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala
---
@@ -68,7 +68,16 @@ private[kinesis] class
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/16114
I will need to take a deeper look at this to remember the code. I'm not
sure but there may be some issues with the checkpointing happening to the
WriteAheadLog and DynamoDB. Going to come back to thi
Github user wangmiao1981 commented on a diff in the pull request:
https://github.com/apache/spark/pull/16150#discussion_r91341471
--- Diff: R/pkg/R/mllib.R ---
@@ -661,7 +665,10 @@ setMethod("fitted", signature(object = "KMeansModel"),
# Get the summary of a k-means model
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16197
**[Test build #69798 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69798/consoleFull)**
for PR 16197 at commit
[`05bb225`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16119
**[Test build #69801 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69801/consoleFull)**
for PR 16119 at commit
[`dcd8063`](https://github.com/apache/spark/commit/d
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16197
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69798/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16197
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16119
Build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16119
**[Test build #69801 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69801/consoleFull)**
for PR 16119 at commit
[`dcd8063`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16119
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69801/
Test FAILed.
---
Github user hhbyyh commented on the issue:
https://github.com/apache/spark/pull/16194
I haven't really checked about it, but is it possible to just provide the
default `toString` implementation in some upstream abstract class, like Model?
And we can do the similar thing for Estimat
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/16197
Merging to 2.0. Thanks! Can you close?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16119
**[Test build #69802 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69802/consoleFull)**
for PR 16119 at commit
[`6641469`](https://github.com/apache/spark/commit/6
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16119
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16119
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69802/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16119
**[Test build #69802 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69802/consoleFull)**
for PR 16119 at commit
[`6641469`](https://github.com/apache/spark/commit/
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/16190
@sarutak Do you know why we needed this change to fix ssl-enabled history
server in #15611?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
Github user huaxingao commented on a diff in the pull request:
https://github.com/apache/spark/pull/16175#discussion_r91345742
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
---
@@ -1110,6 +1110,16 @@ class DatasetSuite extends QueryTest with
SharedSQLCo
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/16179
I think I know what the problem is, this will require some test changes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your projec
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16189#discussion_r91347493
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -432,6 +435,57 @@ private[spark] class Executor(
}
/**
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16189
**[Test build #69803 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69803/consoleFull)**
for PR 16189 at commit
[`000eaef`](https://github.com/apache/spark/commit/0
Github user aray closed the pull request at:
https://github.com/apache/spark/pull/16197
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16175#discussion_r91352281
--- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
---
@@ -1110,6 +1110,17 @@ class DatasetSuite extends QueryTest with
SharedSQLC
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/16192
Thanks. Merging to master and 2.1.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16175
I checked the code base. We are having multiple potential overflow issues
in `sizeInBytes` of `Statistics`. We might need a fix for all the other places.
---
If your project is set up for it, yo
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16192
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16068
**[Test build #69804 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69804/consoleFull)**
for PR 16068 at commit
[`04a4a22`](https://github.com/apache/spark/commit/0
Github user actuaryzhang commented on the issue:
https://github.com/apache/spark/pull/16149
@srowen @sethah
I have cleaned up the change as suggested. Please review and let me know if
there is any question.
---
If your project is set up for it, you can reply to this email and ha
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16179
**[Test build #69805 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69805/consoleFull)**
for PR 16179 at commit
[`93e07db`](https://github.com/apache/spark/commit/9
Github user huaxingao commented on the issue:
https://github.com/apache/spark/pull/16175
@gatorsmile Thanks a lot for reviewing this. Sorry I just saw your last
comment after I pushed the change. Will make more changes for other potential
overflow issues.
---
If your project is s
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/16186#discussion_r91356341
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala
---
@@ -35,12 +43,24 @@ class StreamingQueryListe
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16150
**[Test build #69806 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69806/consoleFull)**
for PR 16150 at commit
[`41fd4ec`](https://github.com/apache/spark/commit/4
Github user anabranch commented on the issue:
https://github.com/apache/spark/pull/16138
More details are here:
https://gist.github.com/anabranch/7a42292593976878eb14e2d86a9966d4
This is completely perplexing to me.
---
If your project is set up for it, you can reply to this
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/16193#discussion_r91360137
--- Diff: python/pyspark/sql/tests.py ---
@@ -360,6 +360,15 @@ def test_broadcast_in_udf(self):
[res] = self.spark.sql("SELECT MYUDF('')").col
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16193
@cloud-fan Let me do a history search and see why we dropped the logical
plan node `EvaluatePython`
---
If your project is set up for it, you can reply to this email and have your
reply appear o
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16193
https://github.com/apache/spark/pull/12127 dropped the node `EvaluatePython
`. Based on the PR description, we removed the node for the following reasons:
>Currently we extract Python UD
101 - 200 of 590 matches
Mail list logo
