Github user zhzhan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16068#discussion_r91026585
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala
---
@@ -487,6 +488,52 @@ class HiveUDFSuite extends QueryTest with
Github user zhzhan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16068#discussion_r91026433
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala
---
@@ -487,6 +488,52 @@ class HiveUDFSuite extends QueryTest with
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/16161
cc @cloud-fan
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if th
Github user hhbyyh commented on the issue:
https://github.com/apache/spark/pull/16103
Thanks for the review.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16167
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69711/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16167
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16167
**[Test build #69711 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69711/consoleFull)**
for PR 16167 at commit
[`41066dd`](https://github.com/apache/spark/commit/
Github user windpiger commented on the issue:
https://github.com/apache/spark/pull/15994
ok ,thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if
Github user sethah commented on a diff in the pull request:
https://github.com/apache/spark/pull/16149#discussion_r91021502
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala
---
@@ -479,7 +479,12 @@ object GeneralizedLinearRegression e
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16068#discussion_r91020060
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala
---
@@ -487,6 +488,52 @@ class HiveUDFSuite extends QueryTest wit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16166
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69710/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16166
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16166
**[Test build #69710 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69710/consoleFull)**
for PR 16166 at commit
[`095184d`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16068
**[Test build #69716 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69716/consoleFull)**
for PR 16068 at commit
[`87f134c`](https://github.com/apache/spark/commit/8
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16068
**[Test build #69715 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69715/consoleFull)**
for PR 16068 at commit
[`78e9b38`](https://github.com/apache/spark/commit/7
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16128
**[Test build #69714 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69714/consoleFull)**
for PR 16128 at commit
[`26a86d6`](https://github.com/apache/spark/commit/2
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16129
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16129
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69709/
Test PASSed.
---
Github user actuaryzhang commented on the issue:
https://github.com/apache/spark/pull/16131
@srowen Done. Thanks for the suggestion.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user Mironor commented on the issue:
https://github.com/apache/spark/pull/16137
@srowen I reversed obvious comments as well as some minor changes (such as
capitalizing). I only left javadoc for some of the non-trivial public api. I
can reverse changes for comments where the onl
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #69709 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69709/consoleFull)**
for PR 16129 at commit
[`b4a197a`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16128
**[Test build #3468 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3468/consoleFull)**
for PR 16128 at commit
[`8d4ca5e`](https://github.com/apache/spark/commit
Github user Mironor commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91015596
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1144,13 +1218,19 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91015460
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1144,13 +1218,19 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16138
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69713/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16138
**[Test build #69713 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69713/consoleFull)**
for PR 16138 at commit
[`8837bdb`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16138
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user ChorPangChan commented on a diff in the pull request:
https://github.com/apache/spark/pull/16000#discussion_r91014959
--- Diff:
streaming/src/main/java/org/apache/spark/streaming/status/api/v1/BatchStatus.java
---
@@ -0,0 +1,30 @@
+/*
+ * Licensed to the Apache
Github user liancheng commented on the issue:
https://github.com/apache/spark/pull/16163
@srowen Thanks. I sent this one because the `consoleFull` page frequently
freezes my browser these days, not mentioning viewing Jenkins build results via
mobile phone...
---
If your project is s
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16138
**[Test build #69713 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69713/consoleFull)**
for PR 16138 at commit
[`8837bdb`](https://github.com/apache/spark/commit/8
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16014
**[Test build #69712 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69712/consoleFull)**
for PR 16014 at commit
[`6ef26fe`](https://github.com/apache/spark/commit/6
Github user seyfe commented on the issue:
https://github.com/apache/spark/pull/16165
Hi @srowen,
Thanks for the quick feedback. Let me get rid of the on/off knob for
inprogress files. Would you like me to remove the maxAge setting for inprogress
files as well?
I init
Github user Mironor commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91013560
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1144,13 +1218,19 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16167
**[Test build #69711 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69711/consoleFull)**
for PR 16167 at commit
[`41066dd`](https://github.com/apache/spark/commit/4
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/16128
LGTM pending tests.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/16167
[DO NOT MERGE]Remove workaround for Netty memory leak
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16165
I don't think it makes sense to expose yet another set of settings for this.
I think the risk of course is that this accidentally cleans up another
instance's work in progress.
However if it's
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16166
**[Test build #69710 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69710/consoleFull)**
for PR 16166 at commit
[`095184d`](https://github.com/apache/spark/commit/0
GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/16166
[SPARK-18734][SS] Represent timestamp in StreamingQueryProgress as
formatted string instead of millis
## What changes were proposed in this pull request?
Easier to read while debugging as a f
GitHub user seyfe opened a pull request:
https://github.com/apache/spark/pull/16165
[SPARK-18733] [WEBUI] HistoryServer: Add config option to cleanup
in-progress files
## What changes were proposed in this pull request?
Add 2 new config parameters
1) spark.history.fs.cleaner
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16165
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feat
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91011837
--- Diff: examples/src/main/r/ml/lda.R ---
@@ -0,0 +1,46 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contri
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16148
this is great, thanks! btw, how are these examples getting run? is there a
way to know if the examples are broken because of API changes?
---
If your project is set up for it, you can reply to
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91011772
--- Diff: examples/src/main/r/ml/randomForest.R ---
@@ -0,0 +1,63 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91011734
--- Diff: examples/src/main/r/ml/randomForest.R ---
@@ -0,0 +1,63 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91011578
--- Diff: docs/sparkr.md ---
@@ -512,39 +512,33 @@ head(teenagers)
# Machine Learning
-SparkR supports the following machine learning
Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/16148#discussion_r91011559
--- Diff: docs/sparkr.md ---
@@ -512,39 +512,33 @@ head(teenagers)
# Machine Learning
-SparkR supports the following machine learning
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16150
there is also this form
`\code{apriori} (the label distribution)`
and this form
`\item{\code{docConcentration}}{concentration parameter commonly named
\code{alpha} `
---
If you
Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/16150
thanks, there is also the issue with `\code{numOfInputs}` vs `number of
iterations IRLS takes`
- should it be a "variable" (and thus wrapped with `\code{something}`
- or should it be a de
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16160
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16164
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16164
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69708/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16164
**[Test build #69708 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69708/consoleFull)**
for PR 16164 at commit
[`4d71250`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16159
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16159
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69704/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16159
**[Test build #69704 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69704/consoleFull)**
for PR 16159 at commit
[`ce2aa99`](https://github.com/apache/spark/commit/
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91010366
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1417,27 +1551,31 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91010077
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1417,27 +1551,31 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91010001
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1401,8 +1532,11 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/16098
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16160
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16160
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69706/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16160
**[Test build #69706 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69706/consoleFull)**
for PR 16160 at commit
[`3a7afe7`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16163
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16098
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or i
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16163
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69703/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91009699
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1620,8 +1766,9 @@ class SparkContext(config: SparkConf) extends Logging
{
Github user Mironor commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91009631
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1417,27 +1551,31 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16163
**[Test build #69703 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69703/testReport)**
for PR 16163 at commit
[`6aa9f34`](https://github.com/apache/spark/commit/6
Github user Mironor commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91009155
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1401,8 +1532,11 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user sethah commented on the issue:
https://github.com/apache/spark/pull/16139
ping @yanboliang
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91008727
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -119,22 +119,22 @@ class SparkContext(config: SparkConf) extends Logging
{
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91008621
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -119,22 +119,22 @@ class SparkContext(config: SparkConf) extends Logging
{
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91008657
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -119,22 +119,22 @@ class SparkContext(config: SparkConf) extends Logging
{
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91008467
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -923,15 +971,13 @@ class SparkContext(config: SparkConf) extends Logging
{
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/16137#discussion_r91008183
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1417,27 +1551,31 @@ class SparkContext(config: SparkConf) extends
Logging {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16128
**[Test build #3468 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3468/consoleFull)**
for PR 16128 at commit
[`8d4ca5e`](https://github.com/apache/spark/commit/
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/16142
@srowen If I have understand what you mean correctly, the **"log
rotation"** is different with **"job event log clean up"**. The "job event
log" is used to reply to build spark history ui. Rightï
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16128
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16128
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69705/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16128
**[Test build #69705 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69705/consoleFull)**
for PR 16128 at commit
[`8d4ca5e`](https://github.com/apache/spark/commit/
Github user weiqingy commented on a diff in the pull request:
https://github.com/apache/spark/pull/16159#discussion_r91006592
--- Diff: project/SparkBuild.scala ---
@@ -596,19 +596,17 @@ object Hive {
}
object Assembly {
- import sbtassembly.AssemblyUtils._
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/15998
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15998
thanks, merging to master/2.1!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled an
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/15998#discussion_r91006319
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala
---
@@ -346,6 +346,31 @@ abstract class ExternalCat
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/16164
@srowen Indeed, it is not a normal case. And I found this problem when the
streaming job went wrong. As you said
> one can compare the graphs visually.
It still may mislead users i
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/15998#discussion_r91006034
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/catalog/ExternalCatalogSuite.scala
---
@@ -346,6 +346,31 @@ abstract class ExternalCa
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/16037#discussion_r91005791
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/optimization/LBFGS.scala ---
@@ -241,16 +241,27 @@ object LBFGS extends Logging {
val bcW = d
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16142
Yes, but the alternative is reimplementing an ad-hoc log rotation system
here, which isn't great either. Are you saying the history server already
manages logs? pardon, I don't know it at all.
---
Github user uncleGen commented on the issue:
https://github.com/apache/spark/pull/16142
@srowen Spark History Server may do the clean-up work. The precondition is
we start it and it keeps running. Besides, if there are abundant applications
constantly, the event log may still take up
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16146
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69707/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16146
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16146
**[Test build #69707 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69707/consoleFull)**
for PR 16146 at commit
[`8672343`](https://github.com/apache/spark/commit/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16129
**[Test build #69709 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69709/consoleFull)**
for PR 16129 at commit
[`b4a197a`](https://github.com/apache/spark/commit/b
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16164
CC @zsxwing because it works this way on purpose, so that one can compare
the graphs visually. Usually these values aren't too different in scale; it's a
problem here because scheduling delay is unus
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16147
Just FYI, I ran some more tests for each package for myself and grepped
`local-cluster` before submitting this PR and It seems there are not many same
instances. If I face the same problems freq
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16164
**[Test build #69708 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69708/consoleFull)**
for PR 16164 at commit
[`4d71250`](https://github.com/apache/spark/commit/4
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16142
Hm, does Spark generally manage log rotation? I confess ignorance. It's
something you often leave to a cron job or something to archive and clean up.
---
If your project is set up for it, you can r
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/16128#discussion_r91003428
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala
---
@@ -1022,6 +1021,33 @@ class FileStreamSourceSuite extends
Fi
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/16128#discussion_r91003243
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/JsonUtils.scala
---
@@ -81,7 +81,14 @@ private object JsonUtils {
*/
1 - 100 of 511 matches
Mail list logo