Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14155
**[Test build #63831 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63831/consoleFull)**
for PR 14155 at commit
[`f523bb6`](https://github.com/apache/spark/commit/f
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/13796#discussion_r74886022
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala
---
@@ -952,13 +963,160 @@ private class LogisticAggregator(
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14555
Ping @zjffdu
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if t
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/13796#discussion_r74886535
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala
---
@@ -952,13 +963,160 @@ private class LogisticAggregator(
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/13796#discussion_r74886863
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala
---
@@ -952,13 +963,160 @@ private class LogisticAggregator(
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/13796#discussion_r74887523
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala
---
@@ -952,13 +963,160 @@ private class LogisticAggregator(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14155
**[Test build #63832 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63832/consoleFull)**
for PR 14155 at commit
[`715c312`](https://github.com/apache/spark/commit/7
GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/14661
[SPARK-16991][SQL] Fix Outer Join Elimination when Filter's isNotNull
Constraints Unable to Filter Out All Null-supplying Rows
### What changes were proposed in this pull request?
This PR is
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14660
**[Test build #63828 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63828/consoleFull)**
for PR 14660 at commit
[`e1214d5`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14660
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14660
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63828/
Test PASSed.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14661
cc @hvanhovell @yhuai @dongjoon-hyun @nsyca
also cc the original reviewers: @davies @sameeragarwal @marmbrus
Thanks!
---
If your project is set up for it, you can reply to thi
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14661
**[Test build #63833 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63833/consoleFull)**
for PR 14661 at commit
[`a537dd0`](https://github.com/apache/spark/commit/a
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14655
cc @cloud-fan and @gatorsmile - both are working on refactoring some of
these code.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If y
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14660
cc @rxin and @liancheng , Could you take a look?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have thi
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14660#discussion_r74889501
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -794,13 +805,44 @@ object ParquetFileFormat
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14646
Are you thinking about testing Hadoop versions that are unpublished? But if
that's the case, you'd need to modify the version anyway. Why not just add this
when you need to do those tests?
---
If yo
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14660#discussion_r74889938
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -224,7 +226,16 @@ class ParquetFileFormat
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14616
thanks, merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wi
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/13796#discussion_r74889972
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala
---
@@ -952,13 +963,160 @@ private class LogisticAggregator(
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14616
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14279#discussion_r74890304
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
---
@@ -62,6 +64,11 @@ object DateTimeUtils {
@transi
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14655
If we gonna do this, I'd like to have a more general approach, which should
also work for data source tables.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14625#discussion_r74890820
--- Diff: sql/core/src/test/resources/test-data/kv1.json ---
@@ -0,0 +1,5 @@
+{"key":251,"value":"val_251"}
--- End diff --
we can inline t
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14656
**[Test build #63829 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63829/consoleFull)**
for PR 14656 at commit
[`2f80f54`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14656
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63829/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14656
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14660
Thank you so much. I will try to address the comments.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/14618
I think this cache is mainly used for file status, not `decoding the
metadata fetched from the external Catalog`. Thus `MetadataCache` may not be a
good name.
And this cache is useful wha
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14279#discussion_r74891800
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala
---
@@ -188,6 +189,30 @@ private[sql] class CsvOutputWriter(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14620
**[Test build #63834 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63834/consoleFull)**
for PR 14620 at commit
[`a3068a7`](https://github.com/apache/spark/commit/a
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14625#discussion_r74891950
--- Diff: sql/core/src/test/resources/test-data/kv1.json ---
@@ -0,0 +1,5 @@
+{"key":251,"value":"val_251"}
--- End diff --
Sure, will do
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14279#discussion_r74892175
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala
---
@@ -62,6 +64,11 @@ object DateTimeUtils {
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14279
@HyukjinKwon can we also allow users to set the output date/timestamp
format? This is a breaking change, and I really worry about that. With this
change and without making it configurable, there will b
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/13758
@cloud-fan , I see. First, I will create another PR to focus on projection
by making the new `UnsafeArrayData`. After merging the PR, let us be back to
this PR.
---
If your project is set up for it,
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14654
LGTM - merging in master/2.0.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14652
LGTM - merging in branch-2.0.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wis
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14279
@rxin, Sure! I can add `dateFormat` option for both. Do you want me to do
this here (or follow-up)?
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/14279#discussion_r74892575
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala
---
@@ -188,6 +189,30 @@ private[sql] class CsvOutput
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14654
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14652
hm damn - this one includes https://github.com/apache/spark/pull/14654 and
I merged that one first. I ended up reverting the other one from branch-2.0 to
merge this one.
Can you close this tic
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14650
Does the existing spark-submit not work on Mesos?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fea
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/14620
I've added test cases for all the methods in `ParserUtils`, and made two
small changes in the `ParserUtils` code:
1. Deleted function `command(stream: CharStream)`, merge both `command`
meth
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14655
Will this be part of the CBO work? The size estimation or statistics
collection is being re-designed for CBO, right?
---
If your project is set up for it, you can reply to this email and have yo
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14623
@dongjoon-hyun I understand that the existing test didn't set a great
standard, but can you look at the data and query and come up with something a
lot shorter? The problem with the current cases is th
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/14618
My original plan is to move it when we decided to use it for the other
external catalog. Yeah, let me move it soon.
Will try to give a better name tomorrow. : )
---
If your project is
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14623
I see what is your point. Then, I'll make a new one without consideration
`WindowQuerySuite.scala`. Thank you for guidance, @rxin !
---
If your project is set up for it, you can reply to this
Github user hvanhovell commented on the issue:
https://github.com/apache/spark/pull/14652
Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user hvanhovell closed the pull request at:
https://github.com/apache/spark/pull/14652
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user witgo opened a pull request:
https://github.com/apache/spark/pull/14662
[WIP][SPARK-17082][CORE]Replace ByteBuffer with ChunkedByteBuffer
## What changes were proposed in this pull request?
Replace `ByteBuffer` with `ChunkedByteBuffer` :
* ManagedBuffer
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14571
Hi, @rxin .
After splitting window functions PR, is there any thing to do more for this
`prettyName` PR?
---
If your project is set up for it, you can reply to this email and have your
re
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14155
**[Test build #63831 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63831/consoleFull)**
for PR 14155 at commit
[`f523bb6`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14155
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14155
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63831/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14662
**[Test build #63835 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63835/consoleFull)**
for PR 14662 at commit
[`b6c1e3a`](https://github.com/apache/spark/commit/b
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14619#discussion_r74895818
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1636,6 +1638,30 @@ object ReplaceExceptWithAntiJoin
Github user jiangxb1987 commented on a diff in the pull request:
https://github.com/apache/spark/pull/14619#discussion_r74896284
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala
---
@@ -1636,6 +1638,30 @@ object ReplaceExceptWithAntiJoi
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14392
**[Test build #63836 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63836/consoleFull)**
for PR 14392 at commit
[`0abdecf`](https://github.com/apache/spark/commit/0
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14662
**[Test build #63837 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63837/consoleFull)**
for PR 14662 at commit
[`b229441`](https://github.com/apache/spark/commit/b
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14662
**[Test build #63835 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63835/consoleFull)**
for PR 14662 at commit
[`b6c1e3a`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14662
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14662
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63835/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14648
**[Test build #63838 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63838/consoleFull)**
for PR 14648 at commit
[`4094b43`](https://github.com/apache/spark/commit/4
Github user andreweduffy commented on the issue:
https://github.com/apache/spark/pull/14649
Let me see if I can answer these in order:
> So, if my understanding is correct, Parquet filters rowgroups in both
normal reader and vectorized reader already (#13701). Is this doing th
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14662
**[Test build #63837 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63837/consoleFull)**
for PR 14662 at commit
[`b229441`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14662
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14662
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63837/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14155
**[Test build #63832 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63832/consoleFull)**
for PR 14155 at commit
[`715c312`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14155
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14155
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63832/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14151
**[Test build #63839 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63839/consoleFull)**
for PR 14151 at commit
[`2540018`](https://github.com/apache/spark/commit/2
Github user ScrapCodes commented on a diff in the pull request:
https://github.com/apache/spark/pull/14151#discussion_r74902549
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/text/TextSuite.scala
---
@@ -39,6 +39,11 @@ class TextSuite extends QueryTes
Github user ScrapCodes commented on a diff in the pull request:
https://github.com/apache/spark/pull/14151#discussion_r74903349
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -533,6 +533,12 @@ object SQLConf {
.timeConf(TimeUnit.MILL
Github user Stibbons commented on the issue:
https://github.com/apache/spark/pull/14567
Any update?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if t
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14392
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63836/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14392
**[Test build #63836 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63836/consoleFull)**
for PR 14392 at commit
[`0abdecf`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14392
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14661
**[Test build #63833 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63833/consoleFull)**
for PR 14661 at commit
[`a537dd0`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14661
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14661
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63833/
Test PASSed.
---
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/14646
I'm adding the ability to test against staged releases, such as Hadoop
2.7.3 RC1. Add this profile and testing that spark runs with the new RC is a
matter of setting the version with a -D and
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/14650
I think not.
MesosDispacther uses
[spark-daemon.sh](https://github.com/apache/spark/blob/master/sbin/start-mesos-dispatcher.sh#L44)
which uses
[class](https://github.com/apache/spark/blob/master
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14620
**[Test build #63834 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63834/consoleFull)**
for PR 14620 at commit
[`a3068a7`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14620
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63834/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14620
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/14620#discussion_r74909202
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ParserUtilsSuite.scala
---
@@ -61,5 +102,84 @@ class ParserUtilsSuite extends
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14644
OK, that makes sense. I think a property under spark.mesos makes sense
right now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If y
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/9571#discussion_r74910796
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -667,6 +710,123 @@ private[history] class FsHistoryProvider
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/9571#discussion_r74910734
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -667,6 +710,123 @@ private[history] class FsHistoryProvider
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/9571#discussion_r74910950
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ---
@@ -667,6 +710,123 @@ private[history] class FsHistoryProvider
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14648
**[Test build #63838 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63838/consoleFull)**
for PR 14648 at commit
[`4094b43`](https://github.com/apache/spark/commit/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14648
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14663
**[Test build #63840 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63840/consoleFull)**
for PR 14663 at commit
[`496a8df`](https://github.com/apache/spark/commit/4
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14648
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63838/
Test FAILed.
---
GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/14663
[SPARK-17001] [ML] Enable standardScaler to standardize sparse vectors when
withMean=True
## What changes were proposed in this pull request?
Allow centering / mean scaling of sparse vector
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14645
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or i
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14649
Oh, sorry for the second question. I missed `val parquetSchema =
metadata.getFileMetaData.getSchema`. and yes, it only reads metadata and I
think I got your idea for using `_metadata` here.
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/14645
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user steveloughran commented on a diff in the pull request:
https://github.com/apache/spark/pull/9571#discussion_r74911975
--- Diff:
core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala ---
@@ -114,28 +123,45 @@ class HistoryServer(
* this UI with
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14657
**[Test build #63841 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63841/consoleFull)**
for PR 14657 at commit
[`7b39d2b`](https://github.com/apache/spark/commit/7
1 - 100 of 556 matches
Mail list logo
