Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/1368#issuecomment-48700214
Thanks. Merging this in master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/1368
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809047
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
maxMe
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/1354#discussion_r14809046
--- Diff: python/pyspark/rdd.py ---
@@ -509,7 +522,8 @@ def sortByKey(self, ascending=True, numPartitions=None,
keyfunc = lambda x: x):
>>> tmp2 = [
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1370#issuecomment-48700541
QA results for PR 1370:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809203
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
maxMe
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809244
--- Diff: project/MimaExcludes.scala ---
@@ -61,16 +63,25 @@ object MimaExcludes {
ProblemFilters.exclude[MissingMethodProblem](
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/955#issuecomment-48701090
QA tests have started for PR 955. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16558/consoleFull
---
If y
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/1165#issuecomment-48701135
Did an initial pass with some feedback - not totally done yet but it should
be enough to get some work done.
---
If your project is set up for it, you can reply to this
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/1365
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/1358#issuecomment-48701713
Hey Dario - do you mind describing a bit more the problem this fixes
(ideally create a JIRA for it) and what the symptoms are.
---
If your project is set up for it, you
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/955#issuecomment-48701783
QA tests have started for PR 955. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16560/consoleFull
---
If y
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1369#issuecomment-48701944
QA results for PR 1369:- This patch FAILED unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/955#issuecomment-48702465
QA tests have started for PR 955. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16561/consoleFull
---
If y
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809771
--- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala
---
@@ -463,16 +463,16 @@ private[spark] class BlockManager(
v
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809809
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
max
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809836
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -87,9 +97,32 @@ private class MemoryStore(blockManager: BlockManager,
maxMe
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809878
--- Diff: core/src/main/scala/org/apache/spark/CacheManager.scala ---
@@ -140,14 +144,39 @@ private[spark] class CacheManager(blockManager:
BlockManager) e
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809944
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
max
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14809936
--- Diff: core/src/main/scala/org/apache/spark/CacheManager.scala ---
@@ -140,14 +144,39 @@ private[spark] class CacheManager(blockManager:
BlockManager) e
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14810031
--- Diff:
core/src/main/scala/org/apache/spark/util/collection/SizeTracker.scala ---
@@ -0,0 +1,105 @@
+/*
+ * Licensed to the Apache Software Foun
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14810039
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
max
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14810095
--- Diff: core/src/main/scala/org/apache/spark/SparkEnv.scala ---
@@ -67,10 +67,14 @@ class SparkEnv (
val metricsSystem: MetricsSystem,
v
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/931#issuecomment-48703798
Jenkins, test this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have t
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/181#issuecomment-48704142
Cool - thanks for contributing the test! Jenkins, test this please. LGTM
pending tests.
---
If your project is set up for it, you can reply to this email and have your
r
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/181#issuecomment-48704291
QA tests have started for PR 181. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16563/consoleFull
---
If y
Github user ScrapCodes commented on a diff in the pull request:
https://github.com/apache/spark/pull/1354#discussion_r14810364
--- Diff: python/pyspark/rdd.py ---
@@ -509,7 +522,8 @@ def sortByKey(self, ascending=True, numPartitions=None,
keyfunc = lambda x: x):
>>> tm
Github user drexin commented on the pull request:
https://github.com/apache/spark/pull/1358#issuecomment-48706534
Hi Patrick,
the problem is described in [this mailing list
entry](http://mail-archives.apache.org/mod_mbox/mesos-user/201407.mbox/%3c53b66e6d.7090...@uninett.no%3e
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1369#issuecomment-48706567
QA tests have started for PR 1369. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16564/consoleFull
---
If
Github user YanjieGao commented on the pull request:
https://github.com/apache/spark/pull/1134#issuecomment-48707013
Thanks Michael ,
(1) We could make it as a user hint ,like hive does .
set hive.optimize.skewjoin = true;
set hive.skewjoin.key = skew_key_threshold ï¼defau
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/1369#issuecomment-48707227
Wasn't this already decided against in
https://github.com/apache/spark/pull/332 and again
https://github.com/apache/spark/pull/1208 ? or is this not another PR for
https:
Github user drexin commented on the pull request:
https://github.com/apache/spark/pull/1358#issuecomment-48707209
Created a JIRA issue here: https://issues.apache.org/jira/browse/SPARK-2445
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user YanjieGao commented on the pull request:
https://github.com/apache/spark/pull/1134#issuecomment-48707289
Hi , I also make a left semi join .I don't know is this join as a
optimization as the left semi join or as a single join algorithm. I think the
1127 PR also has some
Github user YanjieGao commented on a diff in the pull request:
https://github.com/apache/spark/pull/1134#discussion_r14811559
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins.scala ---
@@ -400,3 +401,73 @@ case class BroadcastNestedLoopJoin(
streame
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/955#issuecomment-48708106
QA results for PR 955:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds the following public classes
(experimental):class MultivariateOnlineSumma
Github user witgo commented on the pull request:
https://github.com/apache/spark/pull/1369#issuecomment-48708268
#332 can't automatic test .
#1208 was messing up and I do not know how to solve . :sweat:
---
If your project is set up for it, you can reply to this email and have y
GitHub user fireflyc opened a pull request:
https://github.com/apache/spark/pull/1372
replace println to log4j
Our program needs to receive a large amount of data and run for a long
time.
We set the log level to WARN but "Storing iterator" "received single"
as such messag
Github user witgo commented on the pull request:
https://github.com/apache/spark/pull/332#issuecomment-48708675
It can't automatic test. I submit a new PR #1369.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pr
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/1372#issuecomment-48708875
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/955#issuecomment-48709108
QA results for PR 955:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds the following public classes
(experimental):class MultivariateOnlineSumma
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/955#issuecomment-48709925
QA results for PR 955:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds the following public classes
(experimental):class MultivariateOnlineSumma
GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/1373
[SPARK-2446][SQL] Add BinaryType support to Parquet I/O.
To support `BinaryType`, the following changes are needed:
- Make `StringType` use `OriginalType.UTF8`
- Add `BinaryType` using `Primit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1373#issuecomment-48710936
QA tests have started for PR 1373. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16565/consoleFull
---
If
Github user li-zhihui commented on a diff in the pull request:
https://github.com/apache/spark/pull/900#discussion_r14813843
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -46,9 +46,19 @@ class CoarseGrainedSchedulerBack
Github user li-zhihui commented on the pull request:
https://github.com/apache/spark/pull/900#issuecomment-48714143
Thanks @tgravescs
I will file a new jira for handling mesos and follow it after the PR merged.
---
If your project is set up for it, you can reply to this email an
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1155#issuecomment-48714186
QA tests have started for PR 1155. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16566/consoleFull
---
If
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1369#issuecomment-48714364
QA results for PR 1369:- This patch FAILED unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user avulanov commented on a diff in the pull request:
https://github.com/apache/spark/pull/1155#discussion_r14814439
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/evaluation/MulticlassMetrics.scala
---
@@ -0,0 +1,181 @@
+/*
+ * Licensed to the Apache Softwa
Github user avulanov commented on the pull request:
https://github.com/apache/spark/pull/1155#issuecomment-48715008
@mengxr
I've addressed you comments, except the one with import which I commented
above.
I've posted a question about feature selection interface. Could you
GitHub user ScrapCodes opened a pull request:
https://github.com/apache/spark/pull/1374
[SPARK-2437] Rename MAVEN_PROFILES to SBT_MAVEN_PROFILES and add
SBT_MAVEN_PROPERTIES
NOTE: It is not possible to use both env variable `SBT_MAVEN_PROFILES`
and `-P` flag at same time. `-P` if
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1374#issuecomment-48716144
QA tests have started for PR 1374. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16567/consoleFull
---
If
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1354#issuecomment-48718027
QA tests have started for PR 1354. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16568/consoleFull
---
If
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1373#issuecomment-48718560
QA results for PR 1373:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1155#issuecomment-48720849
QA results for PR 1155:- This patch FAILED unit tests.- This patch
merges cleanly- This patch adds the following public classes
(experimental):class MulticlassMetrics(pre
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1374#issuecomment-48722841
QA results for PR 1374:- This patch FAILED unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1354#issuecomment-48725049
QA results for PR 1354:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user ScrapCodes commented on the pull request:
https://github.com/apache/spark/pull/1374#issuecomment-48725337
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not h
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1374#issuecomment-48725500
QA tests have started for PR 1374. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16569/consoleFull
---
If
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/1279#discussion_r14821748
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -124,6 +124,14 @@ class SparkConf(loadDefaults: Boolean) extends
Cloneable with Loggin
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/1279#discussion_r14822032
--- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala ---
@@ -167,6 +175,8 @@ class SparkConf(loadDefaults: Boolean) extends
Cloneable with Logging
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/1279#discussion_r14822125
--- Diff:
yarn/alpha/src/main/scala/org/apache/spark/deploy/yarn/Client.scala ---
@@ -108,6 +108,10 @@ class Client(clientArgs: ClientArguments, hadoopConf:
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/1279#discussion_r14822197
--- Diff:
yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/Client.scala ---
@@ -81,6 +81,10 @@ class Client(clientArgs: ClientArguments, hadoopConf:
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1374#issuecomment-48736229
QA results for PR 1374:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/900#discussion_r14823260
--- Diff: docs/configuration.md ---
@@ -699,6 +699,22 @@ Apart from these, the following properties are also
available, and may be useful
(in millis
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1372#issuecomment-48739929
I have verified, the log level is set to Info right?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If y
Github user ScrapCodes commented on the pull request:
https://github.com/apache/spark/pull/1354#issuecomment-48740596
Found a way actually.
On Jul 11, 2014 6:07 PM, "Apache Spark QA" wrote:
> QA results for PR 1354:
> - This patch PASSES unit tests.
> - This patch
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/900#discussion_r14825405
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -244,6 +257,17 @@ class CoarseGrainedSchedulerBa
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1022#issuecomment-48750411
QA tests have started for PR 1022. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16570/consoleFull
---
If
Github user YanjieGao commented on the pull request:
https://github.com/apache/spark/pull/1134#issuecomment-48752406
Hi I rewrite the code ,and resolve some former problem
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. I
Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/1366#issuecomment-48759522
@aarondav, you are totally right. However, the `Aggregate` operator that
this is replacing made the same assumption and this approach will use strictly
less memory.
Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/1373#issuecomment-48760249
Thanks for the patch! One quick question: will this change the behavior
when loading in string data that was saved with previous versions of Spark SQL?
---
If your pro
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1022#issuecomment-48761837
QA results for PR 1022:- This patch PASSES unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user dbtsai commented on the pull request:
https://github.com/apache/spark/pull/987#issuecomment-48762832
#560 is merged. Close this PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user dbtsai closed the pull request at:
https://github.com/apache/spark/pull/987
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1360#issuecomment-48762929
QA tests have started for PR 1360. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16571/consoleFull
---
If
Github user etrain commented on a diff in the pull request:
https://github.com/apache/spark/pull/886#discussion_r14836561
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/tree/DecisionTree.scala ---
@@ -768,104 +973,157 @@ object DecisionTree extends Serializable with
Logging
Github user dorx commented on a diff in the pull request:
https://github.com/apache/spark/pull/1367#discussion_r14836617
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/stat/correlation/Correlation.scala
---
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software F
Github user dorx commented on a diff in the pull request:
https://github.com/apache/spark/pull/1367#discussion_r14836715
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/stat/correlation/Correlation.scala
---
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software F
Github user etrain commented on the pull request:
https://github.com/apache/spark/pull/886#issuecomment-48767401
I've gone through this in some depth, and aside from a couple of minor
style nits - the logic looks good to me. Manish - have you compared output vs.
scikit-learn for multi
Github user dorx commented on a diff in the pull request:
https://github.com/apache/spark/pull/1367#discussion_r14836922
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/stat/correlation/Correlation.scala
---
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software F
GitHub user kbzod opened a pull request:
https://github.com/apache/spark/pull/1375
[WIP] SPARK-2450: Add YARN executor log links to UI executors page
This adds a new column in the Executors page of the Spark UI called "Logs",
visible only when running under YARN. After getting a con
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/1375#issuecomment-48768609
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/1374#issuecomment-48768736
Thanks, looks good. I tested this with:
```
SBT_MAVEN_PROFILES=yarn SBT_MAVEN_PROPERTIES="hadoop.versn=2.2.0" sbt/sbt
package
```
---
If your project i
Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/1336#issuecomment-48769071
LGTM with one small comment.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not hav
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/1374
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enab
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1336#discussion_r14837627
--- Diff:
core/src/main/scala/org/apache/spark/deploy/master/ui/HistoryNotFoundPage.scala
---
@@ -0,0 +1,40 @@
+/*
+ * Licensed to the Apache Softwa
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14837730
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
maxMe
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14837775
--- Diff: core/src/main/scala/org/apache/spark/storage/MemoryStore.scala ---
@@ -141,6 +174,86 @@ private class MemoryStore(blockManager: BlockManager,
maxMe
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14837855
--- Diff: core/src/main/scala/org/apache/spark/SparkEnv.scala ---
@@ -67,10 +67,14 @@ class SparkEnv (
val metricsSystem: MetricsSystem,
val
Github user nishkamravi2 commented on the pull request:
https://github.com/apache/spark/pull/492#issuecomment-48769703
@tgravescs Sorry, missed this one somehow. Yes, spark-submit is now fully
tested. We could keep this one open for 0.92 potentially.
---
If your project is set up fo
Github user nishkamravi2 commented on the pull request:
https://github.com/apache/spark/pull/1000#issuecomment-48770070
@rxin, @colorant Sorry, the emails went to my spam folder. The fix looks
better than the one before.
---
If your project is set up for it, you can reply to this e
Github user pwendell commented on a diff in the pull request:
https://github.com/apache/spark/pull/1165#discussion_r14837879
--- Diff: core/src/main/scala/org/apache/spark/CacheManager.scala ---
@@ -140,14 +144,39 @@ private[spark] class CacheManager(blockManager:
BlockManager) ext
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1346#issuecomment-48771573
QA tests have started for PR 1346. This patch merges cleanly. View
progress:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/16572/consoleFull
---
If
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/1360#issuecomment-48773641
QA results for PR 1360:- This patch FAILED unit tests.- This patch
merges cleanly- This patch adds no public classesFor more
information see test
ouptut:https://amplab.c
Github user mridulm commented on the pull request:
https://github.com/apache/spark/pull/1363#issuecomment-48774986
On the contrary, we should remove all filesystem.close() in spark : since
shutdown hooks commit/flush pending messages to hdfs.
filesystem object's are typically globa
Github user mridulm commented on the pull request:
https://github.com/apache/spark/pull/1212#issuecomment-48776662
s/not/now/ :-)
As in, to test the expected change in behavior for a specific host before
rack_local host gets added the schedules should be to ANY; and after maki
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/1367#discussion_r14842782
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/stat/correlation/Correlation.scala
---
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/1367#discussion_r14842983
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/stat/correlation/Correlation.scala
---
@@ -0,0 +1,121 @@
+/*
+ * Licensed to the Apache Software
Github user ueshin commented on the pull request:
https://github.com/apache/spark/pull/1373#issuecomment-48781530
@marmbrus Yes, I think so.
But this new behavior is the same as Avro, Thrift and the next Hive (0.14).
To load the string data saved with previous versions, `Cast` t
Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/1341#issuecomment-48781673
LGTM.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled an
1 - 100 of 194 matches
Mail list logo