Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145724524
Are there any changes in this library's transitive dependency graph?
/cc @srown @pwendell for dependency changes / bumps.
---
If your project is set up for
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8973#issuecomment-145724991
[Test build #43268 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43268/consoleFull)
for PR 8973 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/8958
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145724773
Do you mind filing a JIRA for this change? See
https://issues.apache.org/jira/browse/SPARK and
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145724395
Jenkins, this is ok to test.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145726007
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145726049
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8973#issuecomment-145726838
[Test build #43268 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43268/console)
for PR 8973 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8991#issuecomment-145726882
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8973#issuecomment-145726840
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8991#issuecomment-145726797
[Test build #43265 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43265/console)
for PR 8991 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8973#issuecomment-145726841
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145726925
[Test build #43269 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43269/consoleFull)
for PR 8992 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8991#issuecomment-145726883
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user justinuang commented on a diff in the pull request:
https://github.com/apache/spark/pull/8318#discussion_r41221064
--- Diff: python/pyspark/pyspark_version.py ---
@@ -0,0 +1,17 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+#
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145727434
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145727424
[Test build #43269 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43269/console)
for PR 8992 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8992#issuecomment-145727432
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user zsxwing commented on the pull request:
https://github.com/apache/spark/pull/8950#issuecomment-145732880
New screenshot:
![3](https://cloud.githubusercontent.com/assets/1000778/10299535/bd291c50-6c1d-11e5-92c7-131c0630fad8.png)
---
If your project is set up for it,
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8950#issuecomment-145733024
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8950#issuecomment-145733038
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8950#issuecomment-145734108
[Test build #43270 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43270/consoleFull)
for PR 8950 at commit
Github user dilipbiswal commented on the pull request:
https://github.com/apache/spark/pull/8983#issuecomment-145734618
Can you please help clarify ? Are you referring to the case when one of the
value in the
in list is literal null like 1 in (1, NULL) ? If so, i don't think we
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/8990#discussion_r41224328
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala ---
@@ -319,6 +319,14 @@ private[spark] object SQLConf {
doc = "When true, some
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8978#issuecomment-145484131
[Test build #43236 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43236/console)
for PR 8978 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8958#issuecomment-145488634
[Test build #43237 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43237/consoleFull)
for PR 8958 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8958#issuecomment-145488143
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8958#issuecomment-145488113
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8978#issuecomment-145484244
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/8958#discussion_r41128455
--- Diff:
streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala
---
@@ -140,6 +140,27 @@ class StreamingListenerSuite extends
Github user zsxwing commented on a diff in the pull request:
https://github.com/apache/spark/pull/8950#discussion_r41128898
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/ui/BatchPage.scala ---
@@ -265,16 +323,20 @@ private[ui] class BatchPage(parent: StreamingTab)
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8976#issuecomment-145492004
[Test build #1841 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1841/consoleFull)
for PR 8976 at commit
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/8968#issuecomment-145525454
@srowen , what happened here, why was this closed, it looks like it was
committed but I don't see anyone +1. I was mostly good with it but it would
have been nice to
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8958#issuecomment-145497725
[Test build #43237 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43237/console)
for PR 8958 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8958#issuecomment-145497818
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8958#issuecomment-145497821
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/8934#issuecomment-145489665
ping @davies
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/8976#discussion_r41130010
--- Diff:
yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnRMClient.scala ---
@@ -49,10 +49,11 @@ private[spark] class YarnRMClient(args:
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/8976#issuecomment-145491891
@jerryshao @sryza do you have a thought on this one? looks OK to remove as
it's unused, but was there any hint of a plan to use it again at some point?
---
If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8978#issuecomment-145484242
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/8977#issuecomment-145488268
Looks generally OK to me, with a few questions. You might also build the
docs in docs/ with `SKIP_API=1 jekyll build` and spot-check your changes to
make sure they look
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8976#issuecomment-145494283
[Test build #1841 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1841/console)
for PR 8976 at commit
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/8968#issuecomment-145527571
Ah, I thought you had reviewed this and the previous iteration of this PR
also? seemed pretty cut and dried to me at this stage. I don't know how long to
wait for your
Github user crakjie commented on the pull request:
https://github.com/apache/spark/pull/1306#issuecomment-145531643
It's a nice start to code the scala `def
partition(p: (A) â Boolean): (List[A], List[A])` thanks
---
If your project is set up for it, you can reply to this email
Github user keypointt commented on the pull request:
https://github.com/apache/spark/pull/8977#issuecomment-145563969
@srowen thank you for the code review, I'll change the code lines you
mentioned above and test it out. :)
---
If your project is set up for it, you can reply to this
GitHub user ehnalis opened a pull request:
https://github.com/apache/spark/pull/8979
[SPARK-10797] RDD's coalesce should not write out the temporary key
I think we have the following options to solve this problem:
1. [General, but too complex] Create a new ShuffledRDD, add
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8979#issuecomment-145531065
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8956#issuecomment-145572774
[Test build #43238 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43238/consoleFull)
for PR 8956 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8981#issuecomment-145588517
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145590395
[Test build #43239 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43239/console)
for PR 8438 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145590443
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
GitHub user rick-ibm opened a pull request:
https://github.com/apache/spark/pull/8982
[SPARK-10855] [SQL] Add a JDBC dialect for Apache Derby
@marmbrus
@rxin
This patch adds a JdbcDialect class, which customizes the datatype mappings
for Derby backends. The patch also
Github user keypointt commented on a diff in the pull request:
https://github.com/apache/spark/pull/8977#discussion_r41161204
--- Diff: docs/mllib-statistics.md ---
@@ -86,6 +90,8 @@ System.out.println(summary.numNonzeros()); // number of
nonzeros in each column
which
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145584272
[Test build #43239 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43239/consoleFull)
for PR 8438 at commit
Github user mccheah commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145586843
Ok, we need to merge https://github.com/apache/spark/pull/8981 before
moving forward with this one.
---
If your project is set up for it, you can reply to this email
GitHub user mccheah opened a pull request:
https://github.com/apache/spark/pull/8981
[SPARK-10926][CORE] Create WeakReferenceCleaner interface that Contexâ¦
Preparing the way for SPARK-10250 which will introduce other objects
that will be cleaned via detecting their being
Github user bdolbeare commented on the pull request:
https://github.com/apache/spark/pull/8780#issuecomment-145598968
The problem with Oracle is that you can define numbers without providing
precision or scale:
column_name NUMBER (this is the only case that doesn't work
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/8747#discussion_r41169832
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java
---
@@ -0,0 +1,179 @@
+/*
+ * Licensed
Github user davies commented on the pull request:
https://github.com/apache/spark/pull/8747#issuecomment-145603625
LGTM, left some minor comments about coding style.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8977#issuecomment-145605344
[Test build #1842 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1842/consoleFull)
for PR 8977 at commit
Github user keypointt commented on a diff in the pull request:
https://github.com/apache/spark/pull/8977#discussion_r41160986
--- Diff: docs/mllib-linear-methods.md ---
@@ -230,6 +232,8 @@ Spark Java API uses a separate `JavaRDD` class. You can
convert a Java RDD to a
calling
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8981#issuecomment-145590342
[Test build #43240 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43240/consoleFull)
for PR 8981 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145590436
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8956#issuecomment-145571210
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user keypointt commented on a diff in the pull request:
https://github.com/apache/spark/pull/8977#discussion_r41161006
--- Diff: docs/mllib-frequent-pattern-mining.md ---
@@ -195,10 +202,12 @@ results.collect().foreach { rule =>
Github user mccheah commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145589235
Oh also spilling is now behind a feature flag.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AndriiOmelianenko commented on the pull request:
https://github.com/apache/spark/pull/4960#issuecomment-145593034
@tnachen Hi Tim,
any update here?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/8747#discussion_r41168642
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java
---
@@ -0,0 +1,179 @@
+/*
+ * Licensed
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/8747#discussion_r41170912
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala
---
@@ -393,10 +393,282 @@ object
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8980#issuecomment-145571202
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8956#issuecomment-145571273
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145583861
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user keypointt commented on the pull request:
https://github.com/apache/spark/pull/8977#issuecomment-145599194
Hi @srowen I've corrected what you mentioned, and added markdown level for
the divs missing markdown="1". I've run "jekyll build" and tested on my local
machine too.
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/8747#discussion_r41168782
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java
---
@@ -0,0 +1,179 @@
+/*
+ * Licensed
Github user travishegner commented on a diff in the pull request:
https://github.com/apache/spark/pull/8780#discussion_r41171411
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
---
@@ -66,9 +66,7 @@ private[sql] object JDBCRDD
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8971#issuecomment-145605320
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8971#issuecomment-145605359
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145583830
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user mccheah commented on the pull request:
https://github.com/apache/spark/pull/8438#issuecomment-145583716
@JoshRosen sorry I lagged a bit on this.
I refactored the commit structure to clean things up, but I think we want
ContextCleaner interface refactors to be its
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8982#issuecomment-145599419
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/8747#discussion_r41168843
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeArrayWriter.java
---
@@ -0,0 +1,179 @@
+/*
+ * Licensed
GitHub user alexrovner opened a pull request:
https://github.com/apache/spark/pull/8980
[SPARK-10617] [SQL] Fixed AddMonths leap year calculations
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/alexrovner/spark
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8981#issuecomment-145588604
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8981#issuecomment-145593738
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/8981#issuecomment-145593734
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/8981#issuecomment-145593680
[Test build #43240 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43240/console)
for PR 8981 at commit
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/8747#discussion_r41170167
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala
---
@@ -393,10 +393,282 @@ object
301 - 387 of 387 matches
Mail list logo