[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/7280#discussion_r34256453 --- Diff: R/pkg/inst/tests/test_sparkSQL.R --- @@ -108,6 +108,14 @@ test_that(create DataFrame from RDD, { expect_equal(count(df), 10)

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-09 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/6762#discussion_r34261344 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala --- @@ -188,6 +189,302 @@ case class

[GitHub] spark pull request: [SPARK-6266][MLLIB] PySpark SparseVector missi...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7290#issuecomment-120003811 [Test build #36929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36929/console) for PR 7290 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120017981 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6266][MLLIB] PySpark SparseVector missi...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7290#issuecomment-119982957 [Test build #36929 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36929/consoleFull) for PR 7290 at commit

[GitHub] spark pull request: [SPARK-6266][MLLIB] PySpark SparseVector missi...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7290#issuecomment-120004049 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8938][SQL] Implement toString for Inter...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7315#issuecomment-119979661 [Test build #36931 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36931/consoleFull) for PR 7315 at commit

[GitHub] spark pull request: [SPARK-7419][Streaming][Tests]Fix CheckpointSu...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7323#issuecomment-119979669 [Test build #36930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36930/consoleFull) for PR 7323 at commit

[GitHub] spark pull request: [SPARK-8953] SPARK_EXECUTOR_CORES has no effec...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7322#issuecomment-119979139 [Test build #36928 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36928/consoleFull) for PR 7322 at commit

[GitHub] spark pull request: [SPARK-8881] Fix algorithm for scheduling exec...

2015-07-09 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/7274#issuecomment-119992509 EventLoggingListenerSuite seems to be failing regularly. Does it pass when you run locally? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120008278 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120008317 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-120015796 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-120015905 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-120015605 New screenshot: img width=1350 alt=g7 src=https://cloud.githubusercontent.com/assets/1000778/8598561/e483bb78-268d-11e5-8558-313c9b797fd3.png; --- If your

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120009003 [Test build #36933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36933/consoleFull) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-7419][Streaming][Tests]Fix CheckpointSu...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7323#issuecomment-120012952 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8870][MLlib]Use SQLContext.getOrCreate ...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7321#issuecomment-120029748 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8870][MLlib]Use SQLContext.getOrCreate ...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7321#issuecomment-120029709 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120026390 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120026499 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6762#issuecomment-120036882 [Test build #36938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36938/consoleFull) for PR 6762 at commit

[GitHub] spark pull request: [SPARK-8899][SQL] remove duplicated equals met...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7291#issuecomment-119983658 [Test build #36927 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36927/consoleFull) for PR 7291 at commit

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-119983368 [Test build #36932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36932/consoleFull) for PR 7081 at commit

[GitHub] spark pull request: [SPARK-8955][SQL] Replace a duplicated initial...

2015-07-09 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/7324 [SPARK-8955][SQL] Replace a duplicated initialize() in HiveGenericUDTF with new one HiveGenericUDTF#initialize(ObjectInspector[] argOIs) in v0.13.1 is duplicated, so it needs to be replaced with

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-119976433 **[Test build #36925 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36925/console)** for PR 7081 at commit

[GitHub] spark pull request: [SPARK-8851][YARN] In Yarn client mode, Client...

2015-07-09 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/7255#issuecomment-120014816 I totally missed that. Basically the problem is that the AM is the one that re-logs in and the executors do to, but in the client mode the driver never does,

[GitHub] spark pull request: [SPARK-8870][MLlib]Use SQLContext.getOrCreate ...

2015-07-09 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/7321#issuecomment-120031377 Does this work when we use multiple SparkContext in one application? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120017949 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120020087 [Test build #36935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36935/consoleFull) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-8870][MLlib]Use SQLContext.getOrCreate ...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7321#issuecomment-120031463 [Test build #36937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36937/consoleFull) for PR 7321 at commit

[GitHub] spark pull request: [SPARK-8899][SQL] remove duplicated equals met...

2015-07-09 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/7291#discussion_r34256804 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala --- @@ -363,6 +364,70 @@ trait Row extends Serializable { false }

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-119977698 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8899][SQL] remove duplicated equals met...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7291#issuecomment-119977694 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6266][MLLIB] PySpark SparseVector missi...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7290#issuecomment-119977693 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7419][Streaming][Tests]Fix CheckpointSu...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7323#issuecomment-119977696 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120009392 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120009384 [Test build #36933 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36933/console) for PR 7258 at commit

[GitHub] spark pull request: [SPARK-7419][Streaming][Tests]Fix CheckpointSu...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7323#issuecomment-120012652 [Test build #36930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36930/console) for PR 7323 at commit

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-120016532 [Test build #36934 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36934/consoleFull) for PR 6672 at commit

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6762#issuecomment-120036165 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8247][SPARK-8249][SPARK-8252][SPARK-825...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6762#issuecomment-120036134 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8955][SQL] Replace a duplicated initial...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7324#issuecomment-120044203 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8955][SQL] Replace a duplicated initial...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7324#issuecomment-120044152 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34269648 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala --- @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34269691 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala --- @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34269685 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala --- @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120048076 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8313] R Spark packages support

2015-07-09 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-120055421 Thanks @brkyvz for the update. @sun-rui Could you also take a look at this ? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120055482 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8938][SQL] Implement toString for Inter...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7315#issuecomment-120057120 [Test build #36931 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36931/console) for PR 7315 at commit

[GitHub] spark pull request: [SPARK-8938][SQL] Implement toString for Inter...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7315#issuecomment-120057245 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7241#discussion_r34273509 --- Diff: dev/lint-python --- @@ -61,13 +79,28 @@ else fi if [ $lint_status -ne 0 ]; then -echo Python lint checks failed. +

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread zhangjiajin
Github user zhangjiajin commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120057018 @mengxr I don't know why method 2 is projection before filtering. I think the method two is exactly what you want. The only need to add functionality to the current

[GitHub] spark pull request: [SPARK-8953] SPARK_EXECUTOR_CORES has no effec...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7322#issuecomment-120059794 [Test build #36928 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36928/console) for PR 7322 at commit

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120066421 Also, does the pylint file need to be named `.pylintrc` with a dot in order to be picked up by the default pylint script? --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-8938][SQL] Implement toString for Inter...

2015-07-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7315#issuecomment-120071555 Thanks - merging this in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34269706 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala --- @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34269635 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala --- @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-8870][MLlib]Use SQLContext.getOrCreate ...

2015-07-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7321#issuecomment-120046214 @sarutak We use the SparkContext from input, just not creating new SQLContexts. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-8899][SQL] remove duplicated equals met...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7291#issuecomment-120047647 [Test build #36927 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36927/console) for PR 7291 at commit

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120048001 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8899][SQL] remove duplicated equals met...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7291#issuecomment-120047887 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8870][MLlib]Use SQLContext.getOrCreate ...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7321#issuecomment-120047567 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7241#discussion_r34272490 --- Diff: dev/lint-python --- @@ -61,13 +79,28 @@ else fi if [ $lint_status -ne 0 ]; then -echo Python lint checks failed. +

[GitHub] spark pull request: [SPARK-8931] [SQL] Fallback to interpreted eva...

2015-07-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7309 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7241#discussion_r34273268 --- Diff: dev/lint-python --- @@ -47,6 +48,23 @@ if [ ! -e $PEP8_SCRIPT_PATH ]; then fi fi +# Easy install pylint in /dev/pylint. To

[GitHub] spark pull request: [SPARK-8401] [Build] Scala version switching b...

2015-07-09 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/6832#discussion_r34274335 --- Diff: dev/change-version-to-2.11.sh --- @@ -17,10 +17,4 @@ # limitations under the License. # -# Note that this will not necessarily

[GitHub] spark pull request: [SPARK-8953] SPARK_EXECUTOR_CORES has no effec...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7322#issuecomment-120060015 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120067041 [Test build #36944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36944/consoleFull) for PR 7241 at commit

[GitHub] spark pull request: [SPARK-8313] R Spark packages support

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-120067670 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8926][SQL] Code review followup.

2015-07-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8948][SQL] Remove ExtractValueWithOrdin...

2015-07-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7316 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120071106 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-120071524 [Test build #36934 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36934/console) for PR 6672 at commit

[GitHub] spark pull request: [SPARK-8953] SPARK_EXECUTOR_CORES has no effec...

2015-07-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/7322#issuecomment-120071606 I looked at the branch-1.3 version of the code, to make sure I didn't break this with the launcher refactoring... and the only place where this env variable is read is

[GitHub] spark pull request: [SPARK-4072][Core]Display Streaming blocks in ...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6672#issuecomment-120071821 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/7258#discussion_r34269699 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/fpm/PrefixSpan.scala --- @@ -0,0 +1,252 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-8863] [EC2] Check aws access key from a...

2015-07-09 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7252#issuecomment-120054514 Thanks for digging into this @JuhongPark -- I'm fine with the original PR but lets wait for @nchammas as he is more familiar with boto than I am --- If your project

[GitHub] spark pull request: [SPARK-8743] [Streaming]: Deregister Codahale ...

2015-07-09 Thread nssalian
Github user nssalian commented on a diff in the pull request: https://github.com/apache/spark/pull/7250#discussion_r34273553 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -297,6 +296,23 @@ class StreamingContextSuite extends

[GitHub] spark pull request: [SPARK-8830][SQL] native levenshtein distance

2015-07-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7236 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/7241#discussion_r34273675 --- Diff: python/pyspark/sql/tests.py --- @@ -238,7 +238,6 @@ def test_basic_functions(self): df = self.sqlCtx.jsonRDD(rdd)

[GitHub] spark pull request: [SPARK-8701][Streaming][WebUI] Add input metad...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7081#issuecomment-120060457 [Test build #36932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36932/console) for PR 7081 at commit

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120067766 [Test build #36944 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36944/console) for PR 7241 at commit

[GitHub] spark pull request: [SPARK-8313] R Spark packages support

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7139#issuecomment-120067619 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120067772 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8840][SparkR] Add float coercion on Spa...

2015-07-09 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/7280#discussion_r34277517 --- Diff: R/pkg/inst/tests/test_sparkSQL.R --- @@ -108,6 +108,14 @@ test_that(create DataFrame from RDD, { expect_equal(count(df), 10)

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120071048 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8919][Documentation, MLlib]Added @since...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7325#issuecomment-120075058 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8919][Documentation, MLlib]Added @since...

2015-07-09 Thread vinodkc
GitHub user vinodkc opened a pull request: https://github.com/apache/spark/pull/7325 [SPARK-8919][Documentation, MLlib]Added @since tags to mllib.recommendation You can merge this pull request into a Git repository by running: $ git pull https://github.com/vinodkc/spark

[GitHub] spark pull request: [SPARK-8863] [EC2] Check aws access key from a...

2015-07-09 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/7252#issuecomment-120077370 The current approach is fine with me, too. One last thing to do is perhaps tweak the error messages appropriately now that we are checking 2 places for credentials,

[GitHub] spark pull request: [SPARK-8863] [EC2] Check aws access key from a...

2015-07-09 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7252#issuecomment-120077899 Thanks @nchammas -- LGTM. Merging this --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8955][SQL] Replace a duplicated initial...

2015-07-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7324#issuecomment-120044582 [Test build #36939 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36939/consoleFull) for PR 7324 at commit

[GitHub] spark pull request: [SPARK-6487][MLlib] Add sequential pattern min...

2015-07-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/7258#issuecomment-120045016 @zhangjiajin Since you already collected the frequent items (length-1 patterns) to driver, you don't need to keep the RDD of length-1 patterns. When generating the final

[GitHub] spark pull request: [SPARK-8897][SPARKR] SparkR DataFrame fail to ...

2015-07-09 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7289#issuecomment-12005 @sun-rui Could you close this PR ? Only people who open the PR have permission to close it right now. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-8830][SQL] native levenshtein distance

2015-07-09 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/7236#issuecomment-120056881 @tarekauel Yes, we can remove that. I will do that while merging this. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread MechCoder
Github user MechCoder commented on a diff in the pull request: https://github.com/apache/spark/pull/7241#discussion_r34274569 --- Diff: python/pyspark/sql/tests.py --- @@ -238,7 +238,6 @@ def test_basic_functions(self): df = self.sqlCtx.jsonRDD(rdd)

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120066094 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8706] [PySpark] [Project infra] Add pyl...

2015-07-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/7241#issuecomment-120066183 I think easy_install should be available, but I suppose we'll find out soon now that we fail the lint checks if the installation fails. --- If your project is set up

[GitHub] spark pull request: [SPARK-8863] [EC2] Check aws access key from a...

2015-07-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   3   4   5   6   7   8   9   10   >