[GitHub] spark pull request: [SPARK-9926] [SPARK-10340] [SQL] Use S3 bulk l...

2015-09-04 Thread ewan-realitymine
Github user ewan-realitymine commented on the pull request: https://github.com/apache/spark/pull/8512#issuecomment-137672455 This change is Hive specific, but could it also apply to Parquet files stored on s3 with large numbers of part files? --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-10227] fatal warnings with sbt on Scala...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8433#issuecomment-137673141 [Test build #1719 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1719/consoleFull) for PR 8433 at commit [`0408404`](https://git

[GitHub] spark pull request: [SPARK-10227] fatal warnings with sbt on Scala...

2015-09-04 Thread dragos
Github user dragos commented on a diff in the pull request: https://github.com/apache/spark/pull/8433#discussion_r38729165 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -24,6 +24,7 @@ import java.util.{Collections, ArrayList => JArrayList, List =

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-137678830 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-137678811 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/spark/pull/8598 SPARK-10445: Extend Maven version (enforcer) You can merge this pull request into a Git repository by running: $ git pull https://github.com/jbonofre/spark SPARK-10445 Alternatively you can

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8598#issuecomment-137680516 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-137680766 [Test build #41995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41995/consoleFull) for PR 8349 at commit [`231c810`](https://gith

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/8599 [SPARK-10437][SQ] Support aggregation expressions in Order By JIRA: https://issues.apache.org/jira/browse/SPARK-10437 If an expression in `SortOrder` is a resolved one, such as `count(1)`, th

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137683103 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137683078 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137684190 [Test build #41996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41996/consoleFull) for PR 8599 at commit [`452cfb5`](https://gith

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8598#issuecomment-137684318 No, we require 3.3.3 explicitly to work around some problems with Maven 3.2. `build/mvn` downloads it for you though. Do you mind closing this PR? --- If your project is

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread jbonofre
Github user jbonofre commented on the pull request: https://github.com/apache/spark/pull/8598#issuecomment-137684872 Allright, weird, as it works with Maven 3.2.5 for me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread jbonofre
Github user jbonofre closed the pull request at: https://github.com/apache/spark/pull/8598 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark pull request: [SPARK-10199][SPARK-10200][SPARK-10201][SPARK-...

2015-09-04 Thread vinodkc
Github user vinodkc commented on a diff in the pull request: https://github.com/apache/spark/pull/8507#discussion_r38733907 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeansModel.scala --- @@ -125,16 +126,19 @@ object KMeansModel extends Loader[KMeansModel] {

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8598#issuecomment-137686197 Yeah it 99% works -- I recall that the problem was a little bit subtle, some problem with dependencies or artifacts, and maybe only affects a small number of use cases, b

[GitHub] spark pull request: [SPARK-10199][SPARK-10200][SPARK-10201][SPARK-...

2015-09-04 Thread vinodkc
Github user vinodkc commented on the pull request: https://github.com/apache/spark/pull/8507#issuecomment-137686626 @feynmanliang , I've removed case classes used for schema inference. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: SPARK-10445: Extend Maven version (enforcer)

2015-09-04 Thread jbonofre
Github user jbonofre commented on the pull request: https://github.com/apache/spark/pull/8598#issuecomment-137692450 It makes sense, thanks ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/8600 [SPARK-10446][SQL] Support to specify join type when calling join with usingColumns JIRA: https://issues.apache.org/jira/browse/SPARK-10446 Currently the method `join(right: DataFrame, using

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137695938 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137695988 [Test build #41997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41997/consoleFull) for PR 8600 at commit [`8ff97ed`](https://gith

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137695913 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-1061] assumePartitioned

2015-09-04 Thread rapen
Github user rapen commented on the pull request: https://github.com/apache/spark/pull/4449#issuecomment-137697278 @danielhaviv , see tests in PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-10227] fatal warnings with sbt on Scala...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8433#issuecomment-137698769 [Test build #1719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1719/console) for PR 8433 at commit [`0408404`](https://github

[GitHub] spark pull request: [SPARK-10227] fatal warnings with sbt on Scala...

2015-09-04 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/8433#issuecomment-137707108 Aside from possible removing those imports, yes, this looks good to me for master/1.6. --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137708779 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137708683 [Test build #41996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41996/console) for PR 8599 at commit [`452cfb5`](https://github.

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137708777 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-137709964 [Test build #41995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41995/console) for PR 8349 at commit [`231c810`](https://github.

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38742310 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/SimpleTextRelation.scala --- @@ -112,11 +114,14 @@ class SimpleTextRelation( val fi

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-137710055 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41

[GitHub] spark pull request: [SPARK-9669][MESOS] Support PySpark on Mesos c...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8349#issuecomment-137710050 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38742367 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -100,6 +104,87 @@ abstract class HadoopFsRelationTest ex

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38742692 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -100,6 +104,87 @@ abstract class HadoopFsRelationTest ex

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38742782 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -100,6 +104,87 @@ abstract class HadoopFsRelationTest ex

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38742485 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -100,6 +104,87 @@ abstract class HadoopFsRelationTest ex

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38742967 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -100,6 +104,87 @@ abstract class HadoopFsRelationTest ex

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8597#issuecomment-137714184 Generally looks good except for a few minor issues. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137715324 [Test build #41997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41997/console) for PR 8600 at commit [`8ff97ed`](https://github.

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137715358 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137715359 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41

[GitHub] spark pull request: [SPARK-10227] fatal warnings with sbt on Scala...

2015-09-04 Thread skyluc
Github user skyluc commented on a diff in the pull request: https://github.com/apache/spark/pull/8433#discussion_r38743996 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -24,6 +24,7 @@ import java.util.{Collections, ArrayList => JArrayList, List =

[GitHub] spark pull request: [SQL] SPARK-6981: Factor out SparkPlanner and ...

2015-09-04 Thread evacchi
Github user evacchi commented on the pull request: https://github.com/apache/spark/pull/6356#issuecomment-137717489 @marmbrus I have brought this up to date. Might need fixes in order to merge cleanly, though --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-10310][SQL]Using \t as the field delime...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8476#discussion_r38745091 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -429,7 +429,8 @@ class HiveQuerySuite extends HiveCompari

[GitHub] spark pull request: [SPARK-10310][SQL]Using \t as the field delime...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8476#discussion_r38745663 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/ScriptTransformation.scala --- @@ -58,6 +61,9 @@ case class ScriptTransformation(

[GitHub] spark pull request: [SPARK-10310][SQL]Using \t as the field delime...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8476#discussion_r38745795 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/ScriptTransformation.scala --- @@ -290,7 +300,9 @@ case class HiveScriptIOSchema (

[GitHub] spark pull request: [SPARK-10310][SQL]Using \t as the field delime...

2015-09-04 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8476#issuecomment-137723720 @zhichao-li Could you please add a test case that explicit checks for the output format of a transformation query? --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-137725481 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-137725498 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10310][SQL]Using \t as the field delime...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8476#discussion_r38747088 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/ScriptTransformation.scala --- @@ -328,23 +361,27 @@ case class HiveScriptIOSchema (

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-137726639 [Test build #41998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41998/consoleFull) for PR 8537 at commit [`8660d0e`](https://gith

[GitHub] spark pull request: [SPARK-10310][SQL]Using \t as the field delime...

2015-09-04 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8476#issuecomment-137726968 I'm not super familiar with the script transformation feature. If I understand this problem correctly, in prior versions, we doesn't support `RECORDREADER` or `RECORDW

[GitHub] spark pull request: [SPARK-9170][SQL] Use OrcStructInspector to be...

2015-09-04 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7520#issuecomment-137728254 @viirya Oh sorry. It would be nice if you ping me after you updated your PR next time :) --- If your project is set up for it, you can reply to this email and have yo

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7971#discussion_r38748233 --- Diff: core/src/test/scala/org/apache/spark/SparkFunSuite.scala --- @@ -44,5 +49,27 @@ private[spark] abstract class SparkFunSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-137737040 [Test build #41998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41998/console) for PR 8537 at commit [`8660d0e`](https://github.

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-137737175 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8537#issuecomment-137737181 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41

[GitHub] spark pull request: [SPARK-10192] [core] simple test w/ failure in...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8402#issuecomment-137745447 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10192] [core] simple test w/ failure in...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8402#issuecomment-137745469 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137745960 Sorry Andrew, I certainly didn't mean to imply that I knew your opinion on this particular patch -- as Sean said, I was just trying to point out the general situation. M

[GitHub] spark pull request: [SPARK-10192] [core] simple test w/ failure in...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8402#issuecomment-137746771 [Test build #41999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41999/consoleFull) for PR 8402 at commit [`cfcf4e6`](https://gith

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137751364 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137751393 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9652][CORE] Added method for Avro file ...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7971#issuecomment-137751981 [Test build #42000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42000/consoleFull) for PR 7971 at commit [`bc8f2be`](https://gith

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137752570 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137752519 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10446][SQL] Support to specify join typ...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8600#issuecomment-137754680 [Test build #42001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42001/consoleFull) for PR 8600 at commit [`efe069a`](https://gith

[GitHub] spark pull request: [SPARK-10301] [SQL] Fixes schema merging for n...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8509#discussion_r38760022 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystReadSupport.scala --- @@ -160,4 +101,168 @@ private[parquet] o

[GitHub] spark pull request: [SPARK-10301] [SQL] Fixes schema merging for n...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8509#discussion_r38760227 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystRowConverter.scala --- @@ -179,31 +154,7 @@ private[parquet] c

[GitHub] spark pull request: [SPARK-10301] [SQL] Fixes schema merging for n...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8509#discussion_r38761117 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaSuite.scala --- @@ -941,4 +942,313 @@ class ParquetSchema

[GitHub] spark pull request: [SPARK-9926] [SPARK-10340] [SQL] Use S3 bulk l...

2015-09-04 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8512#issuecomment-137765159 @ewan-realitymine, yeah, that is @davies point about `HadoopFsRelation`. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8599#discussion_r38762488 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -561,7 +561,7 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8599#discussion_r38762581 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -1519,6 +1519,19 @@ class SQLQuerySuite extends QueryTest with SharedSQLC

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8599#discussion_r38764470 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -1519,6 +1519,19 @@ class SQLQuerySuite extends QueryTest with SharedSQLCont

[GitHub] spark pull request: [SPARK-10301] [SQL] Fixes schema merging for n...

2015-09-04 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/8509#discussion_r38764680 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/CatalystReadSupport.scala --- @@ -160,4 +101,168 @@ private[parquet] o

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765752 --- Diff: mllib/src/main/scala/org/apache/spark/ml/source/libsvm/LibSVMRelation.scala --- @@ -0,0 +1,101 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765912 --- Diff: mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765946 --- Diff: mllib/src/test/scala/org/apache/spark/ml/source/LibSVMRelationSuite.scala --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765935 --- Diff: mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765932 --- Diff: mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765957 --- Diff: mllib/src/test/scala/org/apache/spark/ml/source/LibSVMRelationSuite.scala --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765918 --- Diff: mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765954 --- Diff: mllib/src/test/scala/org/apache/spark/ml/source/LibSVMRelationSuite.scala --- @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8599#discussion_r3878 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -561,7 +561,7 @@ class Analyzer( }

[GitHub] spark pull request: [SPARK-10117][MLLIB] Implement SQL data source...

2015-09-04 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/8537#discussion_r38765916 --- Diff: mllib/src/test/java/org/apache/spark/ml/source/JavaLibSVMRelationSuite.java --- @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137778499 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137778493 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137778525 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137778526 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10437][SQ] Support aggregation expressi...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8599#issuecomment-137778681 [Test build #42003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42003/consoleFull) for PR 8599 at commit [`e65f4db`](https://gith

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137779452 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137779431 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137780768 [Test build #42004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42004/consoleFull) for PR 8180 at commit [`bb5190f`](https://gith

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137781454 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137781457 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137781690 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137781452 [Test build #42004 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/42004/console) for PR 8180 at commit [`bb5190f`](https://github.

[GitHub] spark pull request: [SPARK-10441][SQL] Save data correctly to json...

2015-09-04 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8597#discussion_r38769233 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -100,6 +104,87 @@ abstract class HadoopFsRelationTest extend

[GitHub] spark pull request: [SPARK-9851] Support submitting map stages ind...

2015-09-04 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8180#issuecomment-137781689 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

  1   2   3   4   5   >