[GitHub] spark pull request #13189: [SPARK-14670][SQL] allow updating driver side sql...

2016-06-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13189 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13189: [SPARK-14670][SQL] allow updating driver side sql metric...

2016-06-08 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/13189 LGTM, merging this into master and 2.0, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13546: [SPARK-15808] [SQL] File Format Checking When Appending ...

2016-06-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13546 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #60223 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60223/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60219/ Test PASSed. ---

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13518 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13518 **[Test build #60219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60219/consoleFull)** for PR 13518 at commit

[GitHub] spark pull request #13531: [SPARK-15654] [SQL] fix non-splitable files for t...

2016-06-08 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/13531#discussion_r66383788 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala --- @@ -298,6 +309,28 @@ trait FileFormat { }

[GitHub] spark issue #7841: [SPARK-8992] [SQL] Add pivot to dataframe api

2016-06-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/7841 @aray this pull request was highlighted in http://www.slideshare.net/databricks/deep-dive-into-catalyst-apache-spark-20s-optimizer --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked sbt-pom...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13564 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60216/ Test PASSed. ---

[GitHub] spark issue #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked sbt-pom...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13564 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked sbt-pom...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13564 **[Test build #60216 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60216/consoleFull)** for PR 13564 at commit

[GitHub] spark issue #13567: [Minor][Doc] In Dataset Docs, Remove self link to Datase...

2016-06-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13567 LGTM pending tests. can you update the title to say "[Minor][Doc] In Dataset docs, remove self link to Dataset and add link to Column" --- If your project is set up for it, you can

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-08 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13555 LGTM, pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF...

2016-06-08 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/13563#discussion_r66383126 --- Diff: core/src/main/scala/org/apache/spark/rdd/PipedRDD.scala --- @@ -129,7 +130,7 @@ private[spark] class PipedRDD[T: ClassTag]( override

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13555 **[Test build #60222 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60222/consoleFull)** for PR 13555 at commit

[GitHub] spark pull request #13555: [SPARK-15804][SQL]Include metadata in the toStruc...

2016-06-08 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/13555#discussion_r66383008 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala --- @@ -625,6 +625,21 @@ class

[GitHub] spark issue #13567: [Minor][Doc] In Dataset Docs, Remove self link to Datase...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13567 **[Test build #60221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60221/consoleFull)** for PR 13567 at commit

[GitHub] spark issue #13567: [Minor][Doc] In Dataset Docs, Remove self link to Datase...

2016-06-08 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/13567 @rxin Done 👍 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60215/ Test PASSed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #60215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60215/consoleFull)** for PR 13065 at commit

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-08 Thread sadikovi
Github user sadikovi commented on the issue: https://github.com/apache/spark/pull/13563 @tejasapatil Can you also hard-code UTF-8 for `stderr`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #13567: [Minor][Doc] Dataset.reduce Scaladoc Link to Dataset

2016-06-08 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/13567 @rxin Sure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #13567: [Minor][Doc] Dataset.reduce Scaladoc Link to Dataset

2016-06-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13567 Alright do you want to update the pr to remove them instead? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #13555: [SPARK-15804][SQL]Include metadata in the toStruc...

2016-06-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13555#discussion_r66381875 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala --- @@ -625,6 +625,21 @@ class

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13558 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60220/ Test FAILed. ---

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13558 **[Test build #60220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60220/consoleFull)** for PR 13558 at commit

[GitHub] spark issue #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked sbt-pom...

2016-06-08 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/13564 Thanks for doing this. It will definitely save time, and some CPU cycles(energy) for all the first time builds. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13558 **[Test build #60220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60220/consoleFull)** for PR 13558 at commit

[GitHub] spark issue #13558: [SPARK-15820][PySpark][SQL]Add Catalog.refreshTable into...

2016-06-08 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/13558 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-06-08 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/12913 ping @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13567: [Minor][Doc] Dataset.reduce Scaladoc Link to Dataset

2016-06-08 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/13567 @rxin I'm also biased on not doing self-links, but there are already so many self-links on datasets docs So we should either remove those or add these to make everything consistent. --- If

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13518 **[Test build #60219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60219/consoleFull)** for PR 13518 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13518 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13518 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60218/ Test PASSed. ---

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13518 **[Test build #60218 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60218/consoleFull)** for PR 13518 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13518 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13518 **[Test build #60218 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60218/consoleFull)** for PR 13518 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13518 **[Test build #60217 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60217/consoleFull)** for PR 13518 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13518 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60217/ Test FAILed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60214/ Test FAILed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #60214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60214/consoleFull)** for PR 13065 at commit

[GitHub] spark issue #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked sbt-pom...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13564 **[Test build #60216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60216/consoleFull)** for PR 13564 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13518 **[Test build #60217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60217/consoleFull)** for PR 13518 at commit

[GitHub] spark issue #13518: [WIP][SPARK-15472][SQL] Add support for writing in `csv`...

2016-06-08 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/13518 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #13518: [WIP][SPARK-15472][SQL] Add support for writing i...

2016-06-08 Thread lw-lin
GitHub user lw-lin reopened a pull request: https://github.com/apache/spark/pull/13518 [WIP][SPARK-15472][SQL] Add support for writing in `csv`, `json`, `text` formats in Structured Streaming ## What changes were proposed in this pull request? This patch adds support for

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60213/ Test PASSed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #60213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60213/consoleFull)** for PR 13065 at commit

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #60215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60215/consoleFull)** for PR 13065 at commit

[GitHub] spark issue #13565: [SPARK-15783][CORE] Fix Flakiness in BlacklistIntegratio...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13565 **[Test build #3072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3072/consoleFull)** for PR 13565 at commit

[GitHub] spark issue #13566: [SPARK-15678] Add support to REFRESH data source paths

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13566 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60212/ Test PASSed. ---

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/13065 Here are the code dumps for all the generator paths. # Setup ```scala val df = spark.range(1 << 20).selectExpr( "id as key", "array(rand(), rand(),

[GitHub] spark issue #13566: [SPARK-15678] Add support to REFRESH data source paths

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13566 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13566: [SPARK-15678] Add support to REFRESH data source paths

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13566 **[Test build #60212 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60212/consoleFull)** for PR 13566 at commit

[GitHub] spark issue #13565: [SPARK-15783][CORE] Fix Flakiness in BlacklistIntegratio...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13565 **[Test build #3071 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3071/consoleFull)** for PR 13565 at commit

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13555 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60211/ Test PASSed. ---

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13555 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13555 **[Test build #60211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60211/consoleFull)** for PR 13555 at commit

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13563 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13563 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60209/ Test PASSed. ---

[GitHub] spark issue #13563: [SPARK-15826] [CORE] PipedRDD to strictly use UTF-8 and ...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13563 **[Test build #60209 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60209/consoleFull)** for PR 13563 at commit

[GitHub] spark pull request #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked ...

2016-06-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13564#discussion_r66371769 --- Diff: project/plugins.sbt --- @@ -21,3 +21,14 @@ libraryDependencies += "org.ow2.asm" % "asm" % "5.0.3" libraryDependencies += "org.ow2.asm" %

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #60214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60214/consoleFull)** for PR 13065 at commit

[GitHub] spark issue #13424: [SPARK-15489][SQL] Dataset kryo encoder won't load custo...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13424 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60208/ Test PASSed. ---

[GitHub] spark issue #13424: [SPARK-15489][SQL] Dataset kryo encoder won't load custo...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13424 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13424: [SPARK-15489][SQL] Dataset kryo encoder won't load custo...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13424 **[Test build #60208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60208/consoleFull)** for PR 13424 at commit

[GitHub] spark pull request #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked ...

2016-06-08 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13564#discussion_r66369823 --- Diff: project/plugins.sbt --- @@ -21,3 +21,14 @@ libraryDependencies += "org.ow2.asm" % "asm" % "5.0.3" libraryDependencies += "org.ow2.asm" %

[GitHub] spark pull request #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked ...

2016-06-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13564#discussion_r66369515 --- Diff: project/plugins.sbt --- @@ -21,3 +21,14 @@ libraryDependencies += "org.ow2.asm" % "asm" % "5.0.3" libraryDependencies += "org.ow2.asm" %

[GitHub] spark issue #13065: [SPARK-15214][SQL] Code-generation for Generate

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13065 **[Test build #60213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60213/consoleFull)** for PR 13065 at commit

[GitHub] spark pull request #13564: [SPARK-15827][BUILD][WIP] Publish Spark's forked ...

2016-06-08 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13564#discussion_r66369245 --- Diff: project/plugins.sbt --- @@ -21,3 +21,14 @@ libraryDependencies += "org.ow2.asm" % "asm" % "5.0.3" libraryDependencies += "org.ow2.asm" %

[GitHub] spark issue #13569: [SPARK-15791] Fix NPE in ScalarSubquery

2016-06-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13569 Can you try create a unit test? Maybe it's related to ConvertToLocalRelation --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13570: [SPARK-15832][SQL] Embedded IN/EXISTS predicate subquery...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13570 **[Test build #3070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3070/consoleFull)** for PR 13570 at commit

[GitHub] spark issue #13569: [SPARK-15791] Fix NPE in ScalarSubquery

2016-06-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13569 It's possible this was going through the local execution short-cut? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13147: [SPARK-6320][SQL] Move planLater method into GenericStra...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13147 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60207/ Test PASSed. ---

[GitHub] spark issue #13147: [SPARK-6320][SQL] Move planLater method into GenericStra...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13147 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13147: [SPARK-6320][SQL] Move planLater method into GenericStra...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13147 **[Test build #60207 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60207/consoleFull)** for PR 13147 at commit

[GitHub] spark issue #13496: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from ...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13496 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60206/ Test PASSed. ---

[GitHub] spark issue #13496: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from ...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13496 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13496: [SPARK-15753][SQL] Move Analyzer stuff to Analyzer from ...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13496 **[Test build #60206 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60206/consoleFull)** for PR 13496 at commit

[GitHub] spark issue #13566: [SPARK-15678] Add support to REFRESH data source paths

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13566 **[Test build #60212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60212/consoleFull)** for PR 13566 at commit

[GitHub] spark issue #13566: [SPARK-15678] Add support to REFRESH data source paths

2016-06-08 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/13566 Thanks, I pulled it out in a separate function. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #13555: [SPARK-15804][SQL]Include metadata in the toStructType

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13555 **[Test build #60211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60211/consoleFull)** for PR 13555 at commit

[GitHub] spark pull request #13555: [SPARK-15804][SQL]Include metadata in the toStruc...

2016-06-08 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/13555#discussion_r66366855 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala --- @@ -625,6 +625,21 @@ class

[GitHub] spark pull request #13555: [SPARK-15804][SQL]Include metadata in the toStruc...

2016-06-08 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/13555#discussion_r66366487 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala --- @@ -625,6 +625,21 @@ class

[GitHub] spark issue #13565: [SPARK-15783][CORE] Fix Flakiness in BlacklistIntegratio...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13565 **[Test build #3072 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3072/consoleFull)** for PR 13565 at commit

[GitHub] spark pull request #13555: [SPARK-15804][SQL]Include metadata in the toStruc...

2016-06-08 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/13555#discussion_r66366470 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetQuerySuite.scala --- @@ -625,6 +625,21 @@ class

[GitHub] spark issue #13565: [SPARK-15783][CORE] Fix Flakiness in BlacklistIntegratio...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13565 **[Test build #3071 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3071/consoleFull)** for PR 13565 at commit

[GitHub] spark issue #13569: [SPARK-15791] Fix NPE in ScalarSubquery

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13569 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60205/ Test PASSed. ---

[GitHub] spark issue #13569: [SPARK-15791] Fix NPE in ScalarSubquery

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13569 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13569: [SPARK-15791] Fix NPE in ScalarSubquery

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13569 **[Test build #60205 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60205/consoleFull)** for PR 13569 at commit

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60210/ Test FAILed. ---

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-06-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #60210 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60210/consoleFull)** for PR 13571 at commit

[GitHub] spark issue #13189: [SPARK-14670][SQL] allow updating driver side sql metric...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13189 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60204/ Test PASSed. ---

[GitHub] spark issue #13189: [SPARK-14670][SQL] allow updating driver side sql metric...

2016-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13189 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

  1   2   3   4   5   >