[GitHub] spark pull request: [SPARK-14176][SQL]Add DataFrameWriter.trigger ...

2016-03-28 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11976#issuecomment-202498781 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14208][SQL] Renames spark.sql.parquet.f...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12003#issuecomment-202499098 **[Test build #54327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54327/consoleFull)** for PR 12003 at commit

[GitHub] spark pull request: [SPARK-14208][SQL] Renames spark.sql.parquet.f...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12003#issuecomment-202499118 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11999#discussion_r57600937 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -549,15 +549,18 @@ class HDFSFileCatalog( refresh()

[GitHub] spark pull request: [SPARK-14134] [core] [test-maven] Change the p...

2016-03-28 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11941#issuecomment-202497917 You also need to update the flume's log4j files as it's moved back now. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-14169][Core]Add UninterruptibleThread

2016-03-28 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/11971#discussion_r57600647 --- Diff: core/src/main/scala/org/apache/spark/util/UninterruptibleThread.scala --- @@ -0,0 +1,106 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57600622 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JSONRelation.scala --- @@ -120,6 +122,39 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-13579][build][test-maven] Stop building...

2016-03-28 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-202496473 Aside from the above test I'm running, this should be ready for review. @srowen @JoshRosen could you guys take a look? --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-13579][build][test-maven] Stop building...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11796#issuecomment-202496381 **[Test build #54328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54328/consoleFull)** for PR 11796 at commit

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57600394 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57599911 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/TestJsonData.scala --- @@ -32,7 +32,7 @@ private[json] trait

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202495324 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14170] [infra] Simplify the PR template...

2016-03-28 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/11973#issuecomment-202495377 @rxin do you mean you prefer the style where people replace portions of the template with text? I can see why some would prefer that, but it makes a little

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202495312 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14147] [ML] [SparkR] SparkR predict sho...

2016-03-28 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/11958#issuecomment-202495150 Thanks, @yanboliang , this will solve the problem. It seems that the changeset includes only naive bayes and survival analysis. Can we also do the changes for kmeans

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202494895 **[Test build #54320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54320/consoleFull)** for PR 11557 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202495049 @sun-rui This PR have some conflict that fail the build, so reverted it, could you send another PR to fix that? --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-14208][SQL] Renames spark.sql.parquet.f...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12003#issuecomment-202494811 **[Test build #54327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54327/consoleFull)** for PR 12003 at commit

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11960#discussion_r57599706 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JSONRelation.scala --- @@ -120,6 +122,39 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202494317 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202494287 **[Test build #2701 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2701/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202494011 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11999#discussion_r57599100 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -549,15 +549,18 @@ class HDFSFileCatalog( refresh()

[GitHub] spark pull request: [SPARK-14208][SQL] Renames spark.sql.parquet.f...

2016-03-28 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/12003 [SPARK-14208][SQL] Renames spark.sql.parquet.fileScan ## What changes were proposed in this pull request? Renames SQL option `spark.sql.parquet.fileScan` since now all

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202492419 **[Test build #2701 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2701/consoleFull)** for PR 10947 at commit

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10947#issuecomment-202492245 LGTM, merging this into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-3724][MLLIB] RandomForest: More options...

2016-03-28 Thread yongtang
Github user yongtang commented on the pull request: https://github.com/apache/spark/pull/11989#issuecomment-202487601 cc @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57597324 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRelation.scala --- @@ -291,6 +291,7 @@ private[sql] class

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11999#discussion_r57597120 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -549,15 +549,18 @@ class HDFSFileCatalog( refresh()

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/11999#discussion_r57597049 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -549,15 +549,18 @@ class HDFSFileCatalog( refresh()

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202486518 LGTM (except the mima issue). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202485811 ``` [error] * the type hierarchy of class org.apache.spark.sql.Dataset is different in current version. Missing types {org.apache.spark.sql.execution.Queryable}

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202485017 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202485020 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57596762 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -91,6 +96,70 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202484686 **[Test build #54321 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54321/consoleFull)** for PR 11632 at commit

[GitHub] spark pull request: [SPARK-13742][Core] Add non-iterator interface...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11578 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13742][Core] Add non-iterator interface...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11578#issuecomment-202484431 Merging into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13742][Core] Add non-iterator interface...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11578#issuecomment-202484151 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202484260 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202484262 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202483946 **[Test build #54319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54319/consoleFull)** for PR 11720 at commit

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11999#discussion_r57595999 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/sources/interfaces.scala --- @@ -549,15 +549,18 @@ class HDFSFileCatalog( refresh()

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/12002#issuecomment-202483265 cc @marmbrus @yhuai @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57595668 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -113,8 +182,7 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57595515 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -91,6 +96,70 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57595420 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -91,6 +96,70 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57595359 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -91,6 +96,70 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202481762 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57595023 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -91,6 +96,70 @@ class DefaultSource extends

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202481765 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202481169 **[Test build #54318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54318/consoleFull)** for PR 11557 at commit

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57594757 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVRelation.scala --- @@ -49,14 +49,10 @@ object CSVRelation extends

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12002#issuecomment-202480562 **[Test build #54326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54326/consoleFull)** for PR 12002 at commit

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57594679 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -137,8 +131,7 @@ private[sql] object

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/12002#discussion_r57594467 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -78,14 +79,6 @@ private[sql] object

[GitHub] spark pull request: [SPARK-14206][SQL] buildReader() implementatio...

2016-03-28 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/12002 [SPARK-14206][SQL] buildReader() implementation for CSV ## What changes were proposed in this pull request? Major changes: 1. Implement `FileFormat.buildReader()` for the CSV

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202479528 **[Test build #54325 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54325/consoleFull)** for PR 12001 at commit

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202479590 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202479588 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14202][PYTHON] Use generator expression...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11998#issuecomment-202473862 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14202][PYTHON] Use generator expression...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11998#issuecomment-202473860 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202473941 **[Test build #54325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54325/consoleFull)** for PR 12001 at commit

[GitHub] spark pull request: [SPARK-14202][PYTHON] Use generator expression...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11998#issuecomment-202473716 **[Test build #54322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54322/consoleFull)** for PR 11998 at commit

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/12001#issuecomment-202473165 cc @liancheng @rxin @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-14205][SQL] remove trait Queryable

2016-03-28 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/12001 [SPARK-14205][SQL] remove trait Queryable ## What changes were proposed in this pull request? After DataFrame and Dataset are merged, the trait `Queryable` becomes unnecessary as it has

[GitHub] spark pull request: [SPARK-14204] [SQL] register driverClass rathe...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12000#issuecomment-202472162 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14204] [SQL] register driverClass rathe...

2016-03-28 Thread mchalek
GitHub user mchalek opened a pull request: https://github.com/apache/spark/pull/12000 [SPARK-14204] [SQL] register driverClass rather than user class This pull request fixes an issue in which cluster-mode executors fail to properly register a JDBC driver when the driver is provided

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-202470953 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-202470945 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10530] [CORE] Kill other task attempts ...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11996#issuecomment-202470303 **[Test build #54314 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54314/consoleFull)** for PR 11996 at commit

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2016-03-28 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/11943#issuecomment-202466140 @davies @JoshRosen Do you have any comment ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11999#issuecomment-202462960 **[Test build #54324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54324/consoleFull)** for PR 11999 at commit

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-28 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57589165 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -452,27 +451,15 @@ object SparkSubmit {

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11999#issuecomment-202461010 cc @marmbrus @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-14201][SQL] handle empty file for new d...

2016-03-28 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/11999 [SPARK-14201][SQL] handle empty file for new data source strategy ## What changes were proposed in this pull request? It's possible that users will write empty files to data dir. For

[GitHub] spark pull request: [SPARK-14158][SQL] implement buildReader for j...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11960#issuecomment-202459534 **[Test build #54323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54323/consoleFull)** for PR 11960 at commit

[GitHub] spark pull request: [SPARK-3533][Core] Add saveAsTextFileByKey() m...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8375#issuecomment-202458325 @saurfang This could be done easily with DataFrame APIs: ``` val df = rdd.map(t => Row(gen_key(t), t)).toDF("key", "text")

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2016-03-28 Thread JnyJny
Github user JnyJny commented on the pull request: https://github.com/apache/spark/pull/11943#issuecomment-202458241 I have tested this change on a host which does not support misaligned data access with a conf/spark-defaults.conf configured to request off heap memory. The host was

[GitHub] spark pull request: [SPARK-14202][PYTHON] Use generator expression...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11998#issuecomment-202456589 **[Test build #54322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54322/consoleFull)** for PR 11998 at commit

[GitHub] spark pull request: [SPARK-14202][PYTHON] Use generator expression...

2016-03-28 Thread zero323
GitHub user zero323 opened a pull request: https://github.com/apache/spark/pull/11998 [SPARK-14202][PYTHON] Use generator expression instead of list comp in python_full_outer_jo… ## What changes were proposed in this pull request? This PR replaces list comprehension in

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/11720#discussion_r57586861 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -286,6 +286,7 @@ class DAGScheduler( case None =>

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/11720#discussion_r57586226 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -286,6 +286,7 @@ class DAGScheduler( case None =>

[GitHub] spark pull request: [SPARK-14187][MLLIB] Fix incorrect use of bina...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11992 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14187][MLLIB] Fix incorrect use of bina...

2016-03-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11992#issuecomment-202442512 Merged into master, branch-1.6, and branch-1.5. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-14193][SQL] Skip unnecessary sorts if i...

2016-03-28 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/11997#issuecomment-202440622 I found we could't check a global sort of all partitions from `SprakPlan#outputOrdering`, so I'll fix this soon. --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-14086][SQL] Add DDL commands to ANTLR4 ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11905#issuecomment-202437009 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12181] Check Cached unaligned-access ca...

2016-03-28 Thread JnyJny
Github user JnyJny commented on the pull request: https://github.com/apache/spark/pull/11943#issuecomment-202439655 @tedyu Sorry, I haven't had the opportunity to test the change. I am hoping to get that done today. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-14086][SQL] Add DDL commands to ANTLR4 ...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11905#issuecomment-202436010 **[Test build #54312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54312/consoleFull)** for PR 11905 at commit

[GitHub] spark pull request: [SPARK-14086][SQL] Add DDL commands to ANTLR4 ...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11905#issuecomment-202437003 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202434831 The basic idea is a good one, but in addition to needing to spend some time sorting out the logic around that `assert`, I'm a little concerned about the

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202434056 **[Test build #54321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54321/consoleFull)** for PR 11632 at commit

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/11720#discussion_r57581958 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -286,6 +286,7 @@ class DAGScheduler( case None =>

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/11720#discussion_r57581491 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -286,6 +286,7 @@ class DAGScheduler( case None =>

[GitHub] spark pull request: [SPARK-13713][SQL] Migrate parser from ANTLR3 ...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11557#issuecomment-202429698 **[Test build #54320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54320/consoleFull)** for PR 11557 at commit

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202428846 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202428847 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202428748 **[Test build #54316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54316/consoleFull)** for PR 11632 at commit

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202428180 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

<    3   4   5   6   7   8   9   10   >