[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20523 Thanks, @ueshin. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20484 I'm looking at that. BTW, can we finish table property issue in Apache Spark 2.3 at #20522 ? Given that users already experience this for `STORED AS PARQUET` Hive table until

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/20523 I see, then, I'll leave it to @gatorsmile for now. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20522 I agree with you on all the issues. BTW, how can we put these existing Spark bugs into ORC migration guide? --- - To

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20523 Oh, no. I mean another JIRA for this PR. Sorry for confusion. --- - To unsubscribe, e-mail:

[GitHub] spark issue #20521: [SPARK-22977][SQL] fix web UI SQL tab for CTAS

2018-02-06 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/20521 Thanks @cloud-fan It works. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/20523 Sure, I'll take it. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20419: [SPARK-23032][SQL][FOLLOW-UP]Add codegenStageId in comme...

2018-02-06 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20419 ping @rednaxelafx --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20523 Let's make another JIRA ... --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20516: [SPARK-23343][CORE][TEST] Increase the exception ...

2018-02-06 Thread heary-cao
Github user heary-cao commented on a diff in the pull request: https://github.com/apache/spark/pull/20516#discussion_r166494159 --- Diff: core/src/test/scala/org/apache/spark/network/netty/NettyBlockTransferServiceSuite.scala --- @@ -77,16 +79,68 @@ class

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/20523 Seems like `JavaUDAFSuite.java` still uses `registerTempTable`. Should we replace it as well? --- - To unsubscribe, e-mail:

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20523 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20523 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/647/

[GitHub] spark issue #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTab...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20523 **[Test build #87135 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87135/testReport)** for PR 20523 at commit

[GitHub] spark pull request #20523: [SPARK-23122][PYSPARK][FOLLOWUP] Replace register...

2018-02-06 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/20523 [SPARK-23122][PYSPARK][FOLLOWUP] Replace registerTempTable by createOrReplaceTempView ## What changes were proposed in this pull request? Replace `registerTempTable` by

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87133/ Test FAILed. ---

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20445 **[Test build #87133 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87133/testReport)** for PR 20445 at commit

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20522 Also cc @cloud-fan @gengliangwang --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20495: [SPARK-23327] [SQL] Update the description and te...

2018-02-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20495 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20484 How about users setting the ORC-related confs in HiveConf configuration files? Are they still effective in Hive? --- - To

[GitHub] spark issue #20490: [SPARK-23323][SQL]: Support commit coordinator for DataS...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20490 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20522 Just FYI, https://github.com/apache/spark/pull/19382 is to solve the issue of storage/serde properties. However the issue here is table properties. They are not related. Please create a new JIRA

[GitHub] spark issue #20490: [SPARK-23323][SQL]: Support commit coordinator for DataS...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20490 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87132/ Test FAILed. ---

[GitHub] spark issue #20490: [SPARK-23323][SQL]: Support commit coordinator for DataS...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20490 **[Test build #87132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87132/testReport)** for PR 20490 at commit

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166488751 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166488226 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark issue #20519: [Spark-23240][python] Don't let python site customizatio...

2018-02-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20519 Isn't it too a invasive change to deal with a corner case described in the JIRA .. ? Did I maybe miss something? --- - To

[GitHub] spark issue #20487: [SPARK-23319][TESTS] Explicitly specify Pandas and PyArr...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20487 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/646/

[GitHub] spark issue #20487: [SPARK-23319][TESTS] Explicitly specify Pandas and PyArr...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20487 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20487: [SPARK-23319][TESTS] Explicitly skips PySpark tests for ...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20487 **[Test build #87134 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87134/testReport)** for PR 20487 at commit

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87131/ Test PASSed. ---

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20522 **[Test build #87131 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87131/testReport)** for PR 20522 at commit

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87127/ Test PASSed. ---

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87128/ Test PASSed. ---

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20295 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20474 **[Test build #87127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87127/testReport)** for PR 20474 at commit

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20295 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87129/ Test PASSed. ---

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20295 **[Test build #87129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87129/testReport)** for PR 20295 at commit

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20474 **[Test build #87128 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87128/testReport)** for PR 20474 at commit

[GitHub] spark issue #20378: [SPARK-11222][Build][Python] Python document style check...

2018-02-06 Thread rekhajoshm
Github user rekhajoshm commented on the issue: https://github.com/apache/spark/pull/20378 @HyukjinKwon I will check it over weekend.thanks --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20445 **[Test build #87133 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87133/testReport)** for PR 20445 at commit

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/645/

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/20445 jenkins retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20495: [SPARK-23327] [SQL] Update the description and tests of ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20495 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20495: [SPARK-23327] [SQL] Update the description and tests of ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20495 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87124/ Test PASSed. ---

[GitHub] spark issue #20495: [SPARK-23327] [SQL] Update the description and tests of ...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20495 **[Test build #87124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87124/testReport)** for PR 20495 at commit

[GitHub] spark pull request #20474: [SPARK-23235][Core] Add executor Threaddump to ap...

2018-02-06 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/20474#discussion_r166465338 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/OneApplicationResource.scala --- @@ -51,6 +51,30 @@ private[v1] class

[GitHub] spark issue #20490: [SPARK-23323][SQL]: Support commit coordinator for DataS...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20490 **[Test build #87132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87132/testReport)** for PR 20490 at commit

[GitHub] spark issue #20490: [SPARK-23323][SQL]: Support commit coordinator for DataS...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20490 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/644/

[GitHub] spark issue #20490: [SPARK-23323][SQL]: Support commit coordinator for DataS...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20490 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20490: [SPARK-23323][SQL]: Support commit coordinator fo...

2018-02-06 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20490#discussion_r166463921 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala --- @@ -117,20 +118,43 @@ object

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87120/ Test PASSed. ---

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20474 **[Test build #87120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87120/testReport)** for PR 20474 at commit

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87121/ Test PASSed. ---

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20474 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20474: [SPARK-23235][Core] Add executor Threaddump to api

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20474 **[Test build #87121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87121/testReport)** for PR 20474 at commit

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87130/ Test FAILed. ---

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20522 **[Test build #87130 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87130/testReport)** for PR 20522 at commit

[GitHub] spark issue #20387: [SPARK-23203][SQL]: DataSourceV2: Use immutable logical ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20387 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20387: [SPARK-23203][SQL]: DataSourceV2: Use immutable logical ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20387 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87123/ Test PASSed. ---

[GitHub] spark issue #20387: [SPARK-23203][SQL]: DataSourceV2: Use immutable logical ...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20387 **[Test build #87123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87123/testReport)** for PR 20387 at commit

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166460947 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166460621 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20522 **[Test build #87131 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87131/testReport)** for PR 20522 at commit

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166460402 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/643/

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166459898 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark pull request #20244: [SPARK-23053][CORE] taskBinarySerialization and t...

2018-02-06 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/20244#discussion_r166458357 --- Diff: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala --- @@ -2399,6 +2424,121 @@ class DAGSchedulerSuite extends SparkFunSuite

[GitHub] spark issue #20120: [SPARK-22926] [SQL] Respect table-level conf compression...

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20120 @gatorsmile . Did you add some document for this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20490: [SPARK-23323][SQL]: Support commit coordinator fo...

2018-02-06 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/20490#discussion_r166448459 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala --- @@ -117,20 +118,43 @@ object

[GitHub] spark pull request #20490: [SPARK-23323][SQL]: Support commit coordinator fo...

2018-02-06 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/20490#discussion_r166447570 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2.scala --- @@ -117,20 +118,43 @@ object

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20484 With a combination of #20517 and #20522 , (1) configuration names, (2) table properties, (3) serde properties, (4) convertMetastoreOrc/Parquet=true are tested and fixed. The only

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20522 **[Test build #87130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87130/testReport)** for PR 20522 at commit

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20522 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/642/

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20522#discussion_r166440352 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -189,12 +189,13 @@ case class RelationConversions(

[GitHub] spark issue #20484: [SPARK-23313][DOC] Add a migration guide for ORC

2018-02-06 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20484 I understand the situation, but I hope this will not introduce a regression due to the change of default value of `convertMetastoreOrc`. I created another PR,

[GitHub] spark pull request #20522: [SPARK-22158][SQL][FOLLOWUP] convertMetastore sho...

2018-02-06 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/20522 [SPARK-22158][SQL][FOLLOWUP] convertMetastore should not ignore table properties ## What changes were proposed in this pull request? Previously, SPARK-22158 fixed for `USING hive`

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20295 **[Test build #87129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87129/testReport)** for PR 20295 at commit

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20295 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20295 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/641/

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

2018-02-06 Thread icexelloss
Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/20295 gentle ping @HyukjinKwon @ueshin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20485: [SPARK-23315][SQL] failed to get output from cano...

2018-02-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20485 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20485: [SPARK-23315][SQL] failed to get output from canonicaliz...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20485 LGTM Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20485: [SPARK-23315][SQL] failed to get output from cano...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20485#discussion_r166436103 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/PushDownOperatorsToDataSource.scala --- @@ -81,33 +81,44 @@ object

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20445 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87122/ Test FAILed. ---

[GitHub] spark issue #20445: [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 ...

2018-02-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20445 **[Test build #87122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87122/testReport)** for PR 20445 at commit

[GitHub] spark pull request #20489: [MINOR][TEST] Fix class name for Pandas UDF tests

2018-02-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20489 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20513: [SPARK-23312][SQL][followup] add a config to turn...

2018-02-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20513 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20489: [MINOR][TEST] Fix class name for Pandas UDF tests

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20489 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20513: [SPARK-23312][SQL][followup] add a config to turn off ve...

2018-02-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20513 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

<    1   2   3   4   5   6   >