[GitHub] [spark] jeff303 commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read

2019-10-07 Thread GitBox
jeff303 commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read URL: https://github.com/apache/spark/pull/26027#discussion_r332077245 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVE

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-539049991 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-539050003 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-539049991 Merged build finished. Test PASSed. This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-539050003 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] SparkQA commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

2019-10-07 Thread GitBox
SparkQA commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-539049139 **[Test build #111838 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111838/testReport)**

[GitHub] [spark] srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read

2019-10-07 Thread GitBox
srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read URL: https://github.com/apache/spark/pull/26027#discussion_r332035147 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVEx

[GitHub] [spark] srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read

2019-10-07 Thread GitBox
srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read URL: https://github.com/apache/spark/pull/26027#discussion_r332033998 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVEx

[GitHub] [spark] srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read

2019-10-07 Thread GitBox
srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read URL: https://github.com/apache/spark/pull/26027#discussion_r332032936 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVEx

[GitHub] [spark] srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read

2019-10-07 Thread GitBox
srowen commented on a change in pull request #26027: [SPARK-24540][SQL] Support for multiple character delimiter in Spark CSV read URL: https://github.com/apache/spark/pull/26027#discussion_r332032489 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVEx

[GitHub] [spark] srowen commented on issue #25998: [SPARK-29328][SQL] Fix calculation of mean seconds per month

2019-10-07 Thread GitBox
srowen commented on issue #25998: [SPARK-29328][SQL] Fix calculation of mean seconds per month URL: https://github.com/apache/spark/pull/25998#issuecomment-539019931 Merged to master This is an automated message from the Apac

[GitHub] [spark] srowen closed pull request #25998: [SPARK-29328][SQL] Fix calculation of mean seconds per month

2019-10-07 Thread GitBox
srowen closed pull request #25998: [SPARK-29328][SQL] Fix calculation of mean seconds per month URL: https://github.com/apache/spark/pull/25998 This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [spark] srowen commented on a change in pull request #25561: [SPARK-28810][DOC][SQL] Document SHOW TABLES in SQL Reference.

2019-10-07 Thread GitBox
srowen commented on a change in pull request #25561: [SPARK-28810][DOC][SQL] Document SHOW TABLES in SQL Reference. URL: https://github.com/apache/spark/pull/25561#discussion_r332026109 ## File path: docs/sql-ref-syntax-aux-show-tables.md ## @@ -18,5 +18,86 @@ license: |

[GitHub] [spark] srowen commented on a change in pull request #25895: [SPARK-28816][DOC][SQL] Document ADD JAR statement in SQL Reference

2019-10-07 Thread GitBox
srowen commented on a change in pull request #25895: [SPARK-28816][DOC][SQL] Document ADD JAR statement in SQL Reference URL: https://github.com/apache/spark/pull/25895#discussion_r332023526 ## File path: docs/sql-ref-syntax-aux-resource-mgmt-add-jar.md ## @@ -19,4 +19,31

[GitHub] [spark] srowen commented on a change in pull request #25895: [SPARK-28816][DOC][SQL] Document ADD JAR statement in SQL Reference

2019-10-07 Thread GitBox
srowen commented on a change in pull request #25895: [SPARK-28816][DOC][SQL] Document ADD JAR statement in SQL Reference URL: https://github.com/apache/spark/pull/25895#discussion_r332024789 ## File path: docs/sql-ref-syntax-aux-resource-mgmt-add-jar.md ## @@ -19,4 +19,31

[GitHub] [spark] srowen commented on a change in pull request #25895: [SPARK-28816][DOC][SQL] Document ADD JAR statement in SQL Reference

2019-10-07 Thread GitBox
srowen commented on a change in pull request #25895: [SPARK-28816][DOC][SQL] Document ADD JAR statement in SQL Reference URL: https://github.com/apache/spark/pull/25895#discussion_r332025030 ## File path: docs/sql-ref-syntax-aux-resource-mgmt-add-file.md ## @@ -19,4 +19,32

[GitHub] [spark] beliefer commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-10-07 Thread GitBox
beliefer commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-539013867 @srowen Thanks for your help! @dongjoon-hyun @wangyum Thanks for all your review! --

[GitHub] [spark] karuppayya commented on issue #25995: [SPARK-29324][SQL] Fix overwrite behaviour for saveAsTable

2019-10-07 Thread GitBox
karuppayya commented on issue #25995: [SPARK-29324][SQL] Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-539013715 1. When I write to a partitioned table(with fileformat other than parquet) using `saveAstable` and `partitionOverwriteMod

[GitHub] [spark] harpaj commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
harpaj commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-539012906 Might have the same cause as Pandas UDFs not working with Arrow 0.15, see https://issues.apache.org/jira/projects/SPARK/i

[GitHub] [spark] cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#discussion_r332005429 ## File path: core/src/main/scala/org/apache/spark/network/netty/NettyBlockRpcServer.s

[GitHub] [spark] cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#discussion_r332003332 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/Ex

[GitHub] [spark] cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#discussion_r332001894 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/Ex

[GitHub] [spark] cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#discussion_r332001663 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/Ex

[GitHub] [spark] cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#discussion_r331999858 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/pr

[GitHub] [spark] cloud-fan commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint

2019-10-07 Thread GitBox
cloud-fan commented on issue #25971: [SPARK-29298][CORE] Separate block manager heartbeat endpoint from driver endpoint URL: https://github.com/apache/spark/pull/25971#issuecomment-538963522 sounds like a good idea. cc @jiangxb1987 @xuanyuanking ---

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331965588 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala #

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331959991 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4 +

[GitHub] [spark] HyukjinKwon commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
HyukjinKwon commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538921919 Seems Arrow isn't released yet in Windows. The AppVeyor build here used Areow 0.14.1.1. I'll trigger the build again

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538906852 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
SparkQA commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538918226 **[Test build #111837 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111837/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538918386 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538918394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
SparkQA removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538906158 **[Test build #111837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111837/tes

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538918386 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538918394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331921443 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331920547 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4

[GitHub] [spark] hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331918946 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4

[GitHub] [spark] hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
hvanhovell commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331917892 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331916385 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/RowJsonSuite.scala ## @@

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331915644 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala #

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331915644 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala #

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331914961 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4 +

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331913844 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4 +

[GitHub] [spark] cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #26013: [SPARK-29347][SQL] Add JSON serialization for external Rows URL: https://github.com/apache/spark/pull/26013#discussion_r331912961 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/Row.scala ## @@ -501,4 +

[GitHub] [spark] HeartSaVioR edited a comment on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener

2019-10-07 Thread GitBox
HeartSaVioR edited a comment on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener URL: https://github.com/apache/spark/pull/25943#issuecomment-538900768 Just gone through POC, and realized LiveEntities are not considered to be

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538906852 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538906838 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538906838 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
SparkQA commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538906158 **[Test build #111837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111837/testReport)

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener

2019-10-07 Thread GitBox
HeartSaVioR commented on a change in pull request #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener URL: https://github.com/apache/spark/pull/25943#discussion_r331909508 ## File path: core/src/main/scala/org/apache/spark/sta

[GitHub] [spark] HyukjinKwon commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
HyukjinKwon commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538904278 @BryanCutler did Arrow change the format itself? bunch of PySpark tests with Arrow fail too. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538903674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538903668 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538903674 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538903668 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538900375 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538900666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] HeartSaVioR commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener

2019-10-07 Thread GitBox
HeartSaVioR commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener URL: https://github.com/apache/spark/pull/25943#issuecomment-538900768 Just gone through POC, and realized LiveEntities are not considered to store in

[GitHub] [spark] AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538900658 Merged build finished. Test PASSed. This

[GitHub] [spark] HyukjinKwon commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
HyukjinKwon commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538900592 cc @BryanCutler FYI This is an automated message fr

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538900375 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538900364 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538900666 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538900658 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538900364 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
SparkQA commented on issue #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041#issuecomment-538900170 **[Test build #111836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111836/testReport)

[GitHub] [spark] SparkQA commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
SparkQA commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538900070 **[Test build #111835 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111835/test

[GitHub] [spark] SparkQA removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
SparkQA removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538868786 **[Test build #111835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1118

[GitHub] [spark] HyukjinKwon opened a new pull request #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization

2019-10-07 Thread GitBox
HyukjinKwon opened a new pull request #26041: [DO-NOT-MERGE] Investigate Arrow 0.15 with R Arrow optimization URL: https://github.com/apache/spark/pull/26041 ### What changes were proposed in this pull request? Arrow 0.15 support. ### Why are the changes needed? Arrow R

[GitHub] [spark] WeichenXu123 commented on issue #17972: [SPARK-20723][ML]Add intermediate storage level to tree based classifiers

2019-10-07 Thread GitBox
WeichenXu123 commented on issue #17972: [SPARK-20723][ML]Add intermediate storage level to tree based classifiers URL: https://github.com/apache/spark/pull/17972#issuecomment-53513 @phatak-dev This PR is pretty old so the biggest challenge is going to be updating it to the current mast

[GitHub] [spark] cloud-fan commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#discussion_r331887829 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/

[GitHub] [spark] cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#discussion_r331886955 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/Table

[GitHub] [spark] cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

2019-10-07 Thread GitBox
cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#discussion_r331886955 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/Table

[GitHub] [spark] HyukjinKwon closed pull request #26036: [SPARK-29365][SQL] Support dates and timestamps subtraction

2019-10-07 Thread GitBox
HyukjinKwon closed pull request #26036: [SPARK-29365][SQL] Support dates and timestamps subtraction URL: https://github.com/apache/spark/pull/26036 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HyukjinKwon commented on issue #26036: [SPARK-29365][SQL] Support dates and timestamps subtraction

2019-10-07 Thread GitBox
HyukjinKwon commented on issue #26036: [SPARK-29365][SQL] Support dates and timestamps subtraction URL: https://github.com/apache/spark/pull/26036#issuecomment-538879014 Merged to master. This is an automated message from th

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538869208 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538869201 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538869208 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538869201 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
SparkQA commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538868786 **[Test build #111835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111835/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes URL: https://github.com/apache/spark/pull/26037#issuecomment-538868590 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes URL: https://github.com/apache/spark/pull/26037#issuecomment-538868590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] SparkQA commented on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes

2019-10-07 Thread GitBox
SparkQA commented on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes URL: https://github.com/apache/spark/pull/26037#issuecomment-538868559 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestB

[GitHub] [spark] AmplabJenkins commented on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes URL: https://github.com/apache/spark/pull/26037#issuecomment-538868585 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26037: [SPARK-28938][K8S] Move to supported OpenJDK docker image for Kubernetes URL: https://github.com/apache/spark/pull/26037#issuecomment-538868585 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866987 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866985 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866987 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866985 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866524 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] cloud-fan commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
cloud-fan commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866866 retest this please This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE URL: https://github.com/apache/spark/pull/26025#issuecomment-538866431 Test FAILed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] cloud-fan commented on issue #25995: [SPARK-29324][SQL] Fix overwrite behaviour for saveAsTable

2019-10-07 Thread GitBox
cloud-fan commented on issue #25995: [SPARK-29324][SQL] Fix overwrite behaviour for saveAsTable URL: https://github.com/apache/spark/pull/25995#issuecomment-538866799 `saveAsTable` with overwrite mode is kind of `REPLACE OR CREATE TABLE AS SELECT`. This is the expected behavior. I think w

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866518 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866524 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE URL: https://github.com/apache/spark/pull/26025#issuecomment-538866419 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-07 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-538866518 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE

2019-10-07 Thread GitBox
SparkQA commented on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE URL: https://github.com/apache/spark/pull/26025#issuecomment-538866330 **[Test build #111834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111834/te

[GitHub] [spark] AmplabJenkins commented on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE

2019-10-07 Thread GitBox
AmplabJenkins commented on issue #26025: [SPARK-28892][SQL][followup] add resolved logical plan for UPDATE TABLE URL: https://github.com/apache/spark/pull/26025#issuecomment-538866431 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

<    2   3   4   5   6   7   8   >