[GitHub] [spark] SparkQA removed a comment on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459#issuecomment-552428607 **[Test build #113590 has started](https://amplab.cs.berkeley.edu/jenkins/job/S

[GitHub] [spark] SparkQA commented on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
SparkQA commented on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459#issuecomment-552507663 **[Test build #113590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] srowen commented on a change in pull request #26454: [SPARK-29818][MLLIB] Missing persist on RDD

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26454: [SPARK-29818][MLLIB] Missing persist on RDD URL: https://github.com/apache/spark/pull/26454#discussion_r344787564 ## File path: mllib/src/main/scala/org/apache/spark/ml/evaluation/MultilabelClassificationEvaluator.scala

[GitHub] [spark] srowen commented on a change in pull request #26454: [SPARK-29818][MLLIB] Missing persist on RDD

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26454: [SPARK-29818][MLLIB] Missing persist on RDD URL: https://github.com/apache/spark/pull/26454#discussion_r344788315 ## File path: mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala ## @@ -141,8 +141,10 @@

[GitHub] [spark] AmplabJenkins commented on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459#issuecomment-552509749 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459#issuecomment-552509760 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins removed a comment on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459#issuecomment-552509749 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459#issuecomment-552509760 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] MaxGekk commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()`

2019-11-11 Thread GitBox
MaxGekk commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()` URL: https://github.com/apache/spark/pull/26358#discussion_r344794181 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/Inte

[GitHub] [spark] cloud-fan commented on a change in pull request #26409: [SPARK-29655][SQL] Enable adaptive execution should not add more ShuffleExchange

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26409: [SPARK-29655][SQL] Enable adaptive execution should not add more ShuffleExchange URL: https://github.com/apache/spark/pull/26409#discussion_r344796903 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchan

[GitHub] [spark] cloud-fan commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()`

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()` URL: https://github.com/apache/spark/pull/26358#discussion_r344797382 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/In

[GitHub] [spark] MaxGekk commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()`

2019-11-11 Thread GitBox
MaxGekk commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()` URL: https://github.com/apache/spark/pull/26358#discussion_r344800434 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/Inte

[GitHub] [spark] SparkQA commented on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena…

2019-11-11 Thread GitBox
SparkQA commented on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena… URL: https://github.com/apache/spark/pull/26315#issuecomment-552520418 **[Test build #4919 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/491

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344803205 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344803018 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] SparkQA removed a comment on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena…

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is ena… URL: https://github.com/apache/spark/pull/26315#issuecomment-552463186 **[Test build #4919 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuil

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344804735 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] MaxGekk commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

2019-11-11 Thread GitBox
MaxGekk commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-552524543 You have to change the code gen in `castToStringCode` as well. -

[GitHub] [spark] SparkQA commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

2019-11-11 Thread GitBox
SparkQA commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-552529436 **[Test build #113597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r344814074 ## File path: core/src/main/scala/org/apache/spark/shuffle/ShuffleManager.scala ##

[GitHub] [spark] AmplabJenkins commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-552530757 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-552530768 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-552530757 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26418: [SPARK-29783][SQL] Support SQL Standard/ISO_8601 output style for interval type URL: https://github.com/apache/spark/pull/26418#issuecomment-552530768 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train

2019-11-11 Thread GitBox
Icysandwich commented on a change in pull request #26469: [SPARK-29844] Improper unpersist strategy in ml.recommendation.ASL.train URL: https://github.com/apache/spark/pull/26469#discussion_r344824121 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala #

[GitHub] [spark] SparkQA commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
SparkQA commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552541414 **[Test build #113598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113598/testReport)** for P

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r344828826 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552542353 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552542358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r344829344 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] SparkQA commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
SparkQA commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552542371 **[Test build #113591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113591/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552542353 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] SparkQA removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552448297 **[Test build #113591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113591/testReport)*

[GitHub] [spark] AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552542358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552544077 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552544069 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552544069 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26463: [SPARK-29837][SQL] PostgreSQL dialect: cast to boolean URL: https://github.com/apache/spark/pull/26463#issuecomment-552544077 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r344831708 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r344832143 ## File path: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestData.scala #

[GitHub] [spark] amanomer opened a new pull request #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

2019-11-11 Thread GitBox
amanomer opened a new pull request #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472 ### What changes were proposed in this pull request? To make SparkSQL's `cast as timestamp` behavior consistent with PostgreSQL

[GitHub] [spark] cloud-fan commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()`

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26358: [SPARK-29712][SQL] Take into account the left bound in `fromDayTimeString()` URL: https://github.com/apache/spark/pull/26358#discussion_r344832563 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/In

[GitHub] [spark] SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write, Blacklisted, Logs, Threaddump columns

2019-11-11 Thread GitBox
SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write,Blacklisted,Logs,Threaddump columns URL: https://github.com/apache/spark/pull/26263#issuecomment-552545768 **[Test build #4922 has finished](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] SparkQA removed a comment on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write, Blacklisted, Logs, Threaddump columns

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write,Blacklisted,Logs,Threaddump columns URL: https://github.com/apache/spark/pull/26263#issuecomment-552504441 **[Test build #4922 has started](https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] SparkQA commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
SparkQA commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552545971 **[Test build #113594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2019-11-11 Thread GitBox
SparkQA commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26301#issuecomment-552545890 **[Test build #4925 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Ne

[GitHub] [spark] SparkQA removed a comment on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26301#issuecomment-552507111 **[Test build #4925 has started](https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] SparkQA removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552483133 **[Test build #113594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
SparkQA commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552547226 **[Test build #113595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA removed a comment on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552484673 **[Test build #113595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552548658 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552548667 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552548667 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552548658 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552549676 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552549665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552549676 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add executor-level memory usage metrics to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-552549665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472#issuecomment-552551136 Can one of the admins verify this patch? This is an

[GitHub] [spark] SparkQA commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2019-11-11 Thread GitBox
SparkQA commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26301#issuecomment-552552574 **[Test build #4924 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Ne

[GitHub] [spark] SparkQA removed a comment on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26301#issuecomment-552507069 **[Test build #4924 has started](https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins commented on issue #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472#issuecomment-552553127 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26472: [WIP][SPARK-29838][SQL] PostgreSQL dialect: cast to timestamp URL: https://github.com/apache/spark/pull/26472#issuecomment-552551136 Can one of the admins verify this patch? Th

[GitHub] [spark] SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write, Blacklisted, Logs, Threaddump columns

2019-11-11 Thread GitBox
SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write,Blacklisted,Logs,Threaddump columns URL: https://github.com/apache/spark/pull/26263#issuecomment-552554562 **[Test build #4927 has started](https://amplab.cs.berkeley.edu/jenkins/job/

[GitHub] [spark] SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write, Blacklisted, Logs, Threaddump columns

2019-11-11 Thread GitBox
SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write,Blacklisted,Logs,Threaddump columns URL: https://github.com/apache/spark/pull/26263#issuecomment-552554453 **[Test build #4926 has started](https://amplab.cs.berkeley.edu/jenkins/job/

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344843160 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] SparkQA commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2019-11-11 Thread GitBox
SparkQA commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26301#issuecomment-552555039 **[Test build #4928 has started](https://amplab.cs.berkeley.edu/jenkins/job/New

[GitHub] [spark] dongjoon-hyun closed pull request #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql`

2019-11-11 Thread GitBox
dongjoon-hyun closed pull request #26459: [SPARK-29825][SQL][TESTS] Add join-related configs in `inner-join.sql` and `postgreSQL/join.sql` URL: https://github.com/apache/spark/pull/26459 This is an automated message from the

[GitHub] [spark] dongjoon-hyun commented on issue #26430: [SPARK-28859][Core] Remove value check of MEMORY_OFFHEAP_SIZE

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26430: [SPARK-28859][Core] Remove value check of MEMORY_OFFHEAP_SIZE URL: https://github.com/apache/spark/pull/26430#issuecomment-552559354 Gentle ping, @xingyif . This is an automated messag

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26430: [SPARK-28859][Core] Remove value check of MEMORY_OFFHEAP_SIZE

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26430: [SPARK-28859][Core] Remove value check of MEMORY_OFFHEAP_SIZE URL: https://github.com/apache/spark/pull/26430#discussion_r344471022 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala #

[GitHub] [spark] dongjoon-hyun commented on issue #26430: [SPARK-28859][Core] Remove value check of MEMORY_OFFHEAP_SIZE

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26430: [SPARK-28859][Core] Remove value check of MEMORY_OFFHEAP_SIZE URL: https://github.com/apache/spark/pull/26430#issuecomment-552559907 Let's remove the test case simply since it's already a dead-code which doesn't compile. ---

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344849290 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344849321 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] tgravescs commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes

2019-11-11 Thread GitBox
tgravescs commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-552560887 Jenkins seems to be confused, I didn't add the public classes listed --

[GitHub] [spark] SparkQA commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
SparkQA commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552560987 **[Test build #113592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] SparkQA removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552466881 **[Test build #113592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] falaki commented on issue #26429: [SPARK-29777][SparkR] SparkR::cleanClosure aggressively removes a function required by user function

2019-11-11 Thread GitBox
falaki commented on issue #26429: [SPARK-29777][SparkR] SparkR::cleanClosure aggressively removes a function required by user function URL: https://github.com/apache/spark/pull/26429#issuecomment-552561408 @shivaram and @felixcheung do you guys have any input on this? ---

[GitHub] [spark] SparkQA removed a comment on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write, Blacklisted, Logs, Threaddump columns

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write,Blacklisted,Logs,Threaddump columns URL: https://github.com/apache/spark/pull/26263#issuecomment-552505461 **[Test build #4923 has started](https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write, Blacklisted, Logs, Threaddump columns

2019-11-11 Thread GitBox
SparkQA commented on issue #26263: [SPARK-29570][WEBUI] Improve tooltip for Executor Tab for Shuffle Write,Blacklisted,Logs,Threaddump columns URL: https://github.com/apache/spark/pull/26263#issuecomment-552562263 **[Test build #4923 has finished](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552562596 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552562602 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552562596 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26465: [SPARK-29390][SQL] Add the justify_days(), justify_hours() and justif_interval() functions URL: https://github.com/apache/spark/pull/26465#issuecomment-552562602 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] dbtsai commented on a change in pull request #26456: [SPARK-29820][INFRA] Use GitHub Action Cache for `./.m2/repository/[com|org]`

2019-11-11 Thread GitBox
dbtsai commented on a change in pull request #26456: [SPARK-29820][INFRA] Use GitHub Action Cache for `./.m2/repository/[com|org]` URL: https://github.com/apache/spark/pull/26456#discussion_r344856042 ## File path: .github/workflows/master.yml ## @@ -23,6 +23,19 @@ jobs:

[GitHub] [spark] cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-11-11 Thread GitBox
cloud-fan commented on a change in pull request #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#discussion_r344828826 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewe

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26456: [SPARK-29820][INFRA] Use GitHub Action Cache for `./.m2/repository/[com|org]`

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26456: [SPARK-29820][INFRA] Use GitHub Action Cache for `./.m2/repository/[com|org]` URL: https://github.com/apache/spark/pull/26456#discussion_r344857911 ## File path: .github/workflows/master.yml ## @@ -23,6 +23,19 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26456: [SPARK-29820][INFRA] Use GitHub Action Cache for `./.m2/repository/[com|org]`

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26456: [SPARK-29820][INFRA] Use GitHub Action Cache for `./.m2/repository/[com|org]` URL: https://github.com/apache/spark/pull/26456#discussion_r344858190 ## File path: .github/workflows/master.yml ## @@ -23,6 +23,19 @@

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344859255 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command

2019-11-11 Thread GitBox
kevinyu98 commented on a change in pull request #25573: [SPARK-28833][DOCS][SQL] Document ALTER VIEW command URL: https://github.com/apache/spark/pull/25573#discussion_r344859398 ## File path: docs/sql-ref-syntax-ddl-alter-view.md ## @@ -19,4 +19,217 @@ license: | limit

[GitHub] [spark] dbtsai commented on a change in pull request #26443: [SPARK-29805][SQL] Enable nested schema pruning and nested pruning on expressions by default

2019-11-11 Thread GitBox
dbtsai commented on a change in pull request #26443: [SPARK-29805][SQL] Enable nested schema pruning and nested pruning on expressions by default URL: https://github.com/apache/spark/pull/26443#discussion_r344860191 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/int

[GitHub] [spark] dongjoon-hyun closed pull request #26439: [SPARK-29801][ML] ML models unify toString method

2019-11-11 Thread GitBox
dongjoon-hyun closed pull request #26439: [SPARK-29801][ML] ML models unify toString method URL: https://github.com/apache/spark/pull/26439 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on issue #26425: [SPARK-29789][SQL] should not parse the bucket column name when creating v2 tables

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26425: [SPARK-29789][SQL] should not parse the bucket column name when creating v2 tables URL: https://github.com/apache/spark/pull/26425#issuecomment-552573086 Hi, @rdblue . How do you think about @cloud-fan 's question? I'm just wondering which path w

[GitHub] [spark] dbtsai commented on issue #26443: [SPARK-29805][SQL] Enable nested schema pruning and nested pruning on expressions by default

2019-11-11 Thread GitBox
dbtsai commented on issue #26443: [SPARK-29805][SQL] Enable nested schema pruning and nested pruning on expressions by default URL: https://github.com/apache/spark/pull/26443#issuecomment-552573049 Thanks all for reviewing. Merged into master. --

[GitHub] [spark] dbtsai closed pull request #26443: [SPARK-29805][SQL] Enable nested schema pruning and nested pruning on expressions by default

2019-11-11 Thread GitBox
dbtsai closed pull request #26443: [SPARK-29805][SQL] Enable nested schema pruning and nested pruning on expressions by default URL: https://github.com/apache/spark/pull/26443 This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#discussion_r344866754 ## File path: sql/hive/src/main/scala/org/apache/spark/s

[GitHub] [spark] dongjoon-hyun commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552576758 cc @dbtsai This

[GitHub] [spark] dongjoon-hyun edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
dongjoon-hyun edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552576758 cc @dbtsai , too.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#discussion_r344868672 ## File path: sql/hive/src/test/scala/org/apache/spark/

[GitHub] [spark] planga82 commented on a change in pull request #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
planga82 commented on a change in pull request #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#discussion_r344871522 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/An

[GitHub] [spark] viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552581081 @dongjoon-hyun Thanks for review. As I mentioned in the description, although end-

<    1   2   3   4   5   6   7   8   9   >