[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511900404 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511900393 Merged build finished. Test PASSed.

[GitHub] [spark] shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511900972 > Since I'm mainly in the streaming area my main intention is to implement Structured S

[GitHub] [spark] holdenk commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

holdenk commented on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-511901052 I have some general questions about the design/goals: 1) Do we think there might be any problems with blocking around

[GitHub] [spark] squito commented on issue #24462: [SPARK-26268][CORE] Do not resubmit tasks when executors are lost

squito commented on issue #24462: [SPARK-26268][CORE] Do not resubmit tasks when executors are lost URL: https://github.com/apache/spark/pull/24462#issuecomment-511901893 I took another look at @yifeih 's changes, and I think she's right, that will be sufficient. Now you're custom shuffle

[GitHub] [spark] rdblue commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

rdblue commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#discussion_r304020365 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/DescribeTa

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304022398 ## File path: sql/core/src/main/scala/org/apache/spark/s

[GitHub] [spark] vanzin commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

vanzin commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511905007 retest this please This is an automated message

[GitHub] [spark] SparkQA commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

SparkQA commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511905282 **[Test build #107748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107748/tes

[GitHub] [spark] SparkQA commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

SparkQA commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511906347 **[Test build #107746 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107746/testReport

[GitHub] [spark] SparkQA removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

SparkQA removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511896019 **[Test build #107746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107746/tes

[GitHub] [spark] AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511906817 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511906815 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511906817 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511906815 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511907698 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511907690 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511907698 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511907690 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908975 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

SparkQA commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908523 **[Test build #107749 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908965 Merged build finished. Test FAILed.

[GitHub] [spark] WeichenXu123 commented on a change in pull request #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

WeichenXu123 commented on a change in pull request #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#discussion_r304028711 ## File path: core/src/main/scala/org/apache/spark/rdd/H

[GitHub] [spark] SparkQA removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

SparkQA removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908523 **[Test build #107749 has started](https://amplab.cs.berkeley.edu/jenkins/job/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908965 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910726 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910732 Test PASSed. Refer to this link for build results (access ri

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908975 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304030670 ## File path: sql/hive/src/test/scala/org/apache/spark/s

[GitHub] [spark] gatorsmile commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

gatorsmile commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304030121 ## File path: sql/catalyst/src/main/sca

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511910846 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] yeshengm commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

yeshengm commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910370 retest this please

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304029971 ## File path: sql/hive/src/main/scala/org/apache/spark/s

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511910830 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511910826 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910726 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511911595 **[Test build #107750 has started](https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511910846 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] sujith71955 commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511912157 > Can we add a simple test? done --

[GitHub] [spark] SparkQA commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

SparkQA commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511911637 **[Test build #107751 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304031127 ## File path: sql/hive/src/main/scala/org/apache/spark/s

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910732 Test PASSed. Refer to this link for build results (a

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511910848 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511910830 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511910848 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

yeshengm commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304031126 ## File path: sql/catalyst/src/main/scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511910826 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511913264 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511913276 Test FAILed. Refer to this link for build results (access ri

[GitHub] [spark] SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511913245 **[Test build #107750 has finished](https://amplab.cs.berkeley.edu/j

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511913264 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511913276 Test FAILed. Refer to this link for build results (a

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511913934 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511913923 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner

AmplabJenkins commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner URL: https://github.com/apache/spark/pull/25111#issuecomment-511913890 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner

AmplabJenkins commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner URL: https://github.com/apache/spark/pull/25111#issuecomment-511913879 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511913934 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner

AmplabJenkins removed a comment on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner URL: https://github.com/apache/spark/pull/25111#issuecomment-511913879 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511913923 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner

AmplabJenkins removed a comment on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner URL: https://github.com/apache/spark/pull/25111#issuecomment-511913890 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner

SparkQA commented on issue #25111: [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner URL: https://github.com/apache/spark/pull/25111#issuecomment-511914738 **[Test build #107753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304029971 ## File path: sql/hive/src/main/scala/org/apache/spark/s

[GitHub] [spark] mengxr commented on issue #24851: [SPARK-27303][GRAPH] Add Spark Graph API

mengxr commented on issue #24851: [SPARK-27303][GRAPH] Add Spark Graph API URL: https://github.com/apache/spark/pull/24851#issuecomment-511918163 I'm making a pass now. Sorry for the late response! This is an automated message

[GitHub] [spark] vanzin commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

vanzin commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511920937 Merging to master. This is an automated message from the

[GitHub] [spark] vanzin closed pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

vanzin closed pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] mccheah edited a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah edited a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511924956 @cloud-fan I'm hesitant to introduce an API-only change because it introduces the API without any

[GitHub] [spark] mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511924956 @cloud-fan I'm hesitant to introduce an API-only change because it introduces the API without any context

[GitHub] [spark] mccheah edited a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah edited a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511924956 @cloud-fan I'm hesitant to introduce an API-only change because it introduces the API without any

[GitHub] [spark] squito commented on issue #24796: [SPARK-27900][CORE] Add uncaught exception handler to the driver

squito commented on issue #24796: [SPARK-27900][CORE] Add uncaught exception handler to the driver URL: https://github.com/apache/spark/pull/24796#issuecomment-511925835 yarn *does* add the same thing to executors: https://github.com/apache/spark/blob/master/resource-managers/yarn/src/main

[GitHub] [spark] mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511925927 We can also break this out into a `REPLACE TABLE` and then a separate `REPLACE TABLE AS SELECT` PR, but t

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926029 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926043 Test PASSed. Refer to this link for build results (a

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926029 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926871 **[Test build #107754 has started](https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511928608 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511928597 **[Test build #107754 has finished](https://amplab.cs.berkeley.edu/j

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511928615 Test FAILed. Refer to this link for build results (access ri

[GitHub] [spark] SparkQA removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

SparkQA removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926871 **[Test build #107754 has started](https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511928608 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511928615 Test FAILed. Refer to this link for build results (a

[GitHub] [spark] attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#discussion_r304016852 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ResourceR

[GitHub] [spark] attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#discussion_r304030057 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ResourceR

[GitHub] [spark] attilapiros commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

attilapiros commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511932063 It is already closed. Anyway if you think my comments useful even I can do this small changes in a follow-up or in a

[GitHub] [spark] srowen commented on issue #24947: [SPARK-28143][SQL] Expressions without proper constructors should throw AnalysisException

srowen commented on issue #24947: [SPARK-28143][SQL] Expressions without proper constructors should throw AnalysisException URL: https://github.com/apache/spark/pull/24947#issuecomment-511935149 @yaooqinn I think there are some last comments to address?

[GitHub] [spark] brkyvz commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

brkyvz commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511937029 I don't like large PRs either, but I also think that you can't build good abstractions before you have v

[GitHub] [spark] mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511938184 > I don't see too much worth in splitting them up now that we all have made multiple passes of review

[GitHub] [spark] SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511938700 **[Test build #107755 has started](https://amplab.cs.berkeley.edu/je

[GitHub] [spark] SparkQA commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

SparkQA commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940033 **[Test build #107752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107752/testReport)**

[GitHub] [spark] rdblue commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

rdblue commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511939893 I think there are a couple motivations for splitting PRs into smaller parts: 1. To make review easier

[GitHub] [spark] SparkQA removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

SparkQA removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511911612 **[Test build #107752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107752/testRepo

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940256 Merged build finished. Test FAILed. This is an automat

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940264 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940256 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940264 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511941733 Test PASSed. Refer to this link for build results (access ri

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511941722 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511941733 Test PASSed. Refer to this link for build results (a

[GitHub] [spark] dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304068825 ## File path: sql/catalyst/src/main/sc

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511941722 Merged build finished. Test PASSed. --

[GitHub] [spark] yeshengm commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

yeshengm commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304076457 ## File path: sql/catalyst/src/main/scala

<    1   2   3   4   5   6   7   8   9   >