[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-512061401 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-512061395 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-512061395 Merged build finished. Test PASSed.

[GitHub] [spark] dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304188405 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #25176: [SPARK-28417][Spark Core] Wrap File Glob Resolution in DoAs to use ProxyUser Credentials

2019-07-16 Thread GitBox
dongjoon-hyun commented on issue #25176: [SPARK-28417][Spark Core] Wrap File Glob Resolution in DoAs to use ProxyUser Credentials URL: https://github.com/apache/spark/pull/25176#issuecomment-512065475 Hi, @modi95 . Thank you for contribution. What unit test do you mean? If there is no new

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-512067808 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] xianyinxin commented on issue #25169: [SPARK-21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly.

2019-07-16 Thread GitBox
xianyinxin commented on issue #25169: [SPARK-21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly. URL: https://github.com/apache/spark/pull/25169#issuecomment-512067835 @dongjoon-hyun fine, will do that.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-512067803 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-512067803 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-512067808 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304188405 ## File path:

[GitHub] [spark] mengxr commented on issue #24851: [SPARK-27303][GRAPH] Add Spark Graph API

2019-07-16 Thread GitBox
mengxr commented on issue #24851: [SPARK-27303][GRAPH] Add Spark Graph API URL: https://github.com/apache/spark/pull/24851#issuecomment-511918163 I'm making a pass now. Sorry for the late response! This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926029 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926043 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926029 Merged build finished. Test PASSed.

[GitHub] [spark] attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#discussion_r304016852 ## File path:

[GitHub] [spark] attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
attilapiros commented on a change in pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#discussion_r304030057 ## File path:

[GitHub] [spark] srowen commented on issue #24947: [SPARK-28143][SQL] Expressions without proper constructors should throw AnalysisException

2019-07-16 Thread GitBox
srowen commented on issue #24947: [SPARK-28143][SQL] Expressions without proper constructors should throw AnalysisException URL: https://github.com/apache/spark/pull/24947#issuecomment-511935149 @yaooqinn I think there are some last comments to address?

[GitHub] [spark] brkyvz commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
brkyvz commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511937029 I don't like large PRs either, but I also think that you can't build good abstractions before you have

[GitHub] [spark] AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940264 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
SparkQA commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511950480 **[Test build #107756 has

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511959092 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511959083 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval URL: https://github.com/apache/spark/pull/25173#issuecomment-511963037 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval URL: https://github.com/apache/spark/pull/25173#issuecomment-511963352 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval URL: https://github.com/apache/spark/pull/25173#issuecomment-511963345 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #25174: [SPARK-27485][BRANCH-2.4] EnsureRequirements.reorder should handle duplicate expressions gracefully

2019-07-16 Thread GitBox
SparkQA commented on issue #25174: [SPARK-27485][BRANCH-2.4] EnsureRequirements.reorder should handle duplicate expressions gracefully URL: https://github.com/apache/spark/pull/25174#issuecomment-511991024 **[Test build #107760 has

[GitHub] [spark] SparkQA commented on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory

2019-07-16 Thread GitBox
SparkQA commented on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory URL: https://github.com/apache/spark/pull/22560#issuecomment-511991052 **[Test build #107761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107761/testReport)** for PR

[GitHub] [spark] vanzin commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
vanzin commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511920937 Merging to master. This is an automated message from

[GitHub] [spark] SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
SparkQA commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511926871 **[Test build #107754 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511928615 Test FAILed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511949601 Merged build finished. Test PASSed.

[GitHub] [spark] fsauer65 commented on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory

2019-07-16 Thread GitBox
fsauer65 commented on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory URL: https://github.com/apache/spark/pull/22560#issuecomment-511949710 Is DSv2 on master? In other words, if I resolve the merge conflict we're good?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511949601 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511949611 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511952176 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511952184 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511952184 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

2019-07-16 Thread GitBox
SparkQA removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511905282 **[Test build #107748 has

[GitHub] [spark] AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511955926 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

2019-07-16 Thread GitBox
SparkQA commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511955439 **[Test build #107748 has

[GitHub] [spark] AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511955932 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-16 Thread GitBox
dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304089955 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511959092 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511960741 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval

2019-07-16 Thread GitBox
SparkQA commented on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval URL: https://github.com/apache/spark/pull/25173#issuecomment-511964088 **[Test build #107758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107758/testReport)**

[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-16 Thread GitBox
SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511967123 **[Test build #107747 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511968830 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511968826 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory URL: https://github.com/apache/spark/pull/22560#issuecomment-511982186 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory URL: https://github.com/apache/spark/pull/22560#issuecomment-510680246 Can one of the admins verify this patch? This is an

[GitHub] [spark] SparkQA removed a comment on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory

2019-07-16 Thread GitBox
SparkQA removed a comment on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory URL: https://github.com/apache/spark/pull/22560#issuecomment-511981502 **[Test build #107759 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107759/testReport)**

[GitHub] [spark] vanzin closed pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
vanzin closed pull request #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
mccheah commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511938184 > I don't see too much worth in splitting them up now that we all have made multiple passes of review

[GitHub] [spark] SparkQA removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
SparkQA removed a comment on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511911612 **[Test build #107752 has

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940256 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940264 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
SparkQA commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511940033 **[Test build #107752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107752/testReport)**

[GitHub] [spark] rdblue commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2

2019-07-16 Thread GitBox
rdblue commented on issue #24798: [SPARK-27724][SQL] Implement REPLACE TABLE and REPLACE TABLE AS SELECT with V2 URL: https://github.com/apache/spark/pull/24798#issuecomment-511939893 I think there are a couple motivations for splitting PRs into smaller parts: 1. To make review easier

[GitHub] [spark] AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25152: [SPARK-28388][SQL][TEST] Port select_implicit.sql URL: https://github.com/apache/spark/pull/25152#issuecomment-511952176 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] rdblue commented on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory

2019-07-16 Thread GitBox
rdblue commented on issue #22560: [SPARK-25547][SQL] Pluggable JDBC connection factory URL: https://github.com/apache/spark/pull/22560#issuecomment-511955774 @fsauer65, yes. DSv2 is in master. This is an automated message

[GitHub] [spark] mgaido91 commented on issue #21942: [SPARK-24283][ML] Make ml.StandardScaler skip conversion of Spar…

2019-07-16 Thread GitBox
mgaido91 commented on issue #21942: [SPARK-24283][ML] Make ml.StandardScaler skip conversion of Spar… URL: https://github.com/apache/spark/pull/21942#issuecomment-511955807 @sujithjay are you still active on this PR? Or shall someone take this over?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service.

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24817: [SPARK-27963][core] Allow dynamic allocation without a shuffle service. URL: https://github.com/apache/spark/pull/24817#issuecomment-511955926 Merged build finished. Test FAILed.

[GitHub] [spark] mgaido91 commented on issue #25167: [SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully

2019-07-16 Thread GitBox
mgaido91 commented on issue #25167: [SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully URL: https://github.com/apache/spark/pull/25167#issuecomment-511961666 a late LGTM, sorry for the delay and thanks for the fix @hvanhovell !

[GitHub] [spark] MaxGekk opened a new pull request #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval

2019-07-16 Thread GitBox
MaxGekk opened a new pull request #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval URL: https://github.com/apache/spark/pull/25173 ## What changes were proposed in this pull request? The `DateTimeUtils.timestampAddInterval` method was rewritten by using Java 8

[GitHub] [spark] AmplabJenkins removed a comment on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25173: [SPARK-28416][SQL] Use java.time API in timestampAddInterval URL: https://github.com/apache/spark/pull/25173#issuecomment-511963037 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511968826 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511968830 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
dilipbiswal commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304099586 ## File path:

[GitHub] [spark] hvanhovell opened a new pull request #25174: [SPARK-27485][BRANCH-2.4] EnsureRequirements.reorder should handle duplicate expressions gracefully

2019-07-16 Thread GitBox
hvanhovell opened a new pull request #25174: [SPARK-27485][BRANCH-2.4] EnsureRequirements.reorder should handle duplicate expressions gracefully URL: https://github.com/apache/spark/pull/25174 Backport of 421d9d56efd447d31787e77316ce0eafb5fe45a5 ## What changes were proposed in this

[GitHub] [spark] gengliangwang edited a comment on issue #25137: [SPARK-28348][SQL] Decimal precision promotion for binary arithmetic with casted decimal type

2019-07-16 Thread GitBox
gengliangwang edited a comment on issue #25137: [SPARK-28348][SQL] Decimal precision promotion for binary arithmetic with casted decimal type URL: https://github.com/apache/spark/pull/25137#issuecomment-511822926 I am actually slightly -1 with this proposal. If this is OK, in following

[GitHub] [spark] dongjoon-hyun commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-16 Thread GitBox
dongjoon-hyun commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-511879098 Gentle ping. This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511882949 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511882939 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

2019-07-16 Thread GitBox
SparkQA commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511883758 **[Test build #107744 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511889254 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511889265 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511889265 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] holdenk commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

2019-07-16 Thread GitBox
holdenk commented on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511895621 Jenkins ok to test This is an automated message from

[GitHub] [spark] holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API

2019-07-16 Thread GitBox
holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#discussion_r304010743 ## File path: python/pyspark/sql/catalog.py ## @@ -138,6 +139,78 @@ def

[GitHub] [spark] SparkQA removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
SparkQA removed a comment on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511886988 **[Test build #107745 has

[GitHub] [spark] AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895660 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895669 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#issuecomment-511053894 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount

2019-07-16 Thread GitBox
SparkQA commented on issue #24989: [SPARK-27959][YARN] Change YARN resource configs to use .amount URL: https://github.com/apache/spark/pull/24989#issuecomment-511895552 **[Test build #107745 has

[GitHub] [spark] holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API

2019-07-16 Thread GitBox
holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#discussion_r304011185 ## File path: python/pyspark/sql/catalog.py ## @@ -138,6 +139,78 @@ def

[GitHub] [spark] holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API

2019-07-16 Thread GitBox
holdenk commented on a change in pull request #20658: [SPARK-23488][python] Add missing catalog methods to python API URL: https://github.com/apache/spark/pull/20658#discussion_r304011700 ## File path: python/pyspark/sql/catalog.py ## @@ -138,6 +139,78 @@ def

[GitHub] [spark] SparkQA commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

2019-07-16 Thread GitBox
SparkQA commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511897700 **[Test build #107740 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107740/testReport)** for PR

[GitHub] [spark] rdblue commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables.

2019-07-16 Thread GitBox
rdblue commented on a change in pull request #25040: [SPARK-28238][SQL] Implement DESCRIBE TABLE for Data Source V2 Tables. URL: https://github.com/apache/spark/pull/25040#discussion_r304020365 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910726 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910732 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511908975 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-16 Thread GitBox
sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304030670 ## File path:

[GitHub] [spark] gatorsmile commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
gatorsmile commented on a change in pull request #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#discussion_r304030121 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511910846 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] yeshengm commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
yeshengm commented on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910370 retest this please

[GitHub] [spark] sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-16 Thread GitBox
sujith71955 commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r304029971 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#issuecomment-511910830 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2

2019-07-16 Thread GitBox
AmplabJenkins commented on issue #25157: [WIP][SPARK-28396][SQL] Add PathCatalog for data source V2 URL: https://github.com/apache/spark/pull/25157#issuecomment-511910826 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times

2019-07-16 Thread GitBox
AmplabJenkins removed a comment on issue #25164: [SPARK-28375] Prevent the PullupCorrelatedPredicates optimizer rule from removing predicates if run multiple times URL: https://github.com/apache/spark/pull/25164#issuecomment-511910726 Merged build finished. Test PASSed.

<    1   2   3   4   5   6   7   8   9   >