[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655023119 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655023691 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655023082 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655023082 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-654856716 **[Test build #125221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125221/testReport)** for PR 28972 at commit

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655021517 **[Test build #125221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125221/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655015489 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655015483 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015894 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015894 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-654899416 **[Test build #125229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125229/testReport)** for PR 28986 at commit

[GitHub] [spark] SparkQA commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-07 Thread GitBox
SparkQA commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-655015205 **[Test build #125239 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125239/testReport)** for PR 28972 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655015483 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655014888 @dongjoon-hyun @srowen May I ask you review this refactoring. This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-07 Thread GitBox
SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655014761 **[Test build #125229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125229/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655011976 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655011976 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-654770478 **[Test build #125209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125209/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-07 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655010440 **[Test build #125209 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125209/testReport)** for PR 28998 at commit

[GitHub] [spark] baohe-zhang commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
baohe-zhang commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-655002716 I measured the memory usage of some smaller apps, the results are: * 200 jobs, 400 tasks for each job: 265 MB file size, 57.9 MB memory usage. * 100 jobs, 400

[GitHub] [spark] wypoon commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-07 Thread GitBox
wypoon commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655000416 Thanks @dongjoon-hyun for the move to disable the doc generation in Jenkins. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654998901 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654998890 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654998890 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654837665 **[Test build #125219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125219/testReport)** for PR 28412 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654994583 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654994574 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654994574 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654809085 **[Test build #125215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125215/testReport)** for PR 29021 at commit

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-07 Thread GitBox
SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-654994212 **[Test build #125219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125219/testReport)** for PR 28412 at commit

[GitHub] [spark] SparkQA commented on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-07 Thread GitBox
SparkQA commented on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-654993639 **[Test build #125215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125215/testReport)** for PR 29021 at commit

[GitHub] [spark] fqaiser94 commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
fqaiser94 commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654992303 Done, and thank you all for a great experience! This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654991355 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654991355 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-07 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654990313 **[Test build #125238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125238/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-654644357 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-654644343 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-654586579 **[Test build #125176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125176/testReport)** for PR 26935 at commit

[GitHub] [spark] dilipbiswal commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-07 Thread GitBox
dilipbiswal commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r451004154 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -122,6 +122,37 @@ object JdbcUtils

[GitHub] [spark] dongjoon-hyun commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-654988409 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-654986648 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-654986641 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-654986731 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-654986755 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-654986867 Ur, @cloud-fan . It seems that there is a missing part at `SelectedFieldSuite.scala`. ``` [info] - SELECT "col3.field1.subfield1" should select the schema

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-654986731 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-654986755 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-654986641 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-07 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-654986241 **[Test build #125237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125237/testReport)** for PR 28979 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-654873866 **[Test build #125223 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125223/testReport)** for PR 29019 at commit

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-654986192 **[Test build #125236 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125236/testReport)** for PR 29022 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-654985799 Hi, @cloud-fan . SPARK-28067 is merged for 3.1.0 only. This also aims 3.1.0 only? This is an automated

[GitHub] [spark] SparkQA commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-07 Thread GitBox
SparkQA commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-654986047 **[Test build #125223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125223/testReport)** for PR 29019 at commit

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29025: [SPARK-32211][SQL] Pin mariadb-plugin-gssapi-server version to fix MariaDBKrbIntegrationSuite

2020-07-07 Thread GitBox
dongjoon-hyun edited a comment on pull request #29025: URL: https://github.com/apache/spark/pull/29025#issuecomment-654984413 Thanks for keeping this healthy, @gaborgsomogyi ! This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on pull request #29025: [SPARK-32211][SQL] Pin mariadb-plugin-gssapi-server version to fix MariaDBKrbIntegrationSuite

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #29025: URL: https://github.com/apache/spark/pull/29025#issuecomment-654984413 Thanks, @gaborgsomogyi ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun closed pull request #29025: [SPARK-32211][SQL] Pin mariadb-plugin-gssapi-server version to fix MariaDBKrbIntegrationSuite

2020-07-07 Thread GitBox
dongjoon-hyun closed pull request #29025: URL: https://github.com/apache/spark/pull/29025 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] cloud-fan commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
cloud-fan commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-654984212 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-654978851 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
cloud-fan commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654982786 @fqaiser94 can you leave a comment in the JIRA ticket? So that I can assign it to you. Thanks for your great work!

[GitHub] [spark] viirya commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-07 Thread GitBox
viirya commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-654982202 I noticed this too when I played with other PR. I thought it was by purpose. If it is not, looks okay to add it.

[GitHub] [spark] SparkQA commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
SparkQA commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-654982224 **[Test build #125235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125235/testReport)** for PR 29026 at commit

[GitHub] [spark] cloud-fan closed pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
cloud-fan closed pull request #27066: URL: https://github.com/apache/spark/pull/27066 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
cloud-fan commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654981625 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on a change in pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
cloud-fan commented on a change in pull request #29026: URL: https://github.com/apache/spark/pull/29026#discussion_r450994003 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java ## @@ -288,7 +288,7 @@ public void setDecimal(int

[GitHub] [spark] cloud-fan commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
cloud-fan commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-654979274 cc @skambha @rednaxelafx @viirya This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-654978851 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan opened a new pull request #29026: [SPARK-28067][SPARK-32018] fix decimal overflow issues

2020-07-07 Thread GitBox
cloud-fan opened a new pull request #29026: URL: https://github.com/apache/spark/pull/29026 ### What changes were proposed in this pull request? This is a followup of https://github.com/apache/spark/pull/27627 to fix the remaining issues. There are 2 issues fixed in this PR:

[GitHub] [spark] dongjoon-hyun commented on pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-07 Thread GitBox
dongjoon-hyun commented on pull request #29023: URL: https://github.com/apache/spark/pull/29023#issuecomment-654966208 cc @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654962174 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654962174 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
SparkQA commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654961115 **[Test build #125234 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125234/testReport)** for PR 29024 at commit

[GitHub] [spark] gaborgsomogyi commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
gaborgsomogyi commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654958150 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] gaborgsomogyi commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
gaborgsomogyi commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654957796 The failure seems related so checking it... This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654953053 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654953053 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654953315 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654953315 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654952027 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
viirya commented on a change in pull request #28988: URL: https://github.com/apache/spark/pull/28988#discussion_r450963887 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasing.scala ## @@ -174,9 +176,12 @@ object

[GitHub] [spark] SparkQA commented on pull request #28988: [SPARK-32163][SQL] Nested pruning should work even with cosmetic variations

2020-07-07 Thread GitBox
SparkQA commented on pull request #28988: URL: https://github.com/apache/spark/pull/28988#issuecomment-654952432 **[Test build #125233 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125233/testReport)** for PR 28988 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654952018 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654952018 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-07 Thread GitBox
SparkQA commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654952244 **[Test build #125232 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125232/testReport)** for PR 28996 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654833408 **[Test build #125218 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125218/testReport)** for PR 29024 at commit

[GitHub] [spark] SparkQA commented on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
SparkQA commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654951449 **[Test build #125218 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125218/testReport)** for PR 29024 at commit

[GitHub] [spark] viirya commented on pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-07 Thread GitBox
viirya commented on pull request #28996: URL: https://github.com/apache/spark/pull/28996#issuecomment-654949758 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28989: [WIP][SPARK-27194][SPARK-29302][SQL] Define a spark staging committer to resolve FileAlreadyExistingException

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #28989: URL: https://github.com/apache/spark/pull/28989#issuecomment-654948841 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] huaxingao commented on pull request #28990: [SPARK-32164][ML] GeneralizedLinearRegressionSummary optimization

2020-07-07 Thread GitBox
huaxingao commented on pull request #28990: URL: https://github.com/apache/spark/pull/28990#issuecomment-654948910 Merged to master. Thanks everyone! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins commented on pull request #28989: [WIP][SPARK-27194][SPARK-29302][SQL] Define a spark staging committer to resolve FileAlreadyExistingException

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #28989: URL: https://github.com/apache/spark/pull/28989#issuecomment-654948841 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gaborgsomogyi commented on pull request #29024: [SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-07 Thread GitBox
gaborgsomogyi commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-654946886 cc @dongjoon-hyun @maropu This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #28989: [WIP][SPARK-27194][SPARK-29302][SQL] Define a spark staging committer to resolve FileAlreadyExistingException

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #28989: URL: https://github.com/apache/spark/pull/28989#issuecomment-654793884 **[Test build #125212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125212/testReport)** for PR 28989 at commit

[GitHub] [spark] SparkQA commented on pull request #28989: [WIP][SPARK-27194][SPARK-29302][SQL] Define a spark staging committer to resolve FileAlreadyExistingException

2020-07-07 Thread GitBox
SparkQA commented on pull request #28989: URL: https://github.com/apache/spark/pull/28989#issuecomment-654946483 **[Test build #125212 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125212/testReport)** for PR 28989 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654945919 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654945919 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] huaxingao closed pull request #28990: [SPARK-32164][ML] GeneralizedLinearRegressionSummary optimization

2020-07-07 Thread GitBox
huaxingao closed pull request #28990: URL: https://github.com/apache/spark/pull/28990 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
SparkQA commented on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654943375 **[Test build #125198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125198/testReport)** for PR 27066 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27066: [SPARK-31317][SQL] Add withField method to Column

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #27066: URL: https://github.com/apache/spark/pull/27066#issuecomment-654684720 **[Test build #125198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125198/testReport)** for PR 27066 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-07 Thread GitBox
SparkQA removed a comment on pull request #29023: URL: https://github.com/apache/spark/pull/29023#issuecomment-654899529 **[Test build #125228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125228/testReport)** for PR 29023 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-07 Thread GitBox
AmplabJenkins removed a comment on pull request #29023: URL: https://github.com/apache/spark/pull/29023#issuecomment-654941806 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-07 Thread GitBox
AmplabJenkins commented on pull request #29023: URL: https://github.com/apache/spark/pull/29023#issuecomment-654941806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

<    3   4   5   6   7   8   9   10   11   12   >