[GitHub] [spark] cloud-fan commented on a change in pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
cloud-fan commented on a change in pull request #28962: URL: https://github.com/apache/spark/pull/28962#discussion_r448155485 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NormalizeFloatingNumbers.scala ## @@ -123,7 +123,8 @@ object Normaliz

[GitHub] [spark] moomindani commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
moomindani commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r448156275 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -122,6 +122,37 @@ object JdbcUtils extends

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448156640 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -102,6 +105,7 @@ class ResolveSessionCat

[GitHub] [spark] dilipbiswal commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
dilipbiswal commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-652233776 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] dilipbiswal commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
dilipbiswal commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r448157295 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -122,6 +122,37 @@ object JdbcUtils extend

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448157276 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala ## @@ -106,7 +107,7 @@ class ResolveHiveSerdeTable(session: SparkS

[GitHub] [spark] dilipbiswal commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
dilipbiswal commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r448157295 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -122,6 +122,37 @@ object JdbcUtils extend

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-652235278 **[Test build #124748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124748/testReport)** for PR 28953 at commit [`0db0376`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652235381 **[Test build #124749 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124749/testReport)** for PR 28833 at commit [`de08967`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-652235866 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652235840 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448159476 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala ## @@ -2309,6 +2309,108 @@ class HiveDDLSuite } }

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652235853 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-652235877 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #27900: [SPARK-31100][SQL] Check namespace existens when setting namespace

2020-07-01 Thread GitBox
cloud-fan commented on pull request #27900: URL: https://github.com/apache/spark/pull/27900#issuecomment-652236924 how about this: we check namespace existence if the catalog implements `SupportsNamespace`. Otherwise, we just allow it. -

[GitHub] [spark] cloud-fan closed pull request #28925: [SPARK-32095][SQL] Update documentation to reflect usage of updated statistics

2020-07-01 Thread GitBox
cloud-fan closed pull request #28925: URL: https://github.com/apache/spark/pull/28925 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] cloud-fan commented on pull request #28925: [SPARK-32095][SQL] Update documentation to reflect usage of updated statistics

2020-07-01 Thread GitBox
cloud-fan commented on pull request #28925: URL: https://github.com/apache/spark/pull/28925#issuecomment-652237485 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-649230871 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] cloud-fan commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
cloud-fan commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652238618 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [spark] SparkQA commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652238602 **[Test build #124750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124750/testReport)** for PR 28957 at commit [`dd288ca`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652239139 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652239203 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] dongjoon-hyun commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652239258 Does this close https://github.com/apache/spark/pull/28935 too? This is an automated message from the Apac

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652239139 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652239203 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652239450 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] yaooqinn opened a new pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
yaooqinn opened a new pull request #28963: URL: https://github.com/apache/spark/pull/28963 ### What changes were proposed in this pull request? In https://issues.apache.org/jira/browse/SPARK-29283, we only show the error message of root cause to end-users through JDBC client. In

[GitHub] [spark] SparkQA removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652238602 **[Test build #124750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124750/testReport)** for PR 28957 at commit [`dd288ca`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
SparkQA commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652239432 **[Test build #124750 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124750/testReport)** for PR 28957 at commit [`dd288ca`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28957: [WIP][SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-652239461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] yaooqinn commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
yaooqinn commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652240430 cc @juliuszsompolski @cloud-fan @maropu @wangyum @LantaoJin thanks This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448165084 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Ca

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448165084 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Ca

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652241835 **[Test build #124752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124752/testReport)** for PR 28926 at commit [`24384c9`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

2020-07-01 Thread GitBox
SparkQA commented on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-652241921 **[Test build #124753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124753/testReport)** for PR 28885 at commit [`fd522ea`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-652242395 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] SparkQA commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
SparkQA commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652242156 **[Test build #124751 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124751/testReport)** for PR 28963 at commit [`7cb0ae8`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
SparkQA commented on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652242152 **[Test build #124754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124754/testReport)** for PR 28882 at commit [`35ec888`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-652242395 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652242452 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652242452 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652242680 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652242680 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] TJX2014 commented on a change in pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
TJX2014 commented on a change in pull request #28882: URL: https://github.com/apache/spark/pull/28882#discussion_r448168566 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala ## @@ -181,41 +182,47 @@ class HiveExternalCatalogSuite ex

[GitHub] [spark] AmplabJenkins commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652244353 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652242156 **[Test build #124751 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124751/testReport)** for PR 28963 at commit [`7cb0ae8`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652244353 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
SparkQA commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652244336 **[Test build #124751 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124751/testReport)** for PR 28963 at commit [`7cb0ae8`](https://github.co

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448170235 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Catalo

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448170235 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Catalo

[GitHub] [spark] SparkQA commented on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-07-01 Thread GitBox
SparkQA commented on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-652244799 **[Test build #124709 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124709/testReport)** for PR 28852 at commit [`1d5248e`](https://github.co

[GitHub] [spark] stczwd commented on pull request #27900: [SPARK-31100][SQL] Check namespace existens when setting namespace

2020-07-01 Thread GitBox
stczwd commented on pull request #27900: URL: https://github.com/apache/spark/pull/27900#issuecomment-652244744 > how about this: we check namespace existence if the catalog implements `SupportsNamespace`. Otherwise, we just allow it. Ah, that's a better idea. thanks @cloud-fan

[GitHub] [spark] TJX2014 commented on a change in pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
TJX2014 commented on a change in pull request #28882: URL: https://github.com/apache/spark/pull/28882#discussion_r448168566 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogSuite.scala ## @@ -181,41 +182,47 @@ class HiveExternalCatalogSuite ex

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448171612 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Catalo

[GitHub] [spark] SparkQA commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-07-01 Thread GitBox
SparkQA commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-652245843 **[Test build #124719 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124719/testReport)** for PR 28904 at commit [`11cb693`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-652138181 **[Test build #124719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124719/testReport)** for PR 28904 at commit [`11cb693`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

2020-07-01 Thread GitBox
cloud-fan commented on a change in pull request #28947: URL: https://github.com/apache/spark/pull/28947#discussion_r448172830 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewedJoin.scala ## @@ -286,6 +283,36 @@ case class OptimizeSkewe

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448172950 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -319,6 +323,7 @@ class ResolveSessio

[GitHub] [spark] AmplabJenkins commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-652247425 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-652247425 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448173447 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Catalo

[GitHub] [spark] cloud-fan commented on a change in pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

2020-07-01 Thread GitBox
cloud-fan commented on a change in pull request #28947: URL: https://github.com/apache/spark/pull/28947#discussion_r448172830 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewedJoin.scala ## @@ -286,6 +283,36 @@ case class OptimizeSkewe

[GitHub] [spark] cloud-fan commented on a change in pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

2020-07-01 Thread GitBox
cloud-fan commented on a change in pull request #28947: URL: https://github.com/apache/spark/pull/28947#discussion_r448173490 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewedJoin.scala ## @@ -286,6 +283,36 @@ case class OptimizeSkewe

[GitHub] [spark] AmplabJenkins commented on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-652247757 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-652247430 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-652247757 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
SparkQA commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652248540 **[Test build #124738 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124738/testReport)** for PR 28917 at commit [`da6a9f7`](https://github.co

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448175519 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Ca

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652249556 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652249556 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448176200 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Ca

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
dongjoon-hyun commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448176200 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/CatalogV2Util.scala ## @@ -346,4 +346,23 @@ private[sql] object Ca

[GitHub] [spark] AmplabJenkins commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652250759 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652250759 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] beliefer commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
beliefer commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652251921 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652250777 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA commented on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
SparkQA commented on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652252380 **[Test build #124754 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124754/testReport)** for PR 28882 at commit [`35ec888`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652252446 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-652120021 **[Test build #124708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124708/testReport)** for PR 27690 at commit [`8bfe421`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652242152 **[Test build #124754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124754/testReport)** for PR 28882 at commit [`35ec888`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
SparkQA commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652252749 **[Test build #124756 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124756/testReport)** for PR 28917 at commit [`da6a9f7`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652253440 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/29368/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28882: [SPARK-31751][SQL]Serde property `path` overwrites hive table property location

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28882: URL: https://github.com/apache/spark/pull/28882#issuecomment-652252462 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652253431 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652241835 **[Test build #124752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124752/testReport)** for PR 28926 at commit [`24384c9`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652254298 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652143890 **[Test build #124725 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124725/testReport)** for PR 27620 at commit [`0e972fc`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652254298 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
SparkQA commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652254154 **[Test build #124725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124725/testReport)** for PR 27620 at commit [`0e972fc`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652254228 **[Test build #124752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124752/testReport)** for PR 28926 at commit [`24384c9`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-652255027 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-652254306 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-652255034 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652256015 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124725/

[GitHub] [spark] SparkQA commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
SparkQA commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652256563 **[Test build #124758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124758/testReport)** for PR 28963 at commit [`ba0c44d`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652256015 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA commented on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

2020-07-01 Thread GitBox
SparkQA commented on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-652256607 **[Test build #124757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124757/testReport)** for PR 28964 at commit [`89779c4`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-652257228 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-652257228 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652257402 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

  1   2   3   4   5   6   7   8   9   10   >