[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-672020096 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-672019338 **[Test build #127334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127334/testReport)** for PR 28617 at commit [`4bf9711`](https://github.com

[GitHub] [spark] tgravescs commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

tgravescs commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-672019171 this PR doesn't change how its actually used, just allows you to get it via ResourceProfile. The code always has just adding it to the container size requested from yarn. Th

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672012063 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] SparkQA removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

SparkQA removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672008431 **[Test build #127333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127333/testReport)** for PR 29360 at commit [`7a748c2`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672012047 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672012029 **[Test build #127333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127333/testReport)** for PR 29360 at commit [`7a748c2`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672012047 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672009312 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672009312 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] mridulm edited a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

mridulm edited a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-672007797 @tgravescs Had a query regarding this PR : do we configure offheap memory (XX:MaxDirectMemorySize, etc) to ensure what is set via the flag can be honoured by jvm ? Or is

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672008431 **[Test build #127333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127333/testReport)** for PR 29360 at commit [`7a748c2`](https://github.com

[GitHub] [spark] mridulm commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

mridulm commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-672007797 @tgravescs Had a query regarding this PR : do we configure offheap memory (XX:MaxDirectMemorySize, etc) to ensure what is set via the flag can be honoured by jvm ? Or is this to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672004353 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672004353 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-672003736 **[Test build #127332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127332/testReport)** for PR 29360 at commit [`5bda4ad`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671994718 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] SparkQA removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671971592 **[Test build #127328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127328/testReport)** for PR 28617 at commit [`279cea6`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671994707 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671994707 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671994599 **[Test build #127328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127328/testReport)** for PR 28617 at commit [`279cea6`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

AmplabJenkins removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671990635 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

AmplabJenkins commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671990635 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] cchighman commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671990105 > Ah, one more; could you add fine-grained tests for the path filter implementations? Probably, you can create a dedicated test suite like `test/scala/org/apache/spark/sql/exe

[GitHub] [spark] SparkQA commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

SparkQA commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671989831 **[Test build #127331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127331/testReport)** for PR 28841 at commit [`042c36e`](https://github.com

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468636352 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathfilters/ModifiedAfterFilter.scala ## @@ -0,0 +1,59 @@ +/* + * Lice

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468636840 ## File path: python/pyspark/sql/readwriter.py ## @@ -114,6 +114,14 @@ def option(self, key, value): * ``pathGlobFilter``: an optional glob

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468636699 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ## @@ -467,6 +467,14 @@ class DataFrameReader private[sql](sparkSession

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468636142 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathfilters/FileIndexFilter.scala ## @@ -0,0 +1,26 @@ +/* + * Licensed

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468636017 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/pathfilters/FileIndexFilter.scala ## @@ -0,0 +1,26 @@ +/* + * Licensed

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468635076 ## File path: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala ## @@ -561,6 +564,367 @@ class FileBasedDataSourceSuite exten

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468634664 ## File path: sql/core/src/test/scala/org/apache/spark/sql/FileBasedDataSourceSuite.scala ## @@ -561,6 +564,367 @@ class FileBasedDataSourceSuite exten

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

AmplabJenkins removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671985860 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

AmplabJenkins commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671985860 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

SparkQA commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-671985182 **[Test build #127330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127330/testReport)** for PR 28841 at commit [`e6f8928`](https://github.com

[GitHub] [spark] cchighman commented on a change in pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on a change in pull request #28841: URL: https://github.com/apache/spark/pull/28841#discussion_r468630906 ## File path: docs/sql-data-sources-generic-options.md ## @@ -119,3 +119,37 @@ To load all files recursively, you can use: {% include_example recursive

[GitHub] [spark] AmplabJenkins commented on pull request #29406: [SPARK-32352][SQL] Partially push down support data filter if it mixed in partition filters

AmplabJenkins commented on pull request #29406: URL: https://github.com/apache/spark/pull/29406#issuecomment-671982538 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29406: [SPARK-32352][SQL] Partially push down support data filter if it mixed in partition filters

AmplabJenkins removed a comment on pull request #29406: URL: https://github.com/apache/spark/pull/29406#issuecomment-671982538 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29406: [SPARK-32352][SQL] Partially push down support data filter if it mixed in partition filters

SparkQA removed a comment on pull request #29406: URL: https://github.com/apache/spark/pull/29406#issuecomment-671856304 **[Test build #127321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127321/testReport)** for PR 29406 at commit [`5bb0fb9`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

AmplabJenkins removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-671981538 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

AmplabJenkins commented on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-671981538 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29406: [SPARK-32352][SQL] Partially push down support data filter if it mixed in partition filters

SparkQA commented on pull request #29406: URL: https://github.com/apache/spark/pull/29406#issuecomment-671981421 **[Test build #127321 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127321/testReport)** for PR 29406 at commit [`5bb0fb9`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

SparkQA commented on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-671980769 **[Test build #127329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127329/testReport)** for PR 29270 at commit [`67ce505`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

AmplabJenkins removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671979882 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

AmplabJenkins commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671979882 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671978494 **[Test build #127320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127320/testReport)** for PR 29369 at commit [`690e326`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

SparkQA removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671852134 **[Test build #127320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127320/testReport)** for PR 29369 at commit [`690e326`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671971592 **[Test build #127328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127328/testReport)** for PR 28617 at commit [`279cea6`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671968010 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29407: [SPARK-32588][TEST] Fix SizeEstimator initialization in tests.

AmplabJenkins commented on pull request #29407: URL: https://github.com/apache/spark/pull/29407#issuecomment-671967906 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671968010 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29407: [SPARK-32588][TEST] Fix SizeEstimator initialization in tests.

AmplabJenkins removed a comment on pull request #29407: URL: https://github.com/apache/spark/pull/29407#issuecomment-671967906 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29407: [SPARK-32588][TEST] Fix SizeEstimator initialization in tests.

SparkQA commented on pull request #29407: URL: https://github.com/apache/spark/pull/29407#issuecomment-671967193 **[Test build #127327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127327/testReport)** for PR 29407 at commit [`1715d66`](https://github.com

[GitHub] [spark] srowen commented on a change in pull request #29366: [SPARK-32550][SQL] Make SpecificInternalRow constructors faster by using while loops instead of maps

srowen commented on a change in pull request #29366: URL: https://github.com/apache/spark/pull/29366#discussion_r468603216 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/SpecificInternalRow.scala ## @@ -192,24 +192,41 @@ final class Mutable

[GitHub] [spark] srowen commented on pull request #29407: [SPARK-32588][TEST] Fix SizeEstimator initialization in tests.

srowen commented on pull request #29407: URL: https://github.com/apache/spark/pull/29407#issuecomment-671964271 Jenkins test this please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29407: [SPARK-32588][TEST] Fix SizeEstimator initialization in tests.

AmplabJenkins removed a comment on pull request #29407: URL: https://github.com/apache/spark/pull/29407#issuecomment-671909569 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

AmplabJenkins removed a comment on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671963332 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

AmplabJenkins commented on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671963332 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

SparkQA commented on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671962512 **[Test build #127326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127326/testReport)** for PR 29401 at commit [`48c77ab`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

AmplabJenkins removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671959676 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

AmplabJenkins commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671959676 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671957432 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] SparkQA removed a comment on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

SparkQA removed a comment on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671841371 **[Test build #127318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127318/testReport)** for PR 29369 at commit [`a9d5042`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29369: [SPARK-32540][SQL] Eliminate the filter clause in aggregate

SparkQA commented on pull request #29369: URL: https://github.com/apache/spark/pull/29369#issuecomment-671958563 **[Test build #127318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127318/testReport)** for PR 29369 at commit [`a9d5042`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671957417 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671953672 **[Test build #127325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127325/testReport)** for PR 28617 at commit [`b3a6e2b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671957393 **[Test build #127325 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127325/testReport)** for PR 28617 at commit [`b3a6e2b`](https://github.co

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

AngersZh commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468591888 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveSc

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671957417 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

AngersZh commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468590814 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveSc

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins removed a comment on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671954424 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

AmplabJenkins commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671954424 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] tgravescs commented on a change in pull request #29395: [3.0][SPARK-32518][CORE] CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

tgravescs commented on a change in pull request #29395: URL: https://github.com/apache/spark/pull/29395#discussion_r468587871 ## File path: core/src/test/scala/org/apache/spark/BarrierStageOnSubmittedSuite.scala ## @@ -259,4 +262,37 @@ class BarrierStageOnSubmittedSuite extend

[GitHub] [spark] SparkQA commented on pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

SparkQA commented on pull request #28617: URL: https://github.com/apache/spark/pull/28617#issuecomment-671953672 **[Test build #127325 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127325/testReport)** for PR 28617 at commit [`b3a6e2b`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29395: [3.0][SPARK-32518][CORE] CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

AmplabJenkins removed a comment on pull request #29395: URL: https://github.com/apache/spark/pull/29395#issuecomment-671949776 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29395: [3.0][SPARK-32518][CORE] CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

AmplabJenkins commented on pull request #29395: URL: https://github.com/apache/spark/pull/29395#issuecomment-671949776 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] Ngone51 commented on a change in pull request #29395: [3.0][SPARK-32518][CORE] CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

Ngone51 commented on a change in pull request #29395: URL: https://github.com/apache/spark/pull/29395#discussion_r468582181 ## File path: core/src/test/scala/org/apache/spark/BarrierStageOnSubmittedSuite.scala ## @@ -259,4 +262,37 @@ class BarrierStageOnSubmittedSuite extends

[GitHub] [spark] SparkQA commented on pull request #29395: [3.0][SPARK-32518][CORE] CoarseGrainedSchedulerBackend.maxNumConcurrentTasks should consider all kinds of resources

SparkQA commented on pull request #29395: URL: https://github.com/apache/spark/pull/29395#issuecomment-671949201 **[Test build #127324 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127324/testReport)** for PR 29395 at commit [`f635c18`](https://github.com

[GitHub] [spark] srowen commented on pull request #29370: [SPARK-32526][SQL]Fix some test cases of `sql/catalyst` module in scala 2.13

srowen commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-671945416 If there aren't any more fixes that are similar here, I can merge this. We can add more now if there are others that are easily fixable in SQL. -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

AmplabJenkins removed a comment on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671942580 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

SparkQA removed a comment on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671825983 **[Test build #127317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127317/testReport)** for PR 29401 at commit [`0b121c1`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

AmplabJenkins commented on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671942580 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29408: [WIP][SPARK-32250][CORE] Check whether the MasterSuite.test(SPARK-27510...) is still flaky in Github Action

AmplabJenkins removed a comment on pull request #29408: URL: https://github.com/apache/spark/pull/29408#issuecomment-671941391 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

SparkQA commented on pull request #29401: URL: https://github.com/apache/spark/pull/29401#issuecomment-671941532 **[Test build #127317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127317/testReport)** for PR 29401 at commit [`0b121c1`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #29408: [WIP][SPARK-32250][CORE] Check whether the MasterSuite.test(SPARK-27510...) is still flaky in Github Action

AmplabJenkins commented on pull request #29408: URL: https://github.com/apache/spark/pull/29408#issuecomment-671941391 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29408: [WIP][SPARK-32250][CORE] Check whether the MasterSuite.test(SPARK-27510...) is still flaky in Github Action

SparkQA commented on pull request #29408: URL: https://github.com/apache/spark/pull/29408#issuecomment-671940797 **[Test build #127323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127323/testReport)** for PR 29408 at commit [`4e1d8ec`](https://github.com

[GitHub] [spark] Ngone51 opened a new pull request #29408: [WIP][SPARK-32250][CORE] Check whether the MasterSuite.test(SPARK-27510...) is still flaky in Github Action

Ngone51 opened a new pull request #29408: URL: https://github.com/apache/spark/pull/29408 Previously, the test is flaky in Github Action due to `Runtime.getRuntim.availableProcessors()` only return 2. Therefore, there are insufficient threads in `Dispatcher` to consume the messages, which

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468565419 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveScriptTr

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468565060 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveScriptTr

[GitHub] [spark] stczwd commented on a change in pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions APIs on DataSourceV2

stczwd commented on a change in pull request #28617: URL: https://github.com/apache/spark/pull/28617#discussion_r468561205 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/SupportsAtomicPartitionManagement.java ## @@ -0,0 +1,87 @@ +/* + * License

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468560833 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveScriptTr

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468560334 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveScriptTr

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468559774 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveScriptTransformationSuite.scala ## @@ -195,75 +169,146 @@ class HiveScriptTr

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468558950 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@ -1063,6 +1063,9 @@ private[hive] trait HiveInspectors {

[GitHub] [spark] maropu commented on a change in pull request #29401: [SPARK-32400][SQL] Improve test coverage of HiveScriptTransformationExec

maropu commented on a change in pull request #29401: URL: https://github.com/apache/spark/pull/29401#discussion_r468558137 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/BaseScriptTransformationSuite.scala ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apac

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

AmplabJenkins removed a comment on pull request #29403: URL: https://github.com/apache/spark/pull/29403#issuecomment-671910276 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/127

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

AmplabJenkins removed a comment on pull request #29403: URL: https://github.com/apache/spark/pull/29403#issuecomment-671910265 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

AmplabJenkins commented on pull request #29403: URL: https://github.com/apache/spark/pull/29403#issuecomment-671910265 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

SparkQA removed a comment on pull request #29403: URL: https://github.com/apache/spark/pull/29403#issuecomment-671845010 **[Test build #127319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127319/testReport)** for PR 29403 at commit [`0f98bef`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29407: [SPARK-32588][TEST] Fix SizeEstimator initialization in tests.

AmplabJenkins removed a comment on pull request #29407: URL: https://github.com/apache/spark/pull/29407#issuecomment-671909043 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

<    1   2   3   4   5   6   7   >