[jira] [Created] (SPARK-35948) Simplify release scripts by removing Spark 2.4/Java7 parts

Dongjoon Hyun created SPARK-35948: - Summary: Simplify release scripts by removing Spark 2.4/Java7 parts Key: SPARK-35948 URL: https://issues.apache.org/jira/browse/SPARK-35948 Project: Spark

[jira] [Resolved] (SPARK-35935) REPAIR TABLE fails on table refreshing

[ https://issues.apache.org/jira/browse/SPARK-35935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35935. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33137 [https://github.com

[jira] [Assigned] (SPARK-35947) Increase JVM stack size in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-35947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35947: Assignee: (was: Apache Spark) > Increase JVM stack size in release-build.sh > ---

[jira] [Commented] (SPARK-35947) Increase JVM stack size in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-35947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371831#comment-17371831 ] Apache Spark commented on SPARK-35947: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-35947) Increase JVM stack size in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-35947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35947: Assignee: Apache Spark > Increase JVM stack size in release-build.sh > --

[jira] [Created] (SPARK-35947) Increase JVM stack size in release-build.sh

Dongjoon Hyun created SPARK-35947: - Summary: Increase JVM stack size in release-build.sh Key: SPARK-35947 URL: https://issues.apache.org/jira/browse/SPARK-35947 Project: Spark Issue Type: Imp

[jira] [Resolved] (SPARK-35937) Extracting date field from timestamp should work in ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-35937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35937. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33138 [https:

[jira] [Comment Edited] (SPARK-35915) Kafka doesn't recover from data loss

[ https://issues.apache.org/jira/browse/SPARK-35915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371817#comment-17371817 ] Jungtaek Lim edited comment on SPARK-35915 at 6/30/21, 5:27 AM: --

[jira] [Commented] (SPARK-35915) Kafka doesn't recover from data loss

[ https://issues.apache.org/jira/browse/SPARK-35915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371817#comment-17371817 ] Jungtaek Lim commented on SPARK-35915: -- OK the code comment was referring the old b

[jira] [Assigned] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35946: - Assignee: Hyukjin Kwon > Respect Py4J server if InheritableThread API > ---

[jira] [Resolved] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35946. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33147 [https://

[jira] [Resolved] (SPARK-35829) Clean up evaluates subexpressions and add more flexibility to evaluate particular subexpressoin

[ https://issues.apache.org/jira/browse/SPARK-35829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35829. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32980 [https://gith

[jira] [Assigned] (SPARK-35896) [SS] Include more granular metrics for stateful operators in StreamingQueryProgress

[ https://issues.apache.org/jira/browse/SPARK-35896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-35896: Assignee: Venki Korukanti > [SS] Include more granular metrics for stateful operators in

[jira] [Resolved] (SPARK-35896) [SS] Include more granular metrics for stateful operators in StreamingQueryProgress

[ https://issues.apache.org/jira/browse/SPARK-35896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-35896. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33091 [https://gi

[jira] [Commented] (SPARK-33298) Introduce new API to FileCommitProtocol allow flexible file naming

[ https://issues.apache.org/jira/browse/SPARK-33298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371795#comment-17371795 ] Apache Spark commented on SPARK-33298: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-33298) Introduce new API to FileCommitProtocol allow flexible file naming

[ https://issues.apache.org/jira/browse/SPARK-33298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371794#comment-17371794 ] Apache Spark commented on SPARK-33298: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371791#comment-17371791 ] Apache Spark commented on SPARK-35946: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35946: Assignee: Apache Spark > Respect Py4J server if InheritableThread API > -

[jira] [Commented] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371790#comment-17371790 ] Apache Spark commented on SPARK-35946: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-35946) Respect Py4J server if InheritableThread API

[ https://issues.apache.org/jira/browse/SPARK-35946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35946: Assignee: (was: Apache Spark) > Respect Py4J server if InheritableThread API > --

[jira] [Created] (SPARK-35946) Respect Py4J server if InheritableThread API

Hyukjin Kwon created SPARK-35946: Summary: Respect Py4J server if InheritableThread API Key: SPARK-35946 URL: https://issues.apache.org/jira/browse/SPARK-35946 Project: Spark Issue Type: Impr

[jira] [Commented] (SPARK-35912) [SQL] JSON read behavior is different depending on the cache setting when nullable is false.

[ https://issues.apache.org/jira/browse/SPARK-35912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371787#comment-17371787 ] Apache Spark commented on SPARK-35912: -- User 'cfmcgrady' has created a pull request

[jira] [Assigned] (SPARK-35912) [SQL] JSON read behavior is different depending on the cache setting when nullable is false.

[ https://issues.apache.org/jira/browse/SPARK-35912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35912: Assignee: (was: Apache Spark) > [SQL] JSON read behavior is different depending on th

[jira] [Assigned] (SPARK-35912) [SQL] JSON read behavior is different depending on the cache setting when nullable is false.

[ https://issues.apache.org/jira/browse/SPARK-35912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35912: Assignee: Apache Spark > [SQL] JSON read behavior is different depending on the cache set

[jira] [Commented] (SPARK-35912) [SQL] JSON read behavior is different depending on the cache setting when nullable is false.

[ https://issues.apache.org/jira/browse/SPARK-35912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371786#comment-17371786 ] Apache Spark commented on SPARK-35912: -- User 'cfmcgrady' has created a pull request

[jira] [Commented] (SPARK-24540) Support for multiple character delimiter in Spark CSV read

[ https://issues.apache.org/jira/browse/SPARK-24540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371780#comment-17371780 ] Chandra commented on SPARK-24540: - My requirement is to process the file which have a mu

[jira] [Updated] (SPARK-35945) Unable to parse multi character row and column delimited files using Spark

[ https://issues.apache.org/jira/browse/SPARK-35945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandra updated SPARK-35945: Description: My requirement is to process the file which have a multi character row and column delimiter.

[jira] [Created] (SPARK-35945) Unable to parse multi character row and column delimited files using Spark

Chandra created SPARK-35945: --- Summary: Unable to parse multi character row and column delimited files using Spark Key: SPARK-35945 URL: https://issues.apache.org/jira/browse/SPARK-35945 Project: Spark

[jira] [Resolved] (SPARK-35943) Introduce Axis type alias.

[ https://issues.apache.org/jira/browse/SPARK-35943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35943. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33144 [https://gi

[jira] [Assigned] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34549: Assignee: (was: Apache Spark) > Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844 >

[jira] [Assigned] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34549: Assignee: Apache Spark > Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844 > --

[jira] [Assigned] (SPARK-35943) Introduce Axis type alias.

[ https://issues.apache.org/jira/browse/SPARK-35943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35943: Assignee: Takuya Ueshin > Introduce Axis type alias. > -- > >

[jira] [Reopened] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-34549: -- Assignee: (was: L. C. Hsieh) Reverted at https://github.com/apache/spark/commit/7ad682a

[jira] [Updated] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34549: - Fix Version/s: (was: 3.2.0) > Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844 >

[jira] [Updated] (SPARK-35925) Support DayTimeIntervalType in width-bucket function

[ https://issues.apache.org/jira/browse/SPARK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengLei updated SPARK-35925: Fix Version/s: (was: 3.2.0) > Support DayTimeIntervalType in width-bucket function > -

[jira] [Updated] (SPARK-35914) Driver can't distribute task to executor because NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Helt Long updated SPARK-35914: -- Environment: hadoop 2.6.0-cdh5.7.1 Spark 3.0.1, 3.1.1, 3.1.2 was: CDH 5.7.1: Hadoop 2.6.5 Spark 3

[jira] [Commented] (SPARK-35914) Driver can't distribute task to executor because NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-35914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371758#comment-17371758 ] Helt Long commented on SPARK-35914: --- Do what you wanna do, [~code_kr_dev_s], but this

[jira] [Commented] (SPARK-35926) Support YearMonthIntervalType in width-bucket function

[ https://issues.apache.org/jira/browse/SPARK-35926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371756#comment-17371756 ] PengLei commented on SPARK-35926: - [~code_kr_dev_s] Sorry, I will do it after 3.2 releas

[jira] [Commented] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371755#comment-17371755 ] Apache Spark commented on SPARK-34549: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34549) Upgrade aws kinesis to 1.14.0 and java sdk 1.11.844

[ https://issues.apache.org/jira/browse/SPARK-34549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371754#comment-17371754 ] Apache Spark commented on SPARK-34549: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35873) Cleanup the version logic from the pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35873: Assignee: Haejoon Lee > Cleanup the version logic from the pandas API on Spark >

[jira] [Resolved] (SPARK-35873) Cleanup the version logic from the pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35873. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33128 [https://gi

[jira] [Resolved] (SPARK-35784) Implementation for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35784. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32928 [https://gith

[jira] [Assigned] (SPARK-35784) Implementation for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35784: --- Assignee: Yuanjian Li > Implementation for RocksDB instance > -

[jira] [Assigned] (SPARK-35721) Path level discover for python unittests

[ https://issues.apache.org/jira/browse/SPARK-35721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35721: Assignee: (was: Apache Spark) > Path level discover for python unittests > --

[jira] [Assigned] (SPARK-35721) Path level discover for python unittests

[ https://issues.apache.org/jira/browse/SPARK-35721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35721: Assignee: Apache Spark > Path level discover for python unittests > -

[jira] [Commented] (SPARK-35943) Introduce Axis type alias.

[ https://issues.apache.org/jira/browse/SPARK-35943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371738#comment-17371738 ] Apache Spark commented on SPARK-35943: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-35943) Introduce Axis type alias.

[ https://issues.apache.org/jira/browse/SPARK-35943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35943: Assignee: Apache Spark > Introduce Axis type alias. > -- > >

[jira] [Assigned] (SPARK-35943) Introduce Axis type alias.

[ https://issues.apache.org/jira/browse/SPARK-35943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35943: Assignee: (was: Apache Spark) > Introduce Axis type alias. >

[jira] [Commented] (SPARK-35943) Introduce Axis type alias.

[ https://issues.apache.org/jira/browse/SPARK-35943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371737#comment-17371737 ] Apache Spark commented on SPARK-35943: -- User 'ueshin' has created a pull request fo

[jira] [Updated] (SPARK-35933) PartitionFilters and pushFilters not applied to window functions

[ https://issues.apache.org/jira/browse/SPARK-35933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreyas Kothavade updated SPARK-35933: -- Affects Version/s: 2.4.8 > PartitionFilters and pushFilters not applied to window func

[jira] [Updated] (SPARK-35933) PartitionFilters and pushFilters not applied to window functions

[ https://issues.apache.org/jira/browse/SPARK-35933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreyas Kothavade updated SPARK-35933: -- Description: Spark does not apply partition and pushed filters when the partition by c

[jira] [Updated] (SPARK-35337) pandas API on Spark: Separate basic operations into data type based structures

[ https://issues.apache.org/jira/browse/SPARK-35337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-35337: -- Summary: pandas API on Spark: Separate basic operations into data type based structures (was:

[jira] [Updated] (SPARK-35464) pandas API on Spark: Enable mypy check "disallow_untyped_defs" for main codes.

[ https://issues.apache.org/jira/browse/SPARK-35464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-35464: -- Summary: pandas API on Spark: Enable mypy check "disallow_untyped_defs" for main codes. (was:

[jira] [Created] (SPARK-35944) Introduce type aliases for names or labels.

Takuya Ueshin created SPARK-35944: - Summary: Introduce type aliases for names or labels. Key: SPARK-35944 URL: https://issues.apache.org/jira/browse/SPARK-35944 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-35942) Refine Scalar type alias and reuse it

Takuya Ueshin created SPARK-35942: - Summary: Refine Scalar type alias and reuse it Key: SPARK-35942 URL: https://issues.apache.org/jira/browse/SPARK-35942 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-35943) Introduce Axis type alias.

Takuya Ueshin created SPARK-35943: - Summary: Introduce Axis type alias. Key: SPARK-35943 URL: https://issues.apache.org/jira/browse/SPARK-35943 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-35941) pandas API on Spark: Improve type hints.

Takuya Ueshin created SPARK-35941: - Summary: pandas API on Spark: Improve type hints. Key: SPARK-35941 URL: https://issues.apache.org/jira/browse/SPARK-35941 Project: Spark Issue Type: Umbrel

[jira] [Resolved] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-32922. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 321

[jira] [Assigned] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-32922: --- Assignee: Chandni Singh > Add support for ShuffleBlockFetcherIterator to re

[jira] [Resolved] (SPARK-35921) ${spark.yarn.isHadoopProvided} in config.properties is not edited if build with SBT

[ https://issues.apache.org/jira/browse/SPARK-35921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-35921. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33121 [https://github.com/a

[jira] [Commented] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371611#comment-17371611 ] Apache Spark commented on SPARK-33995: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371610#comment-17371610 ] Apache Spark commented on SPARK-33995: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-35939) Deprecate Python 3.6 in Spark documentation

[ https://issues.apache.org/jira/browse/SPARK-35939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371583#comment-17371583 ] Apache Spark commented on SPARK-35939: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371592#comment-17371592 ] Thomas Graves commented on SPARK-33031: --- I do not think its resolved but haven't t

[jira] [Commented] (SPARK-35940) Refactor EquivalentExpressions to make it more efficient

[ https://issues.apache.org/jira/browse/SPARK-35940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371590#comment-17371590 ] Apache Spark commented on SPARK-35940: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-35940) Refactor EquivalentExpressions to make it more efficient

[ https://issues.apache.org/jira/browse/SPARK-35940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35940: Assignee: (was: Apache Spark) > Refactor EquivalentExpressions to make it more effici

[jira] [Commented] (SPARK-35940) Refactor EquivalentExpressions to make it more efficient

[ https://issues.apache.org/jira/browse/SPARK-35940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371589#comment-17371589 ] Apache Spark commented on SPARK-35940: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-35940) Refactor EquivalentExpressions to make it more efficient

[ https://issues.apache.org/jira/browse/SPARK-35940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35940: Assignee: Apache Spark > Refactor EquivalentExpressions to make it more efficient > -

[jira] [Updated] (SPARK-35721) Path level discover for python unittests

[ https://issues.apache.org/jira/browse/SPARK-35721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-35721: -- Fix Version/s: (was: 3.2.0) > Path level discover for python unittests > -

[jira] [Reopened] (SPARK-35721) Path level discover for python unittests

[ https://issues.apache.org/jira/browse/SPARK-35721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reopened SPARK-35721: --- Assignee: (was: Yikun Jiang) The commit was reverted https://github.com/apache/spark/

[jira] [Created] (SPARK-35940) Refactor EquivalentExpressions to make it more efficient

Wenchen Fan created SPARK-35940: --- Summary: Refactor EquivalentExpressions to make it more efficient Key: SPARK-35940 URL: https://issues.apache.org/jira/browse/SPARK-35940 Project: Spark Issue

[jira] [Assigned] (SPARK-35939) Deprecate Python 3.6 in Spark documentation

[ https://issues.apache.org/jira/browse/SPARK-35939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35939: Assignee: (was: Apache Spark) > Deprecate Python 3.6 in Spark documentation > ---

[jira] [Assigned] (SPARK-35939) Deprecate Python 3.6 in Spark documentation

[ https://issues.apache.org/jira/browse/SPARK-35939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35939: Assignee: Apache Spark > Deprecate Python 3.6 in Spark documentation > --

[jira] [Assigned] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35881: Assignee: Apache Spark > [SQL] AQE does not support columnar execution for the final quer

[jira] [Assigned] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35881: Assignee: (was: Apache Spark) > [SQL] AQE does not support columnar execution for the

[jira] [Commented] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371582#comment-17371582 ] Apache Spark commented on SPARK-35881: -- User 'andygrove' has created a pull request

[jira] [Commented] (SPARK-35925) Support DayTimeIntervalType in width-bucket function

[ https://issues.apache.org/jira/browse/SPARK-35925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371576#comment-17371576 ] Max Gekk commented on SPARK-35925: -- [~xiaopenglei] I don't mind of this but before the

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371569#comment-17371569 ] Dongjoon Hyun commented on SPARK-33349: --- Hi, [~code_kr_dev_s]. There is no PR in t

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-35881: --- Affects Version/s: 3.0.3 3.1.2 > [SQL] AQE does not support columnar executio

[jira] [Resolved] (SPARK-35924) Add Java 17 ea build test to GitHub action

[ https://issues.apache.org/jira/browse/SPARK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35924. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33126 [https://

[jira] [Assigned] (SPARK-35924) Add Java 17 ea build test to GitHub action

[ https://issues.apache.org/jira/browse/SPARK-35924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35924: - Assignee: William Hyun > Add Java 17 ea build test to GitHub action > -

[jira] [Commented] (SPARK-35938) Add deprecation warning for Python 3.6

[ https://issues.apache.org/jira/browse/SPARK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371562#comment-17371562 ] Apache Spark commented on SPARK-35938: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-35938) Add deprecation warning for Python 3.6

[ https://issues.apache.org/jira/browse/SPARK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35938: Assignee: (was: Apache Spark) > Add deprecation warning for Python 3.6 >

[jira] [Assigned] (SPARK-35938) Add deprecation warning for Python 3.6

[ https://issues.apache.org/jira/browse/SPARK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35938: Assignee: Apache Spark > Add deprecation warning for Python 3.6 > ---

[jira] [Commented] (SPARK-35938) Add deprecation warning for Python 3.6

[ https://issues.apache.org/jira/browse/SPARK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371561#comment-17371561 ] Apache Spark commented on SPARK-35938: -- User 'xinrong-databricks' has created a pul

[jira] [Created] (SPARK-35939) Deprecate Python 3.6 in Spark documentation

Xinrong Meng created SPARK-35939: Summary: Deprecate Python 3.6 in Spark documentation Key: SPARK-35939 URL: https://issues.apache.org/jira/browse/SPARK-35939 Project: Spark Issue Type: Sub-t

[jira] [Created] (SPARK-35938) Add deprecation warning for Python 3.6

Xinrong Meng created SPARK-35938: Summary: Add deprecation warning for Python 3.6 Key: SPARK-35938 URL: https://issues.apache.org/jira/browse/SPARK-35938 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-35936) Deprecate Python 3.6 support

[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371559#comment-17371559 ] Apache Spark commented on SPARK-35936: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-35936) Deprecate Python 3.6 support

[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371558#comment-17371558 ] Apache Spark commented on SPARK-35936: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-35936) Deprecate Python 3.6 support

[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35936: Assignee: Apache Spark > Deprecate Python 3.6 support > > >

[jira] [Assigned] (SPARK-35936) Deprecate Python 3.6 support

[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35936: Assignee: (was: Apache Spark) > Deprecate Python 3.6 support > --

[jira] [Assigned] (SPARK-35906) Remove order by if the maximum number of rows less than or equal to 1

[ https://issues.apache.org/jira/browse/SPARK-35906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35906: - Assignee: Yuming Wang > Remove order by if the maximum number of rows less than or equa

[jira] [Resolved] (SPARK-35906) Remove order by if the maximum number of rows less than or equal to 1

[ https://issues.apache.org/jira/browse/SPARK-35906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35906. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33100 [https://

[jira] [Comment Edited] (SPARK-35803) Spark SQL does not support creating views using DataSource v2 based data sources

[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371548#comment-17371548 ] David Rabinowitz edited comment on SPARK-35803 at 6/29/21, 5:58 PM: --

[jira] [Commented] (SPARK-35803) Spark SQL does not support creating views using DataSource v2 based data sources

[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371548#comment-17371548 ] David Rabinowitz commented on SPARK-35803: -- Using regular spark-shell: {code:ja

[jira] [Resolved] (SPARK-35464) pandas APIs on Spark: Enable mypy check "disallow_untyped_defs" for main codes.

[ https://issues.apache.org/jira/browse/SPARK-35464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35464. --- Fix Version/s: 3.2.0 Resolution: Fixed > pandas APIs on Spark: Enable mypy check "dis

[jira] [Resolved] (SPARK-35859) Cleanup type hints.

[ https://issues.apache.org/jira/browse/SPARK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35859. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371543#comment-17371543 ] Jolan Rensen commented on SPARK-32530: -- I've been helping with the Jetbrains' [Kotl

[jira] [Updated] (SPARK-35936) Deprecate Python 3.6 support

[ https://issues.apache.org/jira/browse/SPARK-35936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-35936: -- Description: According to [https://endoflife.date/python], Python 3.6 will be EOL on 23 Dec,

  1   2   >