[jira] [Commented] (SPARK-38102) Supporting custom commitProtocolClass when using saveAsNewAPIHadoopDataset

[ https://issues.apache.org/jira/browse/SPARK-38102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487937#comment-17487937 ] Apache Spark commented on SPARK-38102: -- User 'ocworld' has created a pull request f

[jira] [Created] (SPARK-38127) Fix bug of EnumTypeSetBenchmark and update benchmark result

Yang Jie created SPARK-38127: Summary: Fix bug of EnumTypeSetBenchmark and update benchmark result Key: SPARK-38127 URL: https://issues.apache.org/jira/browse/SPARK-38127 Project: Spark Issue Ty

[jira] [Commented] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487956#comment-17487956 ] Apache Spark commented on SPARK-38124: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38124: Assignee: (was: Apache Spark) > Revive HashClusteredDistribution and apply to all sta

[jira] [Assigned] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38124: Assignee: Apache Spark > Revive HashClusteredDistribution and apply to all stateful opera

[jira] [Assigned] (SPARK-38127) Fix bug of EnumTypeSetBenchmark and update benchmark result

[ https://issues.apache.org/jira/browse/SPARK-38127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38127: Assignee: Apache Spark > Fix bug of EnumTypeSetBenchmark and update benchmark result > --

[jira] [Commented] (SPARK-38127) Fix bug of EnumTypeSetBenchmark and update benchmark result

[ https://issues.apache.org/jira/browse/SPARK-38127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487958#comment-17487958 ] Apache Spark commented on SPARK-38127: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38127) Fix bug of EnumTypeSetBenchmark and update benchmark result

[ https://issues.apache.org/jira/browse/SPARK-38127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38127: Assignee: (was: Apache Spark) > Fix bug of EnumTypeSetBenchmark and update benchmark

[jira] [Assigned] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37413: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/tree.py > ---

[jira] [Commented] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487979#comment-17487979 ] Apache Spark commented on SPARK-37413: -- User 'dchvn' has created a pull request for

[jira] [Assigned] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37413: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/tree.py > --

[jira] [Commented] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487983#comment-17487983 ] Apache Spark commented on SPARK-37413: -- User 'dchvn' has created a pull request for

[jira] [Resolved] (SPARK-38046) Fix KafkaSource/KafkaMicroBatch flaky test due to non-deterministic timing

[ https://issues.apache.org/jira/browse/SPARK-38046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38046. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38046) Fix KafkaSource/KafkaMicroBatch flaky test due to non-deterministic timing

[ https://issues.apache.org/jira/browse/SPARK-38046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38046: Assignee: Boyang Jerry Peng > Fix KafkaSource/KafkaMicroBatch flaky test due to non-deter

[jira] [Commented] (SPARK-36061) Add Volcano feature step

[ https://issues.apache.org/jira/browse/SPARK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487996#comment-17487996 ] Apache Spark commented on SPARK-36061: -- User 'Yikun' has created a pull request for

[jira] [Created] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

Hyukjin Kwon created SPARK-38128: Summary: Show full stacktrace in tests by default in PySpark tests Key: SPARK-38128 URL: https://issues.apache.org/jira/browse/SPARK-38128 Project: Spark Iss

[jira] [Assigned] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38128: Assignee: (was: Apache Spark) > Show full stacktrace in tests by default in PySpark t

[jira] [Assigned] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38128: Assignee: Apache Spark > Show full stacktrace in tests by default in PySpark tests >

[jira] [Commented] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488017#comment-17488017 ] Apache Spark commented on SPARK-38128: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488018#comment-17488018 ] Apache Spark commented on SPARK-38128: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38116: Assignee: Apache Spark > Ability to turn off auto commit in JDBC source for read only ope

[jira] [Assigned] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38116: Assignee: (was: Apache Spark) > Ability to turn off auto commit in JDBC source for re

[jira] [Created] (SPARK-38129) Adaptive enable timeout for BroadcastQueryStageExec

weixiuli created SPARK-38129: Summary: Adaptive enable timeout for BroadcastQueryStageExec Key: SPARK-38129 URL: https://issues.apache.org/jira/browse/SPARK-38129 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488036#comment-17488036 ] Apache Spark commented on SPARK-38116: -- User 'yoda-mon' has created a pull request

[jira] [Updated] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38129: - Summary: Adaptively enable timeout for BroadcastQueryStageExec (was: Adaptive enable timeout for Broadc

[jira] [Commented] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488042#comment-17488042 ] Maciej Szymkiewicz commented on SPARK-37411: I'll handle this one. > Inline

[jira] [Commented] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488047#comment-17488047 ] Leona Yoda commented on SPARK-38116: I post sample PR, however, the intended behavio

[jira] [Comment Edited] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488047#comment-17488047 ] Leona Yoda edited comment on SPARK-38116 at 2/7/22, 11:25 AM:

[jira] [Assigned] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38129: Assignee: Apache Spark > Adaptively enable timeout for BroadcastQueryStageExec >

[jira] [Assigned] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38129: Assignee: (was: Apache Spark) > Adaptively enable timeout for BroadcastQueryStageExec

[jira] [Commented] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488049#comment-17488049 ] Apache Spark commented on SPARK-38129: -- User 'weixiuli' has created a pull request

[jira] [Assigned] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38128: Assignee: Hyukjin Kwon > Show full stacktrace in tests by default in PySpark tests >

[jira] [Resolved] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38128. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35423 [https://gi

[jira] [Created] (SPARK-38130) array_sort does not allow non-orderable datatypes

Steven Aerts created SPARK-38130: Summary: array_sort does not allow non-orderable datatypes Key: SPARK-38130 URL: https://issues.apache.org/jira/browse/SPARK-38130 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38130) array_sort does not allow non-orderable datatypes

[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-38130: - Description:  {{array_sort}} has check to see if the entries it has to sort are orderable. I th

[jira] [Commented] (SPARK-38130) array_sort does not allow non-orderable datatypes

[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488100#comment-17488100 ] Apache Spark commented on SPARK-38130: -- User 'steven-aerts' has created a pull requ

[jira] [Assigned] (SPARK-38130) array_sort does not allow non-orderable datatypes

[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38130: Assignee: (was: Apache Spark) > array_sort does not allow non-orderable datatypes > -

[jira] [Assigned] (SPARK-38130) array_sort does not allow non-orderable datatypes

[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38130: Assignee: Apache Spark > array_sort does not allow non-orderable datatypes >

[jira] [Updated] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38129: - Fix Version/s: 3.2.1 3.2.0 > Adaptively enable timeout for BroadcastQueryStageExec >

[jira] [Updated] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38129: - Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > Adaptively enable timeout for BroadcastQu

[jira] [Commented] (SPARK-37401) Inline type hints for python/pyspark/ml/clustering.py

[ https://issues.apache.org/jira/browse/SPARK-37401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488243#comment-17488243 ] Maciej Szymkiewicz commented on SPARK-37401: I'll handle this one. > Inline

[jira] [Commented] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488245#comment-17488245 ] Maciej Szymkiewicz commented on SPARK-37410: I'll handle this one. > Inline

[jira] [Created] (SPARK-38131) Keep only user-facing error classes

Max Gekk created SPARK-38131: Summary: Keep only user-facing error classes Key: SPARK-38131 URL: https://issues.apache.org/jira/browse/SPARK-38131 Project: Spark Issue Type: Sub-task Co

[jira] [Assigned] (SPARK-35781) Support Spark on Apple Silicon on macOS natively on Java 17

[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35781: - Assignee: Dongjoon Hyun > Support Spark on Apple Silicon on macOS natively on Java 17 >

[jira] [Assigned] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37411: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/regression.py

[jira] [Commented] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488277#comment-17488277 ] Apache Spark commented on SPARK-37411: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37411: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/regression.py >

[jira] [Commented] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488288#comment-17488288 ] agen hoki togel online commented on SPARK-37219: h2. Bagaimana Dengan Si

[jira] [Commented] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488287#comment-17488287 ] agen hoki togel online commented on SPARK-37219: Situs Resmi Judi Togel

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488393#comment-17488393 ] Apache Spark commented on SPARK-36665: -- User 'kazuyukitanimura' has created a pull

[jira] [Created] (SPARK-38132) Remove NotPropagation

Kazuyuki Tanimura created SPARK-38132: - Summary: Remove NotPropagation Key: SPARK-38132 URL: https://issues.apache.org/jira/browse/SPARK-38132 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-38132) Remove NotPropagation

[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488415#comment-17488415 ] Apache Spark commented on SPARK-38132: -- User 'kazuyukitanimura' has created a pull

[jira] [Assigned] (SPARK-38132) Remove NotPropagation

[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38132: Assignee: Apache Spark > Remove NotPropagation > - > >

[jira] [Assigned] (SPARK-38132) Remove NotPropagation

[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38132: Assignee: (was: Apache Spark) > Remove NotPropagation > - > >

[jira] [Commented] (SPARK-38132) Remove NotPropagation

[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488414#comment-17488414 ] Apache Spark commented on SPARK-38132: -- User 'kazuyukitanimura' has created a pull

[jira] [Created] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

Bruce Robbins created SPARK-38133: - Summary: Grouping by timestamp_ntz will sometimes corrupt the results Key: SPARK-38133 URL: https://issues.apache.org/jira/browse/SPARK-38133 Project: Spark

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488441#comment-17488441 ] Bruce Robbins commented on SPARK-38133: --- I think I have a handle on what is causin

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488445#comment-17488445 ] kk commented on SPARK-38115: Thanks [~hyukjin.kwon] for responding. Basically I am trying t

[jira] [Commented] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488487#comment-17488487 ] Apache Spark commented on SPARK-37410: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37410: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/recommendatio

[jira] [Assigned] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37410: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/recommendation.py >

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Priority: Blocker (was: Major) > Revive HashClusteredDistribution and apply to all stateful ope

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Labels: correctness (was: ) > Revive HashClusteredDistribution and apply to all stateful operat

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Issue Type: Bug (was: Improvement) > Revive HashClusteredDistribution and apply to all stateful

[jira] [Assigned] (SPARK-38132) Remove NotPropagation

[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38132: - Assignee: Kazuyuki Tanimura > Remove NotPropagation > - > >

[jira] [Resolved] (SPARK-38132) Remove NotPropagation

[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38132. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35428 [https://

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488504#comment-17488504 ] Apache Spark commented on SPARK-38133: -- User 'bersprockets' has created a pull requ

[jira] [Assigned] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38133: Assignee: (was: Apache Spark) > Grouping by timestamp_ntz will sometimes corrupt the

[jira] [Assigned] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38133: Assignee: Apache Spark > Grouping by timestamp_ntz will sometimes corrupt the results > -

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488506#comment-17488506 ] Kazuyuki Tanimura commented on SPARK-36665: --- [~aokolnychyi] issue resolved. >

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488510#comment-17488510 ] Dongjoon Hyun commented on SPARK-38133: --- Does this happen on master branch only, [

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488514#comment-17488514 ] Bruce Robbins commented on SPARK-38133: --- [~dongjoon]  >Does this happen on master

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488520#comment-17488520 ] Anton Okolnychyi commented on SPARK-36665: -- Thank you [~kazuyukitanimura] [~vii

[jira] [Resolved] (SPARK-37409) Inline type hints for python/pyspark/ml/pipeline.py

[ https://issues.apache.org/jira/browse/SPARK-37409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37409. Fix Version/s: 3.3.0 Assignee: Maciej Szymkiewicz Resolution: Fixed

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488529#comment-17488529 ] Haejoon Lee commented on SPARK-36969: - [~dchvn] Just noticed the previous PR is clos

[jira] [Assigned] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37412: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/ml/stat.p

[jira] [Resolved] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37412. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35401

[jira] [Updated] (SPARK-37993) Avoid multiple calls to configuration parameter values

[ https://issues.apache.org/jira/browse/SPARK-37993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37993: - Priority: Trivial (was: Major) This is not "Major" > Avoid multiple calls to configuration par

[jira] [Comment Edited] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488047#comment-17488047 ] Leona Yoda edited comment on SPARK-38116 at 2/8/22, 2:29 AM: -

[jira] [Comment Edited] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488047#comment-17488047 ] Leona Yoda edited comment on SPARK-38116 at 2/8/22, 2:30 AM: -

[jira] [Updated] (SPARK-38033) The structured streaming processing cannot be started because the commitId and offsetId are inconsistent

[ https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LLiu updated SPARK-38033: - Affects Version/s: 3.0.3 > The structured streaming processing cannot be started because the commitId >

[jira] [Assigned] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38133: - Assignee: Bruce Robbins > Grouping by timestamp_ntz will sometimes corrupt the results

[jira] [Resolved] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38133. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35430 [https://

[jira] [Commented] (SPARK-38097) Improve the error for pivoting of unsupported value types

[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488576#comment-17488576 ] Yuto Akutsu commented on SPARK-38097: - [~maxgekk] I'll work on this. > Improve the

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488577#comment-17488577 ] dch nguyen commented on SPARK-36969: [~itholic] this was resolved by https://issues

[jira] [Commented] (SPARK-36444) Remove OptimizeSubqueries from batch of PartitionPruning

[ https://issues.apache.org/jira/browse/SPARK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488582#comment-17488582 ] Apache Spark commented on SPARK-36444: -- User 'pan3793' has created a pull request f

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488594#comment-17488594 ] Haejoon Lee commented on SPARK-36969: - Great!! Thanks, [~dchvn] :) > Inline type hi

[jira] [Created] (SPARK-38134) Upgrade Arrow to 7.0.0

Yang Jie created SPARK-38134: Summary: Upgrade Arrow to 7.0.0 Key: SPARK-38134 URL: https://issues.apache.org/jira/browse/SPARK-38134 Project: Spark Issue Type: Improvement Components:

[jira] [Updated] (SPARK-38134) Upgrade Arrow to 7.0.0

[ https://issues.apache.org/jira/browse/SPARK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38134: - Description: https://arrow.apache.org/release/7.0.0.html > Upgrade Arrow to 7.0.0 >

[jira] [Assigned] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37585: Assignee: Apache Spark > DSV2 InputMetrics are not getting update in corner case > --

[jira] [Assigned] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37585: Assignee: (was: Apache Spark) > DSV2 InputMetrics are not getting update in corner ca

[jira] [Commented] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488596#comment-17488596 ] Apache Spark commented on SPARK-37585: -- User 'bozhang2820' has created a pull reque

[jira] [Commented] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488597#comment-17488597 ] Apache Spark commented on SPARK-37585: -- User 'bozhang2820' has created a pull reque

[jira] [Commented] (SPARK-38134) Upgrade Arrow to 7.0.0

[ https://issues.apache.org/jira/browse/SPARK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488601#comment-17488601 ] Yang Jie commented on SPARK-38134: -- Waiting can be download from the maven central repo

[jira] [Assigned] (SPARK-38030) Query with cast containing non-nullable columns fails with AQE on Spark 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-38030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38030: --- Assignee: Shardul Mahadik > Query with cast containing non-nullable columns fails with AQE

[jira] [Resolved] (SPARK-38030) Query with cast containing non-nullable columns fails with AQE on Spark 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-38030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38030. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35332 [https://gith

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488610#comment-17488610 ] Wenchen Fan commented on SPARK-35531: - [~angerszhuuu] can you help to backport it?

[jira] [Commented] (SPARK-30661) KMeans blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488611#comment-17488611 ] zhengruifeng commented on SPARK-30661: -- since the input datasets of kmeans are like

[jira] [Assigned] (SPARK-38097) Improve the error for pivoting of unsupported value types

[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38097: Assignee: Apache Spark > Improve the error for pivoting of unsupported value types >

[jira] [Assigned] (SPARK-38097) Improve the error for pivoting of unsupported value types

[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38097: Assignee: (was: Apache Spark) > Improve the error for pivoting of unsupported value t

  1   2   >