[jira] [Assigned] (SPARK-39591) Offset Management Improvements in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39591: Assignee: Apache Spark > Offset Management Improvements in Structured Streaming > ---

[jira] [Commented] (SPARK-39591) Offset Management Improvements in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629252#comment-17629252 ] Apache Spark commented on SPARK-39591: -- User 'jerrypeng' has created a pull request

[jira] [Assigned] (SPARK-39591) Offset Management Improvements in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39591: Assignee: (was: Apache Spark) > Offset Management Improvements in Structured Streamin

[jira] [Commented] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream

[ https://issues.apache.org/jira/browse/SPARK-41013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629240#comment-17629240 ] Yuming Wang commented on SPARK-41013: - Could you test the Spark 3.3.1? > spark-3.1.

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629239#comment-17629239 ] Apache Spark commented on SPARK-32380: -- User 'attilapiros' has created a pull reque

[jira] [Commented] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629230#comment-17629230 ] Apache Spark commented on SPARK-41015: -- User 'SandishKumarHN' has created a pull re

[jira] [Assigned] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41015: Assignee: (was: Apache Spark) > Failure of ProtobufCatalystDataConversionSuite.scala

[jira] [Assigned] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41015: Assignee: Apache Spark > Failure of ProtobufCatalystDataConversionSuite.scala > -

[jira] [Commented] (SPARK-41018) Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives

[ https://issues.apache.org/jira/browse/SPARK-41018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629220#comment-17629220 ] Nikesh commented on SPARK-41018: Attached the notebooks I used. When the data size is sm

[jira] [Created] (SPARK-41018) Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives

Nikesh created SPARK-41018: -- Summary: Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives Key: SPARK-41018 URL: https://issues.apache.org/jira/browse/SPARK-41018 Proj

[jira] [Updated] (SPARK-41018) Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives

[ https://issues.apache.org/jira/browse/SPARK-41018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikesh updated SPARK-41018: --- Attachment: ZScoreWithKoalas_PandasOnSpark_SmallerDataset.html ZScoreWithKoalas_PandasOnSpark

[jira] [Commented] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629204#comment-17629204 ] Raghu Angadi commented on SPARK-41015: -- Thanks for filing this [~maxgekk] . cc: [~

[jira] [Assigned] (SPARK-40950) isRemoteAddressMaxedOut performance overhead on scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-40950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40950: --- Assignee: Emil Ejbyfeldt > isRemoteAddressMaxedOut performance overhead on

[jira] [Resolved] (SPARK-40950) isRemoteAddressMaxedOut performance overhead on scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-40950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40950. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 384

[jira] [Commented] (SPARK-40903) Avoid reordering decimal Add for canonicalization

[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629165#comment-17629165 ] Apache Spark commented on SPARK-40903: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-40903) Avoid reordering decimal Add for canonicalization

[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629164#comment-17629164 ] Apache Spark commented on SPARK-40903: -- User 'gengliangwang' has created a pull req

[jira] [Resolved] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40769. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38498 [https://github.com

[jira] [Commented] (SPARK-39740) vis-timeline @ 4.2.1 vulnerable to XSS attacks

[ https://issues.apache.org/jira/browse/SPARK-39740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629113#comment-17629113 ] Eugene Shinn (Truveta) commented on SPARK-39740: Any updates here? > vi

[jira] [Commented] (SPARK-38564) Support collecting metrics from streaming sinks

[ https://issues.apache.org/jira/browse/SPARK-38564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629061#comment-17629061 ] Apache Spark commented on SPARK-38564: -- User 'FouadApp' has created a pull request

[jira] [Assigned] (SPARK-41017) Do not push Filter through reference-only Project

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41017: Assignee: Wenchen Fan (was: Apache Spark) > Do not push Filter through reference-only Pr

[jira] [Assigned] (SPARK-41017) Do not push Filter through reference-only Project

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41017: Assignee: Apache Spark (was: Wenchen Fan) > Do not push Filter through reference-only Pr

[jira] [Commented] (SPARK-41017) Do not push Filter through reference-only Project

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17629030#comment-17629030 ] Apache Spark commented on SPARK-41017: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-40533) Extend type support for Spark Connect literals

[ https://issues.apache.org/jira/browse/SPARK-40533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40533. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38462 [https://gi

[jira] [Assigned] (SPARK-40533) Extend type support for Spark Connect literals

[ https://issues.apache.org/jira/browse/SPARK-40533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40533: Assignee: Martin Grund > Extend type support for Spark Connect literals > ---

[jira] [Created] (SPARK-41017) Do not push Filter through reference-only Project

Wenchen Fan created SPARK-41017: --- Summary: Do not push Filter through reference-only Project Key: SPARK-41017 URL: https://issues.apache.org/jira/browse/SPARK-41017 Project: Spark Issue Type: I

[jira] [Created] (SPARK-41016) Identical expressions should not be used on both sides of a binary operator

Bjørn Jørgensen created SPARK-41016: --- Summary: Identical expressions should not be used on both sides of a binary operator Key: SPARK-41016 URL: https://issues.apache.org/jira/browse/SPARK-41016 Pro

[jira] [Updated] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41015: - Description: To reproduce the issue, set the seed to 38: {code} diff --git a/connector/protobuf/src/te

[jira] [Created] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

Max Gekk created SPARK-41015: Summary: Failure of ProtobufCatalystDataConversionSuite.scala Key: SPARK-41015 URL: https://issues.apache.org/jira/browse/SPARK-41015 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-40954) Kubernetes integration tests stuck forever on Mac M1 with Minikube + Docker

[ https://issues.apache.org/jira/browse/SPARK-40954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628904#comment-17628904 ] Anton Ippolitov commented on SPARK-40954: - Thank you for the suggestion [~dcoliv

[jira] [Resolved] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41012. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38508 [https://github.com

[jira] [Assigned] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41012: Assignee: Haejoon Lee > Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE > ---

[jira] [Assigned] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41014: Assignee: Apache Spark > Improve documentation and typing of applyInPandas for groupby an

[jira] [Commented] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17628853#comment-17628853 ] Apache Spark commented on SPARK-41014: -- User 'EnricoMi' has created a pull request

[jira] [Assigned] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41014: Assignee: (was: Apache Spark) > Improve documentation and typing of applyInPandas for

[jira] [Updated] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-41014: -- Description: Documentation of method `applyInPandas` for grouby and cogroup does not mention

[jira] [Created] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

Enrico Minack created SPARK-41014: - Summary: Improve documentation and typing of applyInPandas for groupby and cogroup Key: SPARK-41014 URL: https://issues.apache.org/jira/browse/SPARK-41014 Project:

[jira] [Created] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream

yutiantian created SPARK-41013: -- Summary: spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream Key: SPARK-41013 URL: https://issues.apache.org/jira/browse/SPARK-41013

[jira] [Assigned] (SPARK-40749) Migrate type check failures of generators onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40749: Assignee: BingKun Pan > Migrate type check failures of generators onto error classes > --

[jira] [Resolved] (SPARK-40749) Migrate type check failures of generators onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40749. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38482 [https://github.com