[jira] [Assigned] (SPARK-39591) Offset Management Improvements in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39591: Assignee: Apache Spark > Offset Management Improvements in Structured Streaming >

[jira] [Commented] (SPARK-39591) Offset Management Improvements in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629252#comment-17629252 ] Apache Spark commented on SPARK-39591: -- User 'jerrypeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39591) Offset Management Improvements in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-39591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39591: Assignee: (was: Apache Spark) > Offset Management Improvements in Structured

[jira] [Commented] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream

[ https://issues.apache.org/jira/browse/SPARK-41013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629240#comment-17629240 ] Yuming Wang commented on SPARK-41013: - Could you test the Spark 3.3.1? > spark-3.1.2以cluster模式提交作业报

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629239#comment-17629239 ] Apache Spark commented on SPARK-32380: -- User 'attilapiros' has created a pull request for this

[jira] [Commented] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629230#comment-17629230 ] Apache Spark commented on SPARK-41015: -- User 'SandishKumarHN' has created a pull request for this

[jira] [Assigned] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41015: Assignee: (was: Apache Spark) > Failure of ProtobufCatalystDataConversionSuite.scala

[jira] [Assigned] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41015: Assignee: Apache Spark > Failure of ProtobufCatalystDataConversionSuite.scala >

[jira] [Commented] (SPARK-41018) Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives

[ https://issues.apache.org/jira/browse/SPARK-41018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629220#comment-17629220 ] Nikesh commented on SPARK-41018: Attached the notebooks I used. When the data size is small( Notebook

[jira] [Created] (SPARK-41018) Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives

Nikesh created SPARK-41018: -- Summary: Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives Key: SPARK-41018 URL: https://issues.apache.org/jira/browse/SPARK-41018

[jira] [Updated] (SPARK-41018) Koalas.idxmin() is not picking the minimum value from a dataframe, but pandas.idxmin() gives

[ https://issues.apache.org/jira/browse/SPARK-41018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikesh updated SPARK-41018: --- Attachment: ZScoreWithKoalas_PandasOnSpark_SmallerDataset.html

[jira] [Commented] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629204#comment-17629204 ] Raghu Angadi commented on SPARK-41015: -- Thanks for filing this [~maxgekk] . cc:

[jira] [Assigned] (SPARK-40950) isRemoteAddressMaxedOut performance overhead on scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-40950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40950: --- Assignee: Emil Ejbyfeldt > isRemoteAddressMaxedOut performance overhead on

[jira] [Resolved] (SPARK-40950) isRemoteAddressMaxedOut performance overhead on scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-40950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40950. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Commented] (SPARK-40903) Avoid reordering decimal Add for canonicalization

[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629165#comment-17629165 ] Apache Spark commented on SPARK-40903: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-40903) Avoid reordering decimal Add for canonicalization

[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629164#comment-17629164 ] Apache Spark commented on SPARK-40903: -- User 'gengliangwang' has created a pull request for this

[jira] [Resolved] (SPARK-40769) Migrate type check failures of aggregate expressions onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40769. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38498

[jira] [Commented] (SPARK-39740) vis-timeline @ 4.2.1 vulnerable to XSS attacks

[ https://issues.apache.org/jira/browse/SPARK-39740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629113#comment-17629113 ] Eugene Shinn (Truveta) commented on SPARK-39740: Any updates here? > vis-timeline @

[jira] [Commented] (SPARK-38564) Support collecting metrics from streaming sinks

[ https://issues.apache.org/jira/browse/SPARK-38564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629061#comment-17629061 ] Apache Spark commented on SPARK-38564: -- User 'FouadApp' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41017) Do not push Filter through reference-only Project

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41017: Assignee: Wenchen Fan (was: Apache Spark) > Do not push Filter through reference-only

[jira] [Assigned] (SPARK-41017) Do not push Filter through reference-only Project

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41017: Assignee: Apache Spark (was: Wenchen Fan) > Do not push Filter through reference-only

[jira] [Commented] (SPARK-41017) Do not push Filter through reference-only Project

[ https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629030#comment-17629030 ] Apache Spark commented on SPARK-41017: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-40533) Extend type support for Spark Connect literals

[ https://issues.apache.org/jira/browse/SPARK-40533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40533. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38462

[jira] [Assigned] (SPARK-40533) Extend type support for Spark Connect literals

[ https://issues.apache.org/jira/browse/SPARK-40533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40533: Assignee: Martin Grund > Extend type support for Spark Connect literals >

[jira] [Created] (SPARK-41017) Do not push Filter through reference-only Project

Wenchen Fan created SPARK-41017: --- Summary: Do not push Filter through reference-only Project Key: SPARK-41017 URL: https://issues.apache.org/jira/browse/SPARK-41017 Project: Spark Issue Type:

[jira] [Created] (SPARK-41016) Identical expressions should not be used on both sides of a binary operator

Bjørn Jørgensen created SPARK-41016: --- Summary: Identical expressions should not be used on both sides of a binary operator Key: SPARK-41016 URL: https://issues.apache.org/jira/browse/SPARK-41016

[jira] [Updated] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

[ https://issues.apache.org/jira/browse/SPARK-41015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-41015: - Description: To reproduce the issue, set the seed to 38: {code} diff --git

[jira] [Created] (SPARK-41015) Failure of ProtobufCatalystDataConversionSuite.scala

Max Gekk created SPARK-41015: Summary: Failure of ProtobufCatalystDataConversionSuite.scala Key: SPARK-41015 URL: https://issues.apache.org/jira/browse/SPARK-41015 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-40954) Kubernetes integration tests stuck forever on Mac M1 with Minikube + Docker

[ https://issues.apache.org/jira/browse/SPARK-40954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628904#comment-17628904 ] Anton Ippolitov commented on SPARK-40954: - Thank you for the suggestion [~dcoliversun]! The

[jira] [Resolved] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41012. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38508

[jira] [Assigned] (SPARK-41012) Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE

[ https://issues.apache.org/jira/browse/SPARK-41012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41012: Assignee: Haejoon Lee > Rename _LEGACY_ERROR_TEMP_1022 to ORDER_BY_POS_OUT_OF_RANGE >

[jira] [Assigned] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41014: Assignee: Apache Spark > Improve documentation and typing of applyInPandas for groupby

[jira] [Commented] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628853#comment-17628853 ] Apache Spark commented on SPARK-41014: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41014: Assignee: (was: Apache Spark) > Improve documentation and typing of applyInPandas

[jira] [Updated] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

[ https://issues.apache.org/jira/browse/SPARK-41014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-41014: -- Description: Documentation of method `applyInPandas` for grouby and cogroup does not mention

[jira] [Created] (SPARK-41014) Improve documentation and typing of applyInPandas for groupby and cogroup

Enrico Minack created SPARK-41014: - Summary: Improve documentation and typing of applyInPandas for groupby and cogroup Key: SPARK-41014 URL: https://issues.apache.org/jira/browse/SPARK-41014 Project:

[jira] [Created] (SPARK-41013) spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream

yutiantian created SPARK-41013: -- Summary: spark-3.1.2以cluster模式提交作业报 Could not initialize class com.github.luben.zstd.ZstdOutputStream Key: SPARK-41013 URL: https://issues.apache.org/jira/browse/SPARK-41013

[jira] [Assigned] (SPARK-40749) Migrate type check failures of generators onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40749: Assignee: BingKun Pan > Migrate type check failures of generators onto error classes >

[jira] [Resolved] (SPARK-40749) Migrate type check failures of generators onto error classes

[ https://issues.apache.org/jira/browse/SPARK-40749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40749. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38482

[jira] [Resolved] (SPARK-41004) Check error classes in InterceptorRegistrySuite

[ https://issues.apache.org/jira/browse/SPARK-41004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41004. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38494

[jira] [Assigned] (SPARK-41004) Check error classes in InterceptorRegistrySuite

[ https://issues.apache.org/jira/browse/SPARK-41004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41004: Assignee: BingKun Pan > Check error classes in InterceptorRegistrySuite >

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17628700#comment-17628700 ] Yilun Fan commented on SPARK-33349: --- I also met this problem in Spark 3.2.1, kubernetes-client 5.4.1.