[jira] [Commented] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447223#comment-17447223 ] Apache Spark commented on SPARK-37421: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37421: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Assigned] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37421: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/evaluation.py >

[jira] [Commented] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447221#comment-17447221 ] Apache Spark commented on SPARK-37421: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37437) Remove unused profile

[ https://issues.apache.org/jira/browse/SPARK-37437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37437: Assignee: Apache Spark > Remove unused profile > - > >

[jira] [Assigned] (SPARK-37437) Remove unused profile

[ https://issues.apache.org/jira/browse/SPARK-37437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37437: Assignee: (was: Apache Spark) > Remove unused profile > - > >

[jira] [Commented] (SPARK-37437) Remove unused profile

[ https://issues.apache.org/jira/browse/SPARK-37437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447218#comment-17447218 ] Apache Spark commented on SPARK-37437: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-37437) Remove unused profile

[ https://issues.apache.org/jira/browse/SPARK-37437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447219#comment-17447219 ] Apache Spark commented on SPARK-37437: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-37437) Remove unused profile

angerszhu created SPARK-37437: - Summary: Remove unused profile Key: SPARK-37437 URL: https://issues.apache.org/jira/browse/SPARK-37437 Project: Spark Issue Type: Task Components: SQL

[jira] [Assigned] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py

[ https://issues.apache.org/jira/browse/SPARK-37407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37407: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/functions.py >

[jira] [Assigned] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py

[ https://issues.apache.org/jira/browse/SPARK-37407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37407: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/functions.py

[jira] [Commented] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py

[ https://issues.apache.org/jira/browse/SPARK-37407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447210#comment-17447210 ] Apache Spark commented on SPARK-37407: -- User 'dchvn' has created a pull request for this issue:

[jira] [Commented] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447208#comment-17447208 ] Apache Spark commented on SPARK-37436: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447207#comment-17447207 ] Apache Spark commented on SPARK-37436: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37436: Assignee: Apache Spark > Uses Python's standard string formatter for SQL API in pandas

[jira] [Assigned] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37436: Assignee: (was: Apache Spark) > Uses Python's standard string formatter for SQL API

[jira] [Updated] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-37436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37436: - Issue Type: Improvement (was: Test) > Uses Python's standard string formatter for SQL API in

[jira] [Created] (SPARK-37436) Uses Python's standard string formatter for SQL API in pandas API on Spark

Hyukjin Kwon created SPARK-37436: Summary: Uses Python's standard string formatter for SQL API in pandas API on Spark Key: SPARK-37436 URL: https://issues.apache.org/jira/browse/SPARK-37436 Project:

[jira] [Assigned] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36231: Assignee: Yikun Jiang (was: Apache Spark) > Support arithmetic operations of Series

[jira] [Assigned] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36231: Assignee: Apache Spark (was: Yikun Jiang) > Support arithmetic operations of Series

[jira] [Created] (SPARK-37435) Did not find value which can be converted into java.lang.String

Ziqun Ye created SPARK-37435: Summary: Did not find value which can be converted into java.lang.String Key: SPARK-37435 URL: https://issues.apache.org/jira/browse/SPARK-37435 Project: Spark

[jira] [Assigned] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon

[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37434: Assignee: (was: Apache Spark) > Add a new profile to auto disable unsupported UTs on

[jira] [Assigned] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon

[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37434: Assignee: Apache Spark > Add a new profile to auto disable unsupported UTs on Macos

[jira] [Commented] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon

[ https://issues.apache.org/jira/browse/SPARK-37434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447185#comment-17447185 ] Apache Spark commented on SPARK-37434: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-37434) Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon

Yang Jie created SPARK-37434: Summary: Add a new profile to auto disable unsupported UTs on Macos using Apple Silicon Key: SPARK-37434 URL: https://issues.apache.org/jira/browse/SPARK-37434 Project:

[jira] [Resolved] (SPARK-37354) Make the Java version installed on the container image used by the K8s integration tests with SBT configurable

[ https://issues.apache.org/jira/browse/SPARK-37354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37354. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved in

[jira] [Updated] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36231: - Fix Version/s: (was: 3.3.0) > Support arithmetic operations of Series containing

[jira] [Reopened] (SPARK-36231) Support arithmetic operations of Series containing Decimal(np.nan)

[ https://issues.apache.org/jira/browse/SPARK-36231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-36231: -- Reverted at https://github.com/apache/spark/commit/406455d79f787486f9e6fab1dce0d9a2645b8d14 >

[jira] [Resolved] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed

[ https://issues.apache.org/jira/browse/SPARK-37209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37209. -- Fix Version/s: 3.3.0 3.0.4 3.2.1

[jira] [Assigned] (SPARK-37209) YarnShuffleIntegrationSuite and other two similar cases in `resource-managers` test failed

[ https://issues.apache.org/jira/browse/SPARK-37209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37209: Assignee: Yang Jie > YarnShuffleIntegrationSuite and other two similar cases in >

[jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-34497

[ https://issues.apache.org/jira/browse/SPARK-37391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447162#comment-17447162 ] Hyukjin Kwon commented on SPARK-37391: -- [~danny-seismic], it would be great to assess this issue

[jira] [Assigned] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval()

[ https://issues.apache.org/jira/browse/SPARK-37433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37433: Assignee: (was: Apache Spark) > TimeZoneAwareExpression throws

[jira] [Commented] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval()

[ https://issues.apache.org/jira/browse/SPARK-37433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447159#comment-17447159 ] Apache Spark commented on SPARK-37433: -- User 'sathiyapk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval()

[ https://issues.apache.org/jira/browse/SPARK-37433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37433: Assignee: Apache Spark > TimeZoneAwareExpression throws NoSuchElementException: None.get

[jira] [Created] (SPARK-37433) TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval()

Sathiya Kumar created SPARK-37433: - Summary: TimeZoneAwareExpression throws NoSuchElementException: None.get on expr.eval() Key: SPARK-37433 URL: https://issues.apache.org/jira/browse/SPARK-37433

[jira] [Updated] (SPARK-37432) Driver keep a record of decommission executor

[ https://issues.apache.org/jira/browse/SPARK-37432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hoa Le updated SPARK-37432: --- Attachment: master_ui_executor_tab.png > Driver keep a record of decommission executor >

[jira] [Created] (SPARK-37432) Driver keep a record of decommission executor

Hoa Le created SPARK-37432: -- Summary: Driver keep a record of decommission executor Key: SPARK-37432 URL: https://issues.apache.org/jira/browse/SPARK-37432 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-37104) RDD and DStream should be covariant

[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37104: -- Assignee: Maciej Szymkiewicz > RDD and DStream should be covariant >

[jira] [Resolved] (SPARK-37104) RDD and DStream should be covariant

[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37104. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-37431) pyspark.{ml, mllib}.linalg.Vector API

Maciej Szymkiewicz created SPARK-37431: -- Summary: pyspark.{ml, mllib}.linalg.Vector API Key: SPARK-37431 URL: https://issues.apache.org/jira/browse/SPARK-37431 Project: Spark Issue

[jira] [Created] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

Maciej Szymkiewicz created SPARK-37430: -- Summary: Inline type hints for python/pyspark/mllib/linalg/distributed.py Key: SPARK-37430 URL: https://issues.apache.org/jira/browse/SPARK-37430

[jira] [Created] (SPARK-37429) Inline type hints for python/pyspark/mllib/linalg/__init__.py

Maciej Szymkiewicz created SPARK-37429: -- Summary: Inline type hints for python/pyspark/mllib/linalg/__init__.py Key: SPARK-37429 URL: https://issues.apache.org/jira/browse/SPARK-37429 Project:

[jira] [Updated] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py

[ https://issues.apache.org/jira/browse/SPARK-37423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37423: --- Summary: Inline type hints for python/pyspark/mllib/fpm.py (was: Inline type hints

[jira] [Updated] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37427: --- Summary: Inline type hints for python/pyspark/mllib/tree.py (was: Inline type

[jira] [Updated] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37428: --- Summary: Inline type hints for python/pyspark/mllib/util.py (was: Inline type

[jira] [Updated] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.py

[ https://issues.apache.org/jira/browse/SPARK-37424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37424: --- Summary: Inline type hints for python/pyspark/mllib/random.py (was: Inline type

[jira] [Updated] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37426: --- Summary: Inline type hints for python/pyspark/mllib/regression.py (was: Inline

[jira] [Updated] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37425: --- Summary: Inline type hints for python/pyspark/mllib/recommendation.py (was: Inline

[jira] [Updated] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37422: --- Summary: Inline type hints for python/pyspark/mllib/feature.py (was: Inline type

[jira] [Updated] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37421: --- Summary: Inline type hints for python/pyspark/mllib/evaluation.py (was: Inline

[jira] [Updated] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37236: --- Parent: (was: SPARK-37233) Issue Type: Improvement (was: Sub-task) >

[jira] [Updated] (SPARK-37236) Inline type hints for KernelDensity.pyi, test.py in python/pyspark/mllib/stat/

[ https://issues.apache.org/jira/browse/SPARK-37236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37236: --- Parent: SPARK-37396 Issue Type: Sub-task (was: Improvement) > Inline type

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37235: --- Parent: SPARK-37396 Issue Type: Sub-task (was: Improvement) > Inline type

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37235: --- Parent: (was: SPARK-37396) Issue Type: Improvement (was: Sub-task) >

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37235: --- Parent: SPARK-37396 Issue Type: Sub-task (was: Improvement) > Inline type

[jira] [Updated] (SPARK-37235) Inline type hints for distribution.py and __init__.py in python/pyspark/mllib/stat

[ https://issues.apache.org/jira/browse/SPARK-37235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37235: --- Parent: (was: SPARK-37233) Issue Type: Improvement (was: Sub-task) >

[jira] [Updated] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37234: --- Parent: SPARK-37396 Issue Type: Sub-task (was: Improvement) > Inline type

[jira] [Updated] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-37234: --- Parent: (was: SPARK-37233) Issue Type: Improvement (was: Sub-task) >

[jira] [Created] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.pypy

Maciej Szymkiewicz created SPARK-37428: -- Summary: Inline type hints for python/pyspark/mllib/util.pypy Key: SPARK-37428 URL: https://issues.apache.org/jira/browse/SPARK-37428 Project: Spark

[jira] [Created] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.pypy

Maciej Szymkiewicz created SPARK-37427: -- Summary: Inline type hints for python/pyspark/mllib/tree.pypy Key: SPARK-37427 URL: https://issues.apache.org/jira/browse/SPARK-37427 Project: Spark

[jira] [Created] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.pypy

Maciej Szymkiewicz created SPARK-37425: -- Summary: Inline type hints for python/pyspark/mllib/recommendation.pypy Key: SPARK-37425 URL: https://issues.apache.org/jira/browse/SPARK-37425 Project:

[jira] [Created] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.pypy

Maciej Szymkiewicz created SPARK-37426: -- Summary: Inline type hints for python/pyspark/mllib/regression.pypy Key: SPARK-37426 URL: https://issues.apache.org/jira/browse/SPARK-37426 Project: Spark

[jira] [Created] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.pypy

Maciej Szymkiewicz created SPARK-37423: -- Summary: Inline type hints for python/pyspark/mllib/fpm.pypy Key: SPARK-37423 URL: https://issues.apache.org/jira/browse/SPARK-37423 Project: Spark

[jira] [Created] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.pypy

Maciej Szymkiewicz created SPARK-37424: -- Summary: Inline type hints for python/pyspark/mllib/random.pypy Key: SPARK-37424 URL: https://issues.apache.org/jira/browse/SPARK-37424 Project: Spark

[jira] [Created] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.pypy

Maciej Szymkiewicz created SPARK-37422: -- Summary: Inline type hints for python/pyspark/mllib/feature.pypy Key: SPARK-37422 URL: https://issues.apache.org/jira/browse/SPARK-37422 Project: Spark

[jira] [Created] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.pypy

Maciej Szymkiewicz created SPARK-37421: -- Summary: Inline type hints for python/pyspark/mllib/evaluation.pypy Key: SPARK-37421 URL: https://issues.apache.org/jira/browse/SPARK-37421 Project: Spark

[jira] [Commented] (SPARK-37395) Inline type hint files for files in python/pyspark/ml

[ https://issues.apache.org/jira/browse/SPARK-37395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446996#comment-17446996 ] Maciej Szymkiewicz commented on SPARK-37395: cc [~hyukjin.kwon] [~ueshin] [~XinrongM] FYI.