[jira] [Commented] (SPARK-38033) The structured streaming processing cannot be started because the commitId and offsetId are inconsistent

2022-02-07 Thread LeeeeLiu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488650#comment-17488650 ] LLiu commented on SPARK-38033: -- Hi [~kabhwan] , this is a good idea(y), thanks for your suggestion,

[jira] [Commented] (SPARK-37500) Incorrect scope when using named_windows in CTEs

2022-02-07 Thread Lauri Koobas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488649#comment-17488649 ] Lauri Koobas commented on SPARK-37500: -- This particular case is fixed indeed, but I believe it was

[jira] [Assigned] (SPARK-38136) Update GitHub Action test image

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38136: Assignee: Apache Spark > Update GitHub Action test image >

[jira] [Assigned] (SPARK-38136) Update GitHub Action test image

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38136: Assignee: (was: Apache Spark) > Update GitHub Action test image >

[jira] [Commented] (SPARK-38136) Update GitHub Action test image

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488638#comment-17488638 ] Apache Spark commented on SPARK-38136: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-38136) Update GitHub Action test image

2022-02-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-38136: - Summary: Update GitHub Action test image Key: SPARK-38136 URL: https://issues.apache.org/jira/browse/SPARK-38136 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Description: SPARK-35703 removed HashClusteredDistribution and replaced its usages with

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Labels: (was: correctness) > Revive HashClusteredDistribution and apply to stream-stream join

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to stream-stream join

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Summary: Revive HashClusteredDistribution and apply to stream-stream join (was: Revive

[jira] [Created] (SPARK-38135) Introduce `spark.kubernetes.job` sheduling related configurations

2022-02-07 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-38135: --- Summary: Introduce `spark.kubernetes.job` sheduling related configurations Key: SPARK-38135 URL: https://issues.apache.org/jira/browse/SPARK-38135 Project: Spark

[jira] [Updated] (SPARK-38135) Introduce `spark.kubernetes.job` sheduling related configurations

2022-02-07 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-38135: Description: spark.kubernetes.job.minCPU:  the minimum cpu resources for running job

[jira] [Assigned] (SPARK-38097) Improve the error for pivoting of unsupported value types

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38097: Assignee: Apache Spark > Improve the error for pivoting of unsupported value types >

[jira] [Assigned] (SPARK-38097) Improve the error for pivoting of unsupported value types

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38097: Assignee: (was: Apache Spark) > Improve the error for pivoting of unsupported value

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-02-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488612#comment-17488612 ] angerszhu commented on SPARK-35531: --- Sure. > Can not insert into hive bucket table if create table

[jira] [Commented] (SPARK-38097) Improve the error for pivoting of unsupported value types

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488614#comment-17488614 ] Apache Spark commented on SPARK-38097: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Commented] (SPARK-30661) KMeans blockify input vectors

2022-02-07 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488611#comment-17488611 ] zhengruifeng commented on SPARK-30661: -- since the input datasets of kmeans are likely dense, so I

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488610#comment-17488610 ] Wenchen Fan commented on SPARK-35531: - [~angerszhuuu] can you help to backport it? > Can not insert

[jira] [Resolved] (SPARK-38030) Query with cast containing non-nullable columns fails with AQE on Spark 3.1.1

2022-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38030. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35332

[jira] [Assigned] (SPARK-38030) Query with cast containing non-nullable columns fails with AQE on Spark 3.1.1

2022-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38030: --- Assignee: Shardul Mahadik > Query with cast containing non-nullable columns fails with AQE

[jira] [Commented] (SPARK-38134) Upgrade Arrow to 7.0.0

2022-02-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488601#comment-17488601 ] Yang Jie commented on SPARK-38134: -- Waiting can be download from the maven central repository   >

[jira] [Commented] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488597#comment-17488597 ] Apache Spark commented on SPARK-37585: -- User 'bozhang2820' has created a pull request for this

[jira] [Commented] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488596#comment-17488596 ] Apache Spark commented on SPARK-37585: -- User 'bozhang2820' has created a pull request for this

[jira] [Updated] (SPARK-38134) Upgrade Arrow to 7.0.0

2022-02-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38134: - Description: https://arrow.apache.org/release/7.0.0.html > Upgrade Arrow to 7.0.0 >

[jira] [Assigned] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37585: Assignee: Apache Spark > DSV2 InputMetrics are not getting update in corner case >

[jira] [Assigned] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37585: Assignee: (was: Apache Spark) > DSV2 InputMetrics are not getting update in corner

[jira] [Created] (SPARK-38134) Upgrade Arrow to 7.0.0

2022-02-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-38134: Summary: Upgrade Arrow to 7.0.0 Key: SPARK-38134 URL: https://issues.apache.org/jira/browse/SPARK-38134 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

2022-02-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488594#comment-17488594 ] Haejoon Lee commented on SPARK-36969: - Great!! Thanks, [~dchvn] :) > Inline type hints for

[jira] [Commented] (SPARK-36444) Remove OptimizeSubqueries from batch of PartitionPruning

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488582#comment-17488582 ] Apache Spark commented on SPARK-36444: -- User 'pan3793' has created a pull request for this issue:

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

2022-02-07 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488577#comment-17488577 ] dch nguyen commented on SPARK-36969: [~itholic] this was resolved by

[jira] [Commented] (SPARK-38097) Improve the error for pivoting of unsupported value types

2022-02-07 Thread Yuto Akutsu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488576#comment-17488576 ] Yuto Akutsu commented on SPARK-38097: - [~maxgekk] I'll work on this. > Improve the error for

[jira] [Assigned] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38133: - Assignee: Bruce Robbins > Grouping by timestamp_ntz will sometimes corrupt the results

[jira] [Resolved] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38133. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35430

[jira] [Updated] (SPARK-38033) The structured streaming processing cannot be started because the commitId and offsetId are inconsistent

2022-02-07 Thread LeeeeLiu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LLiu updated SPARK-38033: - Affects Version/s: 3.0.3 > The structured streaming processing cannot be started because the commitId

[jira] [Comment Edited] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488047#comment-17488047 ] Leona Yoda edited comment on SPARK-38116 at 2/8/22, 2:30 AM: - I post sample

[jira] [Comment Edited] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488047#comment-17488047 ] Leona Yoda edited comment on SPARK-38116 at 2/8/22, 2:29 AM: - I post sample

[jira] [Updated] (SPARK-37993) Avoid multiple calls to configuration parameter values

2022-02-07 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37993: - Priority: Trivial (was: Major) This is not "Major" > Avoid multiple calls to configuration

[jira] [Resolved] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

2022-02-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37412. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37412) Inline type hints for python/pyspark/ml/stat.py

2022-02-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37412: -- Assignee: Maciej Szymkiewicz > Inline type hints for

[jira] [Commented] (SPARK-36969) Inline type hints for SparkContext

2022-02-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488529#comment-17488529 ] Haejoon Lee commented on SPARK-36969: - [~dchvn] Just noticed the previous PR is closed without

[jira] [Resolved] (SPARK-37409) Inline type hints for python/pyspark/ml/pipeline.py

2022-02-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37409. Fix Version/s: 3.3.0 Assignee: Maciej Szymkiewicz Resolution:

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-07 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488520#comment-17488520 ] Anton Okolnychyi commented on SPARK-36665: -- Thank you [~kazuyukitanimura] [~viirya]! > Add

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488514#comment-17488514 ] Bruce Robbins commented on SPARK-38133: --- [~dongjoon]  >Does this happen on master branch only As

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488510#comment-17488510 ] Dongjoon Hyun commented on SPARK-38133: --- Does this happen on master branch only, [~bersprockets]?

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-07 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488506#comment-17488506 ] Kazuyuki Tanimura commented on SPARK-36665: --- [~aokolnychyi] issue resolved. > Add more Not

[jira] [Assigned] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38133: Assignee: Apache Spark > Grouping by timestamp_ntz will sometimes corrupt the results >

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488504#comment-17488504 ] Apache Spark commented on SPARK-38133: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38133: Assignee: (was: Apache Spark) > Grouping by timestamp_ntz will sometimes corrupt the

[jira] [Resolved] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38132. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35428

[jira] [Assigned] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38132: - Assignee: Kazuyuki Tanimura > Remove NotPropagation > - > >

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Issue Type: Bug (was: Improvement) > Revive HashClusteredDistribution and apply to all

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Labels: correctness (was: ) > Revive HashClusteredDistribution and apply to all stateful

[jira] [Updated] (SPARK-38124) Revive HashClusteredDistribution and apply to all stateful operators

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38124: - Priority: Blocker (was: Major) > Revive HashClusteredDistribution and apply to all stateful

[jira] [Assigned] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37410: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/recommendation.py >

[jira] [Commented] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488487#comment-17488487 ] Apache Spark commented on SPARK-37410: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37410: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Commented] (SPARK-38115) No spark conf to control the path of _temporary when writing to target filesystem

2022-02-07 Thread kk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488445#comment-17488445 ] kk commented on SPARK-38115: Thanks [~hyukjin.kwon] for responding. Basically I am trying to write data to

[jira] [Commented] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488441#comment-17488441 ] Bruce Robbins commented on SPARK-38133: --- I think I have a handle on what is causing this, and will

[jira] [Created] (SPARK-38133) Grouping by timestamp_ntz will sometimes corrupt the results

2022-02-07 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-38133: - Summary: Grouping by timestamp_ntz will sometimes corrupt the results Key: SPARK-38133 URL: https://issues.apache.org/jira/browse/SPARK-38133 Project: Spark

[jira] [Assigned] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38132: Assignee: (was: Apache Spark) > Remove NotPropagation > - > >

[jira] [Commented] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488414#comment-17488414 ] Apache Spark commented on SPARK-38132: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Commented] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488415#comment-17488415 ] Apache Spark commented on SPARK-38132: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Assigned] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38132: Assignee: Apache Spark > Remove NotPropagation > - > >

[jira] [Created] (SPARK-38132) Remove NotPropagation

2022-02-07 Thread Kazuyuki Tanimura (Jira)
Kazuyuki Tanimura created SPARK-38132: - Summary: Remove NotPropagation Key: SPARK-38132 URL: https://issues.apache.org/jira/browse/SPARK-38132 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488393#comment-17488393 ] Apache Spark commented on SPARK-36665: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Commented] (SPARK-37219) support AS OF syntax

2022-02-07 Thread agen hoki togel online (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488287#comment-17488287 ] agen hoki togel online commented on SPARK-37219: Situs Resmi Judi Togel Online

[jira] [Commented] (SPARK-37219) support AS OF syntax

2022-02-07 Thread agen hoki togel online (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488288#comment-17488288 ] agen hoki togel online commented on SPARK-37219: h2. Bagaimana Dengan Sistem Keposlot?

[jira] [Assigned] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37411: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/regression.py >

[jira] [Assigned] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37411: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Commented] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488277#comment-17488277 ] Apache Spark commented on SPARK-37411: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35781) Support Spark on Apple Silicon on macOS natively on Java 17

2022-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35781: - Assignee: Dongjoon Hyun > Support Spark on Apple Silicon on macOS natively on Java 17

[jira] [Created] (SPARK-38131) Keep only user-facing error classes

2022-02-07 Thread Max Gekk (Jira)
Max Gekk created SPARK-38131: Summary: Keep only user-facing error classes Key: SPARK-38131 URL: https://issues.apache.org/jira/browse/SPARK-38131 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

2022-02-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488245#comment-17488245 ] Maciej Szymkiewicz commented on SPARK-37410: I'll handle this one. > Inline type hints for

[jira] [Commented] (SPARK-37401) Inline type hints for python/pyspark/ml/clustering.py

2022-02-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488243#comment-17488243 ] Maciej Szymkiewicz commented on SPARK-37401: I'll handle this one. > Inline type hints for

[jira] [Updated] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

2022-02-07 Thread weixiuli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38129: - Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > Adaptively enable timeout for

[jira] [Updated] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

2022-02-07 Thread weixiuli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38129: - Fix Version/s: 3.2.1 3.2.0 > Adaptively enable timeout for BroadcastQueryStageExec >

[jira] [Assigned] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38130: Assignee: Apache Spark > array_sort does not allow non-orderable datatypes >

[jira] [Assigned] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38130: Assignee: (was: Apache Spark) > array_sort does not allow non-orderable datatypes >

[jira] [Commented] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488100#comment-17488100 ] Apache Spark commented on SPARK-38130: -- User 'steven-aerts' has created a pull request for this

[jira] [Updated] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Aerts updated SPARK-38130: - Description:  {{array_sort}} has check to see if the entries it has to sort are orderable. I

[jira] [Created] (SPARK-38130) array_sort does not allow non-orderable datatypes

2022-02-07 Thread Steven Aerts (Jira)
Steven Aerts created SPARK-38130: Summary: array_sort does not allow non-orderable datatypes Key: SPARK-38130 URL: https://issues.apache.org/jira/browse/SPARK-38130 Project: Spark Issue

[jira] [Assigned] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38128: Assignee: Hyukjin Kwon > Show full stacktrace in tests by default in PySpark tests >

[jira] [Resolved] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38128. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35423

[jira] [Commented] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488049#comment-17488049 ] Apache Spark commented on SPARK-38129: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38129: Assignee: Apache Spark > Adaptively enable timeout for BroadcastQueryStageExec >

[jira] [Assigned] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38129: Assignee: (was: Apache Spark) > Adaptively enable timeout for

[jira] [Comment Edited] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488047#comment-17488047 ] Leona Yoda edited comment on SPARK-38116 at 2/7/22, 11:25 AM: -- I post

[jira] [Commented] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488047#comment-17488047 ] Leona Yoda commented on SPARK-38116: I post sample PR, however, the intended behavior might be

[jira] [Commented] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

2022-02-07 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488042#comment-17488042 ] Maciej Szymkiewicz commented on SPARK-37411: I'll handle this one. > Inline type hints for

[jira] [Updated] (SPARK-38129) Adaptively enable timeout for BroadcastQueryStageExec

2022-02-07 Thread weixiuli (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-38129: - Summary: Adaptively enable timeout for BroadcastQueryStageExec (was: Adaptive enable timeout for

[jira] [Commented] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488036#comment-17488036 ] Apache Spark commented on SPARK-38116: -- User 'yoda-mon' has created a pull request for this issue:

[jira] [Created] (SPARK-38129) Adaptive enable timeout for BroadcastQueryStageExec

2022-02-07 Thread weixiuli (Jira)
weixiuli created SPARK-38129: Summary: Adaptive enable timeout for BroadcastQueryStageExec Key: SPARK-38129 URL: https://issues.apache.org/jira/browse/SPARK-38129 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38116: Assignee: (was: Apache Spark) > Ability to turn off auto commit in JDBC source for

[jira] [Assigned] (SPARK-38116) Ability to turn off auto commit in JDBC source for read only operations

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38116: Assignee: Apache Spark > Ability to turn off auto commit in JDBC source for read only

[jira] [Commented] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488018#comment-17488018 ] Apache Spark commented on SPARK-38128: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488017#comment-17488017 ] Apache Spark commented on SPARK-38128: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38128: Assignee: Apache Spark > Show full stacktrace in tests by default in PySpark tests >

[jira] [Assigned] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38128: Assignee: (was: Apache Spark) > Show full stacktrace in tests by default in PySpark

[jira] [Created] (SPARK-38128) Show full stacktrace in tests by default in PySpark tests

2022-02-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-38128: Summary: Show full stacktrace in tests by default in PySpark tests Key: SPARK-38128 URL: https://issues.apache.org/jira/browse/SPARK-38128 Project: Spark

[jira] [Commented] (SPARK-36061) Add Volcano feature step

2022-02-07 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487996#comment-17487996 ] Apache Spark commented on SPARK-36061: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38046) Fix KafkaSource/KafkaMicroBatch flaky test due to non-deterministic timing

2022-02-07 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-38046: Assignee: Boyang Jerry Peng > Fix KafkaSource/KafkaMicroBatch flaky test due to

  1   2   >