[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484525#comment-17484525 ] Sujit Biswas commented on SPARK-38061: -- do not know what is the best resolution,  

[jira] [Assigned] (SPARK-38076) Remove redundant null-check is covered by further condition

[ https://issues.apache.org/jira/browse/SPARK-38076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38076: Assignee: Apache Spark > Remove redundant null-check is covered by further condition >

[jira] [Assigned] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38042: Assignee: (was: Apache Spark) > Encoder cannot be found when a tuple component is a

[jira] [Assigned] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38042: Assignee: Apache Spark > Encoder cannot be found when a tuple component is a type alias

[jira] [Assigned] (SPARK-38076) Remove redundant null-check is covered by further condition

[ https://issues.apache.org/jira/browse/SPARK-38076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38076: Assignee: (was: Apache Spark) > Remove redundant null-check is covered by further

[jira] [Commented] (SPARK-38076) Remove redundant null-check is covered by further condition

[ https://issues.apache.org/jira/browse/SPARK-38076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484507#comment-17484507 ] Apache Spark commented on SPARK-38076: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-38042) Encoder cannot be found when a tuple component is a type alias for an Array

[ https://issues.apache.org/jira/browse/SPARK-38042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484506#comment-17484506 ] Apache Spark commented on SPARK-38042: -- User 'jtnystrom' has created a pull request for this issue:

[jira] [Updated] (SPARK-38076) Remove redundant null-check is covered by further condition

[ https://issues.apache.org/jira/browse/SPARK-38076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38076: - Description: There are many code pattern as follows: {code:java} obj != null && obj instanceof

[jira] [Updated] (SPARK-38076) Remove redundant null check is covered by further condition

[ https://issues.apache.org/jira/browse/SPARK-38076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38076: - Description: There are many code pattern as follows: {code:java} obj != null && obj instanceof

[jira] [Updated] (SPARK-38076) Remove redundant null-check is covered by further condition

[ https://issues.apache.org/jira/browse/SPARK-38076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38076: - Summary: Remove redundant null-check is covered by further condition (was: Remove redundant null check

[jira] [Created] (SPARK-38076) Remove redundant null check is covered by further condition

Yang Jie created SPARK-38076: Summary: Remove redundant null check is covered by further condition Key: SPARK-38076 URL: https://issues.apache.org/jira/browse/SPARK-38076 Project: Spark Issue

[jira] [Updated] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38075: -- Affects Version/s: 3.2.1 > Hive script transform with order by and limit will return fake

[jira] [Commented] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484472#comment-17484472 ] Apache Spark commented on SPARK-38075: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38075: Assignee: Apache Spark > Hive script transform with order by and limit will return fake

[jira] [Commented] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484471#comment-17484471 ] Apache Spark commented on SPARK-38075: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38075: Assignee: (was: Apache Spark) > Hive script transform with order by and limit will

[jira] [Commented] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484468#comment-17484468 ] Bruce Robbins commented on SPARK-38075: --- It's a small iterator issue. I will make a PR shortly. >

[jira] [Updated] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38075: -- Affects Version/s: 3.1.2 > Hive script transform with order by and limit will return fake

[jira] [Updated] (SPARK-38075) Hive script transform with order by and limit will return fake rows

[ https://issues.apache.org/jira/browse/SPARK-38075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38075: -- Affects Version/s: 3.2.0 > Hive script transform with order by and limit will return fake

[jira] [Created] (SPARK-38075) Hive script transform with order by and limit will return fake rows

Bruce Robbins created SPARK-38075: - Summary: Hive script transform with order by and limit will return fake rows Key: SPARK-38075 URL: https://issues.apache.org/jira/browse/SPARK-38075 Project: Spark

[jira] [Commented] (SPARK-37415) Inline type hints for python/pyspark/ml/util.py

[ https://issues.apache.org/jira/browse/SPARK-37415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484461#comment-17484461 ] Apache Spark commented on SPARK-37415: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37415) Inline type hints for python/pyspark/ml/util.py

[ https://issues.apache.org/jira/browse/SPARK-37415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37415: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/ml/util.py >

[jira] [Assigned] (SPARK-37415) Inline type hints for python/pyspark/ml/util.py

[ https://issues.apache.org/jira/browse/SPARK-37415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37415: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/util.py >

[jira] [Commented] (SPARK-37415) Inline type hints for python/pyspark/ml/util.py

[ https://issues.apache.org/jira/browse/SPARK-37415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484460#comment-17484460 ] Apache Spark commented on SPARK-37415: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-37941) Use error classes in the compilation errors of casting

[ https://issues.apache.org/jira/browse/SPARK-37941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484414#comment-17484414 ] Apache Spark commented on SPARK-37941: -- User 'ivoson' has created a pull request for this issue:

[jira] [Resolved] (SPARK-38072) Support K8s imageTag parameter in SBT K8s IT

[ https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38072. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35365

[jira] [Assigned] (SPARK-38072) Support K8s imageTag parameter in SBT K8s IT

[ https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38072: - Assignee: William Hyun > Support K8s imageTag parameter in SBT K8s IT >

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484401#comment-17484401 ] Vu Tan commented on SPARK-35531: Hi, JFYI, I tested the above commands on my local PC with

[jira] [Updated] (SPARK-38074) RuntimeError: Java gateway process exited before sending its port number

[ https://issues.apache.org/jira/browse/SPARK-38074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Malla updated SPARK-38074: -- Summary: RuntimeError: Java gateway process exited before sending its port number (was: RuntimeError: Java

[jira] [Updated] (SPARK-38074) RuntimeError: Java gateway process exited before sending its port number

[ https://issues.apache.org/jira/browse/SPARK-38074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Malla updated SPARK-38074: -- Priority: Blocker (was: Major) > RuntimeError: Java gateway process exited before sending its port number >

[jira] [Created] (SPARK-38074) RuntimeError: Java gateway process exited before sending its port numbe

Malla created SPARK-38074: - Summary: RuntimeError: Java gateway process exited before sending its port numbe Key: SPARK-38074 URL: https://issues.apache.org/jira/browse/SPARK-38074 Project: Spark

[jira] [Commented] (SPARK-38073) NameError: name 'sc' is not defined when running driver with IPyhon and Pyhon > 3.7

[ https://issues.apache.org/jira/browse/SPARK-38073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484378#comment-17484378 ] Maciej Szymkiewicz commented on SPARK-38073: [~holden] FYI, since you questioned usage of

[jira] [Created] (SPARK-38073) NameError: name 'sc' is not defined when running driver with IPyhon and Pyhon > 3.7

Maciej Szymkiewicz created SPARK-38073: -- Summary: NameError: name 'sc' is not defined when running driver with IPyhon and Pyhon > 3.7 Key: SPARK-38073 URL: https://issues.apache.org/jira/browse/SPARK-38073

[jira] [Assigned] (SPARK-38072) Support K8s imageTag parameter in SBT K8s IT

[ https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38072: Assignee: (was: Apache Spark) > Support K8s imageTag parameter in SBT K8s IT >

[jira] [Assigned] (SPARK-38072) Support K8s imageTag parameter in SBT K8s IT

[ https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38072: Assignee: Apache Spark > Support K8s imageTag parameter in SBT K8s IT >

[jira] [Commented] (SPARK-38072) Support K8s imageTag parameter in SBT K8s IT

[ https://issues.apache.org/jira/browse/SPARK-38072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484321#comment-17484321 ] Apache Spark commented on SPARK-38072: -- User 'williamhyun' has created a pull request for this

[jira] [Created] (SPARK-38072) Support K8s imageTag parameter in SBT K8s IT

William Hyun created SPARK-38072: Summary: Support K8s imageTag parameter in SBT K8s IT Key: SPARK-38072 URL: https://issues.apache.org/jira/browse/SPARK-38072 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

[ https://issues.apache.org/jira/browse/SPARK-38058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484318#comment-17484318 ] john commented on SPARK-38058: -- it seems it doesn't specific to sql server.it is the problem with the spark

[jira] [Comment Edited] (SPARK-37916) The ConfigMap is assigned to incorrect namespace

[ https://issues.apache.org/jira/browse/SPARK-37916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484314#comment-17484314 ] Chia-Ping Tsai edited comment on SPARK-37916 at 1/30/22, 9:08 AM: -- see

[jira] [Resolved] (SPARK-37916) The ConfigMap is assigned to incorrect namespace

[ https://issues.apache.org/jira/browse/SPARK-37916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved SPARK-37916. Resolution: Duplicate see SPARK-37713 > The ConfigMap is assigned to incorrect namespace