[jira] [Commented] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289983#comment-17289983 ] Pavel Ganelin commented on SPARK-34521: --- Originally submitted to ARROW:

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Summary: JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call (was:

[jira] [Updated] (SPARK-34523) JDK-8194653: JDK-8194653 Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Summary: JDK-8194653: JDK-8194653 Deadlock involving FileSystems.getDefault and System.loadLibrary call

[jira] [Created] (SPARK-34523) JDK-8194653

Kent Yao created SPARK-34523: Summary: JDK-8194653 Key: SPARK-34523 URL: https://issues.apache.org/jira/browse/SPARK-34523 Project: Spark Issue Type: Sub-task Components: Spark Core

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Attachment: (was: bug-1.png) > Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Attachment: (was: bug-2.png) > Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Resolved] (SPARK-34514) Push down limit for LEFT SEMI and LEFT ANTI join

[ https://issues.apache.org/jira/browse/SPARK-34514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34514. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31630

[jira] [Updated] (SPARK-34517) breeze.linalg.SparseVector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: I implemented an iterative graph algorithm with 'breeze.linalg.SparseVector' just like

[jira] [Updated] (SPARK-34517) breeze.linalg.SparseVector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: I implemented an iterative graph algorithm with 'breeze.linalg.SparseVector' just like

[jira] [Updated] (SPARK-34520) Remove unused SecurityManager references

[ https://issues.apache.org/jira/browse/SPARK-34520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34520: - Summary: Remove unused SecurityManager references (was: Remove unused SecurityManager) >

[jira] [Created] (SPARK-34522) Issue Tracker for JDK related Bugs

Kent Yao created SPARK-34522: Summary: Issue Tracker for JDK related Bugs Key: SPARK-34522 URL: https://issues.apache.org/jira/browse/SPARK-34522 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-34523) JDK-8194653

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Attachment: 4303.log > JDK-8194653 > --- > > Key: SPARK-34523 >

[jira] [Resolved] (SPARK-34515) Fix NPE if InSet contains null value during getPartitionsByFilter

[ https://issues.apache.org/jira/browse/SPARK-34515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34515. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34515) Fix NPE if InSet contains null value during getPartitionsByFilter

[ https://issues.apache.org/jira/browse/SPARK-34515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34515: --- Assignee: ulysses you > Fix NPE if InSet contains null value during getPartitionsByFilter

[jira] [Created] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

Pavel Ganelin created SPARK-34521: - Summary: spark.createDataFrame does not support Pandas StringDtype extension type Key: SPARK-34521 URL: https://issues.apache.org/jira/browse/SPARK-34521 Project:

[jira] [Resolved] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34523. -- Resolution: Information Provided > JDK-8194653: Deadlock involving FileSystems.getDefault and >

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Created] (SPARK-34520) Remove unused SecurityManager

Hyukjin Kwon created SPARK-34520: Summary: Remove unused SecurityManager Key: SPARK-34520 URL: https://issues.apache.org/jira/browse/SPARK-34520 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33504) The application log in the Spark history server contains sensitive attributes such as password that should be redated instead of plain text

[ https://issues.apache.org/jira/browse/SPARK-33504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33504: Fix Version/s: 3.0.3 > The application log in the Spark history server contains sensitive

[jira] [Created] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

GH created SPARK-34517: -- Summary: Unexpected result when using 'aggregateMessages' with 'outerJoinVertices' Key: SPARK-34517 URL: https://issues.apache.org/jira/browse/SPARK-34517 Project: Spark Issue

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Priority: Major (was: Critical) > Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-28231) Adaptive execution should ignore RepartitionByExpression

[ https://issues.apache.org/jira/browse/SPARK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jrex Ge updated SPARK-28231: Issue Type: Bug (was: Wish) > Adaptive execution should ignore RepartitionByExpression >

[jira] [Assigned] (SPARK-34520) Remove unused SecurityManager references

[ https://issues.apache.org/jira/browse/SPARK-34520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34520: Assignee: Apache Spark > Remove unused SecurityManager references >

[jira] [Assigned] (SPARK-34520) Remove unused SecurityManager references

[ https://issues.apache.org/jira/browse/SPARK-34520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34520: Assignee: (was: Apache Spark) > Remove unused SecurityManager references >

[jira] [Commented] (SPARK-34520) Remove unused SecurityManager references

[ https://issues.apache.org/jira/browse/SPARK-34520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289878#comment-17289878 ] Apache Spark commented on SPARK-34520: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-34518) Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand`

Maxim Gekk created SPARK-34518: -- Summary: Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand` Key: SPARK-34518 URL: https://issues.apache.org/jira/browse/SPARK-34518 Project: Spark

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-34484) Introduce a new syntax to represent map types with the Catalyst DSL

[ https://issues.apache.org/jira/browse/SPARK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34484: --- Summary: Introduce a new syntax to represent map types with the Catalyst DSL (was:

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Comment Edited] (SPARK-32195) Standardize warning types and messages

[ https://issues.apache.org/jira/browse/SPARK-32195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289833#comment-17289833 ] Maciej Szymkiewicz edited comment on SPARK-32195 at 2/24/21, 10:26 AM:

[jira] [Comment Edited] (SPARK-32195) Standardize warning types and messages

[ https://issues.apache.org/jira/browse/SPARK-32195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289833#comment-17289833 ] Maciej Szymkiewicz edited comment on SPARK-32195 at 2/24/21, 10:26 AM:

[jira] [Updated] (SPARK-34517) breeze.linalg.Vector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: I implement an iterative graph algorithm with > breeze.linalg.Vector.equals always return true

[jira] [Updated] (SPARK-34447) Refactor the unified v1 and v2 command tests

[ https://issues.apache.org/jira/browse/SPARK-34447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34447: --- Description: The ticket aims to gather potential improvements for the unified tests. 1. Remove

[jira] [Commented] (SPARK-32195) Standardize warning types and messages

[ https://issues.apache.org/jira/browse/SPARK-32195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289833#comment-17289833 ] Maciej Szymkiewicz commented on SPARK-32195: [~RISHI_23]  SPARK-33730 is already resolved

[jira] [Updated] (SPARK-34517) breeze.linalg.SparseVector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: I implemented an iterative graph algorithm with 'breeze.linalg.SparseVector' just like

[jira] [Assigned] (SPARK-34518) Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand`

[ https://issues.apache.org/jira/browse/SPARK-34518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34518: Assignee: (was: Apache Spark) > Rename `AlterTableRecoverPartitionsCommand` to

[jira] [Commented] (SPARK-34518) Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand`

[ https://issues.apache.org/jira/browse/SPARK-34518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289801#comment-17289801 ] Apache Spark commented on SPARK-34518: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34518) Rename `AlterTableRecoverPartitionsCommand` to `RepairTableCommand`

[ https://issues.apache.org/jira/browse/SPARK-34518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34518: Assignee: Apache Spark > Rename `AlterTableRecoverPartitionsCommand` to

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Attachment: bug-1.png bug-2.png > Unexpected result when using 'aggregateMessages' with

[jira] [Commented] (SPARK-34497) JDBC connection provider is not removing kerberos credentials from JVM security context

[ https://issues.apache.org/jira/browse/SPARK-34497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289815#comment-17289815 ] Gabor Somogyi commented on SPARK-34497: --- Thanks for the suggestion, filled. > JDBC connection

[jira] [Updated] (SPARK-34497) JDBC connection provider is not removing kerberos credentials from JVM security context

[ https://issues.apache.org/jira/browse/SPARK-34497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-34497: -- Description: Some of the built-in JDBC connection providers are changing the JVM security

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-28231) Do not modify the number of partitions set by the user when using repartition

[ https://issues.apache.org/jira/browse/SPARK-28231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jrex Ge updated SPARK-28231: Summary: Do not modify the number of partitions set by the user when using repartition (was: Adaptive

[jira] [Created] (SPARK-34519) ExecutorPodsAllocator use exponential backoff strategy when request executor pod failed

Fengyu Cao created SPARK-34519: -- Summary: ExecutorPodsAllocator use exponential backoff strategy when request executor pod failed Key: SPARK-34519 URL: https://issues.apache.org/jira/browse/SPARK-34519

[jira] [Updated] (SPARK-34517) breeze.linalg.SparseVector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Summary: breeze.linalg.SparseVector.equals always return true may bring error. (was:

[jira] [Updated] (SPARK-34517) breeze.linalg.Vector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: I implemented an iterative graph algorithm with 'breeze.linalg.SparseVector' just like

[jira] [Commented] (SPARK-34232) redact credentials not working when log slow event enabled

[ https://issues.apache.org/jira/browse/SPARK-34232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289794#comment-17289794 ] Apache Spark commented on SPARK-34232: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-34517) Unexpected result when using 'aggregateMessages' with 'outerJoinVertices'

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when  implementing an

[jira] [Updated] (SPARK-34517) breeze.linalg.Vector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: (was: Using 'Graph.aggregateMessages' and 'Graph.outerJoinVertices' together when 

[jira] [Updated] (SPARK-34517) breeze.linalg.Vector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Summary: breeze.linalg.Vector.equals always return true may bring error. (was: Unexpected result when using

[jira] [Updated] (SPARK-34517) breeze.linalg.SparseVector.equals always return true may bring error.

[ https://issues.apache.org/jira/browse/SPARK-34517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MiKou updated SPARK-34517: -- Description: I implemented an iterative graph algorithm with 'breeze.linalg.SparseVector' just like

[jira] [Commented] (SPARK-34520) Remove unused SecurityManager references

[ https://issues.apache.org/jira/browse/SPARK-34520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289879#comment-17289879 ] Apache Spark commented on SPARK-34520: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-34525) Update Spark Create Table DDL Docs

Miklos Christine created SPARK-34525: Summary: Update Spark Create Table DDL Docs Key: SPARK-34525 URL: https://issues.apache.org/jira/browse/SPARK-34525 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34524) simplify v2 partition commands resolution

[ https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290120#comment-17290120 ] Apache Spark commented on SPARK-34524: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-34526) Add a flag to skip checking file sink format and handle glob path

Yuanjian Li created SPARK-34526: --- Summary: Add a flag to skip checking file sink format and handle glob path Key: SPARK-34526 URL: https://issues.apache.org/jira/browse/SPARK-34526 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type

[ https://issues.apache.org/jira/browse/SPARK-34521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Ganelin updated SPARK-34521: -- Comment: was deleted (was: Originally submitted to ARROW:

[jira] [Commented] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290084#comment-17290084 ] Dongjoon Hyun commented on SPARK-34523: --- Hi, [~Qin Yao]. This looks like a duplicate JDK

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290158#comment-17290158 ] Sean R. Owen commented on SPARK-34448: -- I crudely ported the test setup to a Scala test, and tried

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290052#comment-17290052 ] Sean R. Owen commented on SPARK-34448: -- Yes I believe you're definitely correct there's a problem

[jira] [Created] (SPARK-34524) simplify v2 partition commands resolution

Wenchen Fan created SPARK-34524: --- Summary: simplify v2 partition commands resolution Key: SPARK-34524 URL: https://issues.apache.org/jira/browse/SPARK-34524 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290087#comment-17290087 ] Dongjoon Hyun commented on SPARK-34523: --- I'd like to recommend to make a documentation PR instead.

[jira] [Updated] (SPARK-34526) Add a flag to skip checking file sink format and handle glob path

[ https://issues.apache.org/jira/browse/SPARK-34526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-34526: Description: This ticket fixes the following issues related to file sink format checking

[jira] [Commented] (SPARK-33212) Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile

[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290127#comment-17290127 ] Chao Sun commented on SPARK-33212: -- Thanks again [~ouyangxc.zte].

[jira] [Updated] (SPARK-34525) Update Spark Create Table DDL Docs

[ https://issues.apache.org/jira/browse/SPARK-34525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34525: Labels: starter (was: ) > Update Spark Create Table DDL Docs > -- > >

[jira] [Assigned] (SPARK-34524) simplify v2 partition commands resolution

[ https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34524: Assignee: (was: Apache Spark) > simplify v2 partition commands resolution >

[jira] [Assigned] (SPARK-34524) simplify v2 partition commands resolution

[ https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34524: Assignee: Apache Spark > simplify v2 partition commands resolution >

[jira] [Commented] (SPARK-34524) simplify v2 partition commands resolution

[ https://issues.apache.org/jira/browse/SPARK-34524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290119#comment-17290119 ] Apache Spark commented on SPARK-34524: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

[ https://issues.apache.org/jira/browse/SPARK-34527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290211#comment-17290211 ] Karen Feng commented on SPARK-34527: I've implemented a fix for this, will push a PR. >

[jira] [Commented] (SPARK-34526) Add a flag to skip checking file sink format and handle glob path

[ https://issues.apache.org/jira/browse/SPARK-34526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290177#comment-17290177 ] Apache Spark commented on SPARK-34526: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-34526) Add a flag to skip checking file sink format and handle glob path

[ https://issues.apache.org/jira/browse/SPARK-34526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34526: Assignee: Apache Spark > Add a flag to skip checking file sink format and handle glob

[jira] [Assigned] (SPARK-34526) Add a flag to skip checking file sink format and handle glob path

[ https://issues.apache.org/jira/browse/SPARK-34526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34526: Assignee: (was: Apache Spark) > Add a flag to skip checking file sink format and

[jira] [Created] (SPARK-34527) De-duplicated common columns cannot be resolved from USING/NATURAL JOIN

Karen Feng created SPARK-34527: -- Summary: De-duplicated common columns cannot be resolved from USING/NATURAL JOIN Key: SPARK-34527 URL: https://issues.apache.org/jira/browse/SPARK-34527 Project: Spark

[jira] [Resolved] (SPARK-32617) Upgrade kubernetes client version to support latest minikube version.

[ https://issues.apache.org/jira/browse/SPARK-32617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32617. -- Fix Version/s: 3.2.0 Assignee: Attila Zsolt Piros Resolution: Fixed > Upgrade

[jira] [Created] (SPARK-34528) View result are not consistent after a modification inside a struct of the table

Thomas Prelle created SPARK-34528: - Summary: View result are not consistent after a modification inside a struct of the table Key: SPARK-34528 URL: https://issues.apache.org/jira/browse/SPARK-34528

[jira] [Created] (SPARK-34529) spark.read.csv is throwing exception ,"lineSep' can contain only 1 character" when parsing windows line feed (CR LF)

Shanmugavel Kuttiyandi Chandrakasu created SPARK-34529: -- Summary: spark.read.csv is throwing exception ,"lineSep' can contain only 1 character" when parsing windows line feed (CR LF) Key: SPARK-34529

[jira] [Commented] (SPARK-34528) View result are not consistent after a modification inside a struct of the table

[ https://issues.apache.org/jira/browse/SPARK-34528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290275#comment-17290275 ] Apache Spark commented on SPARK-34528: -- User 'tprelle' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34528) View result are not consistent after a modification inside a struct of the table

[ https://issues.apache.org/jira/browse/SPARK-34528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34528: Assignee: Apache Spark > View result are not consistent after a modification inside a

[jira] [Assigned] (SPARK-34528) View result are not consistent after a modification inside a struct of the table

[ https://issues.apache.org/jira/browse/SPARK-34528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34528: Assignee: (was: Apache Spark) > View result are not consistent after a modification

[jira] [Updated] (SPARK-34529) spark.read.csv is throwing exception ,"lineSep' can contain only 1 character" when parsing windows line feed (CR LF)

[ https://issues.apache.org/jira/browse/SPARK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34529: - Issue Type: Improvement (was: Bug) > spark.read.csv is throwing exception ,"lineSep'

[jira] [Updated] (SPARK-34529) spark.read.csv is throwing exception ,"lineSep' can contain only 1 character" when parsing windows line feed (CR LF)

[ https://issues.apache.org/jira/browse/SPARK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34529: - Component/s: (was: Spark Core) SQL > spark.read.csv is throwing

[jira] [Created] (SPARK-34530) logError for interrupting block migrations is too high

Holden Karau created SPARK-34530: Summary: logError for interrupting block migrations is too high Key: SPARK-34530 URL: https://issues.apache.org/jira/browse/SPARK-34530 Project: Spark Issue

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: This will cause deadlock and hangs concurrent tasks forever on the same executor. for

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Attachment: screenshot-1.png > JDK-8194653: Deadlock involving FileSystems.getDefault and >

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Attachment: screenshot-2.png > JDK-8194653: Deadlock involving FileSystems.getDefault and >

[jira] [Commented] (SPARK-34516) Spark 3.0.1 encounter parquet PageHerder IO issue

[ https://issues.apache.org/jira/browse/SPARK-34516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290599#comment-17290599 ] Dongjoon Hyun commented on SPARK-34516: --- Hi, [~angerszhuuu]. Could you provide a reproducer? For

[jira] [Comment Edited] (SPARK-33212) Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile

[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290613#comment-17290613 ] Chao Sun edited comment on SPARK-33212 at 2/25/21, 2:21 AM: I was able to

[jira] [Commented] (SPARK-34529) spark.read.csv is throwing exception ,"lineSep' can contain only 1 character" when parsing windows line feed (CR LF)

[ https://issues.apache.org/jira/browse/SPARK-34529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290539#comment-17290539 ] Takeshi Yamamuro commented on SPARK-34529: -- Since I think this is not a bug but improvement, I

[jira] [Resolved] (SPARK-34497) JDBC connection provider is not removing kerberos credentials from JVM security context

[ https://issues.apache.org/jira/browse/SPARK-34497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34497. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31622

[jira] [Assigned] (SPARK-34497) JDBC connection provider is not removing kerberos credentials from JVM security context

[ https://issues.apache.org/jira/browse/SPARK-34497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34497: Assignee: Gabor Somogyi > JDBC connection provider is not removing kerberos credentials

[jira] [Updated] (SPARK-34523) JDK-8194653: Deadlock involving FileSystems.getDefault and System.loadLibrary call

[ https://issues.apache.org/jira/browse/SPARK-34523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34523: - Description: This will cause deadlock and hangs concurrent tasks forever on the same executor. for

[jira] [Updated] (SPARK-34531) Remove Experimental API tag in PrometheusServlet

[ https://issues.apache.org/jira/browse/SPARK-34531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34531: -- Issue Type: Bug (was: Improvement) > Remove Experimental API tag in PrometheusServlet >

[jira] [Updated] (SPARK-34531) Remove Experimental API tag in PrometheusServlet

[ https://issues.apache.org/jira/browse/SPARK-34531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34531: -- Affects Version/s: (was: 3.1.2) 3.1.1 > Remove Experimental API

[jira] [Updated] (SPARK-34531) Remove Experimental API tag in PrometheusServlet

[ https://issues.apache.org/jira/browse/SPARK-34531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34531: -- Affects Version/s: 3.0.2 > Remove Experimental API tag in PrometheusServlet >

[jira] [Updated] (SPARK-34531) Remove Experimental API tag in PrometheusServlet

[ https://issues.apache.org/jira/browse/SPARK-34531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34531: -- Affects Version/s: 3.1.2 > Remove Experimental API tag in PrometheusServlet >

  1   2   >