[jira] [Assigned] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39490: Assignee: Dongjoon Hyun (was: Apache Spark) > Support `ipFamilyPolicy` and `ipFamilies`

[jira] [Commented] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554911#comment-17554911 ] Apache Spark commented on SPARK-39490: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39490: Assignee: Apache Spark (was: Dongjoon Hyun) > Support `ipFamilyPolicy` and `ipFamilies`

[jira] [Updated] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39490: -- Description: K8s IPv4/IPv6 dual-stack Feature reached `Stable` stage at v1.23. -

[jira] [Updated] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39490: -- Description: K8s IPv4/IPv6 dual-stack Feature reached `Stable` stage at v1.23. -

[jira] [Updated] (SPARK-39490) Support `ipFamilyPolicy` and `ipFamilies` in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39490: -- Summary: Support `ipFamilyPolicy` and `ipFamilies` in Driver Service (was: Support

[jira] [Assigned] (SPARK-39490) Support ipFamilyPolicy and ipFamilies in Driver Service

[ https://issues.apache.org/jira/browse/SPARK-39490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39490: - Assignee: Dongjoon Hyun > Support ipFamilyPolicy and ipFamilies in Driver Service >

[jira] [Created] (SPARK-39490) Support ipFamilyPolicy and ipFamilies in Driver Service

Dongjoon Hyun created SPARK-39490: - Summary: Support ipFamilyPolicy and ipFamilies in Driver Service Key: SPARK-39490 URL: https://issues.apache.org/jira/browse/SPARK-39490 Project: Spark

[jira] [Commented] (SPARK-39399) proxy-user support not working for Spark on k8s in cluster deploy mode

[ https://issues.apache.org/jira/browse/SPARK-39399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554904#comment-17554904 ] pralabhkumar commented on SPARK-39399: -- ping [~hyukjin.kwon]  , please help us on the same or

[jira] [Commented] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554899#comment-17554899 ] Hyukjin Kwon commented on SPARK-39074: -- Reverted at

[jira] [Assigned] (SPARK-39383) Support V2 data sources with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39383: -- Assignee: Daniel > Support V2 data sources with DEFAULT values >

[jira] [Resolved] (SPARK-39383) Support V2 data sources with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39383. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36880

[jira] [Reopened] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-39074: -- Assignee: (was: Enrico Minack) > Fail on uploading test files, not when downloading

[jira] [Commented] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554895#comment-17554895 ] Hyukjin Kwon commented on SPARK-39074: -- Fixed in

[jira] [Assigned] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39074: Assignee: (was: Apache Spark) > Fail on uploading test files, not when downloading

[jira] [Assigned] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39074: Assignee: Apache Spark > Fail on uploading test files, not when downloading them >

[jira] [Updated] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39074: - Fix Version/s: (was: 3.4.0) > Fail on uploading test files, not when downloading them >

[jira] [Commented] (SPARK-39489) Improve EventLoggingListener and ReplayListener performance by replacing Json4S ASTs with Jackson trees

[ https://issues.apache.org/jira/browse/SPARK-39489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554874#comment-17554874 ] Apache Spark commented on SPARK-39489: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Created] (SPARK-39489) Improve EventLoggingListener and ReplayListener performance by replacing Json4S ASTs with Jackson trees

Josh Rosen created SPARK-39489: -- Summary: Improve EventLoggingListener and ReplayListener performance by replacing Json4S ASTs with Jackson trees Key: SPARK-39489 URL:

[jira] [Assigned] (SPARK-39488) Simplify the error handling of TempResolvedColumn

[ https://issues.apache.org/jira/browse/SPARK-39488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39488: Assignee: (was: Apache Spark) > Simplify the error handling of TempResolvedColumn >

[jira] [Assigned] (SPARK-39488) Simplify the error handling of TempResolvedColumn

[ https://issues.apache.org/jira/browse/SPARK-39488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39488: Assignee: Apache Spark > Simplify the error handling of TempResolvedColumn >

[jira] [Commented] (SPARK-39488) Simplify the error handling of TempResolvedColumn

[ https://issues.apache.org/jira/browse/SPARK-39488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554851#comment-17554851 ] Apache Spark commented on SPARK-39488: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-39488) Simplify the error handling of TempResolvedColumn

Wenchen Fan created SPARK-39488: --- Summary: Simplify the error handling of TempResolvedColumn Key: SPARK-39488 URL: https://issues.apache.org/jira/browse/SPARK-39488 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

[ https://issues.apache.org/jira/browse/SPARK-39476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39476. - Fix Version/s: 3.3.1 3.2.2 3.1.3 3.4.0

[jira] [Assigned] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

[ https://issues.apache.org/jira/browse/SPARK-39476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39476: --- Assignee: EdisonWang > Disable Unwrap cast optimize when casting from Long to Float/

[jira] [Resolved] (SPARK-39465) Log4j version upgrade to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-39465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-39465. Resolution: Done > Log4j version upgrade to 2.17.2 > --- > >

[jira] [Reopened] (SPARK-39465) Log4j version upgrade to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-39465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-39465: > Log4j version upgrade to 2.17.2 > --- > > Key:

[jira] [Comment Edited] (SPARK-39465) Log4j version upgrade to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-39465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554844#comment-17554844 ] Josh Rosen edited comment on SPARK-39465 at 6/16/22 1:21 AM: - Spark uses

[jira] [Resolved] (SPARK-39465) Log4j version upgrade to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-39465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-39465. Resolution: Won't Fix > Log4j version upgrade to 2.17.2 > --- > >

[jira] [Commented] (SPARK-39465) Log4j version upgrade to 2.17.2

[ https://issues.apache.org/jira/browse/SPARK-39465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554844#comment-17554844 ] Josh Rosen commented on SPARK-39465: Spark uses Log4J 2.x starting in Spark 3.3.0+; see SPARK-37814 

[jira] [Assigned] (SPARK-39485) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39485: Assignee: (was: Apache Spark) > When fetching hiveMetastoreJars from path,

[jira] [Assigned] (SPARK-39485) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39485: Assignee: Apache Spark > When fetching hiveMetastoreJars from path, IsolatedClientLoader

[jira] [Commented] (SPARK-39485) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554840#comment-17554840 ] Apache Spark commented on SPARK-39485: -- User 'koodin9' has created a pull request for this issue:

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39061: - Fix Version/s: 3.3.1 (was: 3.3.0) > Incorrect results or NPE when using

[jira] [Assigned] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39061: Assignee: Bruce Robbins > Incorrect results or NPE when using Inline function against an

[jira] [Resolved] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39061. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-38292) Support `na_filter` for pyspark.pandas.read_csv

[ https://issues.apache.org/jira/browse/SPARK-38292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554836#comment-17554836 ] Hyukjin Kwon commented on SPARK-38292: -- please go ahead! > Support `na_filter` for

[jira] [Resolved] (SPARK-39482) Add build and test documentation on IPv6

[ https://issues.apache.org/jira/browse/SPARK-39482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39482. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36879

[jira] [Commented] (SPARK-39457) Support IPv6-only environment

[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554830#comment-17554830 ] DB Tsai commented on SPARK-39457: - If there is any IPv6 issue in Hadoop client side, we might hit it

[jira] [Closed] (SPARK-39486) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SeongHoon Ku closed SPARK-39486. duplicated https://issues.apache.org/jira/browse/SPARK-39485 > When fetching hiveMetastoreJars from

[jira] [Closed] (SPARK-39487) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SeongHoon Ku closed SPARK-39487. duplicated https://issues.apache.org/jira/browse/SPARK-39485 > When fetching hiveMetastoreJars from

[jira] [Resolved] (SPARK-39487) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SeongHoon Ku resolved SPARK-39487. -- Resolution: Duplicate > When fetching hiveMetastoreJars from path, IsolatedClientLoader

[jira] [Resolved] (SPARK-39486) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

[ https://issues.apache.org/jira/browse/SPARK-39486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SeongHoon Ku resolved SPARK-39486. -- Resolution: Duplicate > When fetching hiveMetastoreJars from path, IsolatedClientLoader

[jira] [Created] (SPARK-39487) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

SeongHoon Ku created SPARK-39487: Summary: When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader. Key: SPARK-39487 URL:

[jira] [Created] (SPARK-39486) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

SeongHoon Ku created SPARK-39486: Summary: When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader. Key: SPARK-39486 URL:

[jira] [Created] (SPARK-39485) When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader.

SeongHoon Ku created SPARK-39485: Summary: When fetching hiveMetastoreJars from path, IsolatedClientLoader should get hive settings from origLoader. Key: SPARK-39485 URL:

[jira] [Assigned] (SPARK-39469) Infer date type for CSV schema inference

[ https://issues.apache.org/jira/browse/SPARK-39469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39469: Assignee: (was: Apache Spark) > Infer date type for CSV schema inference >

[jira] [Commented] (SPARK-39469) Infer date type for CSV schema inference

[ https://issues.apache.org/jira/browse/SPARK-39469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554809#comment-17554809 ] Apache Spark commented on SPARK-39469: -- User 'Jonathancui123' has created a pull request for this

[jira] [Commented] (SPARK-39469) Infer date type for CSV schema inference

[ https://issues.apache.org/jira/browse/SPARK-39469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554808#comment-17554808 ] Apache Spark commented on SPARK-39469: -- User 'Jonathancui123' has created a pull request for this

[jira] [Assigned] (SPARK-39469) Infer date type for CSV schema inference

[ https://issues.apache.org/jira/browse/SPARK-39469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39469: Assignee: Apache Spark > Infer date type for CSV schema inference >

[jira] [Updated] (SPARK-39469) Infer date type for CSV schema inference

[ https://issues.apache.org/jira/browse/SPARK-39469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Cui updated SPARK-39469: - Description: 1. If a column contains only dates, it should be of “date” type in the inferred

[jira] [Assigned] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39061: Assignee: (was: Apache Spark) > Incorrect results or NPE when using Inline function

[jira] [Commented] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554801#comment-17554801 ] Apache Spark commented on SPARK-39061: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39061: Assignee: Apache Spark > Incorrect results or NPE when using Inline function against an

[jira] [Commented] (SPARK-39468) Improve RpcAddress to add [] to IPv6 if needed

[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554800#comment-17554800 ] Apache Spark commented on SPARK-39468: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39484) V2 write for type struct fails to handle case sensitivity on field names during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-39484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554777#comment-17554777 ] Apache Spark commented on SPARK-39484: -- User 'edgarRd' has created a pull request for this issue:

[jira] [Commented] (SPARK-39484) V2 write for type struct fails to handle case sensitivity on field names during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-39484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554776#comment-17554776 ] Edgar Rodriguez commented on SPARK-39484: - Proposed solution PR:

[jira] [Assigned] (SPARK-39484) V2 write for type struct fails to handle case sensitivity on field names during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-39484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39484: Assignee: Apache Spark > V2 write for type struct fails to handle case sensitivity on

[jira] [Assigned] (SPARK-39484) V2 write for type struct fails to handle case sensitivity on field names during resolution of V2 write command

[ https://issues.apache.org/jira/browse/SPARK-39484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39484: Assignee: (was: Apache Spark) > V2 write for type struct fails to handle case

[jira] [Created] (SPARK-39484) V2 write for type struct fails to handle case sensitivity on field names during resolution of V2 write command

Edgar Rodriguez created SPARK-39484: --- Summary: V2 write for type struct fails to handle case sensitivity on field names during resolution of V2 write command Key: SPARK-39484 URL:

[jira] [Commented] (SPARK-39383) Support V2 data sources with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554761#comment-17554761 ] Apache Spark commented on SPARK-39383: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-39383) Support V2 data sources with DEFAULT values

[ https://issues.apache.org/jira/browse/SPARK-39383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554760#comment-17554760 ] Apache Spark commented on SPARK-39383: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

[ https://issues.apache.org/jira/browse/SPARK-39483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554733#comment-17554733 ] Apache Spark commented on SPARK-39483: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

[ https://issues.apache.org/jira/browse/SPARK-39483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554734#comment-17554734 ] Apache Spark commented on SPARK-39483: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

[ https://issues.apache.org/jira/browse/SPARK-39483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39483: Assignee: (was: Apache Spark) > Construct the schema from `np.dtype` when

[jira] [Assigned] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

[ https://issues.apache.org/jira/browse/SPARK-39483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39483: Assignee: Apache Spark > Construct the schema from `np.dtype` when `createDataFrame`

[jira] [Created] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

Xinrong Meng created SPARK-39483: Summary: Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array Key: SPARK-39483 URL: https://issues.apache.org/jira/browse/SPARK-39483

[jira] [Assigned] (SPARK-39482) Add build and test documentation on IPv6

[ https://issues.apache.org/jira/browse/SPARK-39482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39482: Assignee: Dongjoon Hyun (was: Apache Spark) > Add build and test documentation on IPv6

[jira] [Commented] (SPARK-39482) Add build and test documentation on IPv6

[ https://issues.apache.org/jira/browse/SPARK-39482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554698#comment-17554698 ] Apache Spark commented on SPARK-39482: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39482) Add build and test documentation on IPv6

[ https://issues.apache.org/jira/browse/SPARK-39482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39482: Assignee: Apache Spark (was: Dongjoon Hyun) > Add build and test documentation on IPv6

[jira] [Updated] (SPARK-39482) Add build and test documentation on IPv6

[ https://issues.apache.org/jira/browse/SPARK-39482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39482: -- Summary: Add build and test documentation on IPv6 (was: Add IPv6 documentation) > Add build

[jira] [Assigned] (SPARK-39482) Add IPv6 documentation

[ https://issues.apache.org/jira/browse/SPARK-39482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39482: - Assignee: Dongjoon Hyun > Add IPv6 documentation > -- > >

[jira] [Created] (SPARK-39482) Add IPv6 documentation

Dongjoon Hyun created SPARK-39482: - Summary: Add IPv6 documentation Key: SPARK-39482 URL: https://issues.apache.org/jira/browse/SPARK-39482 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-39481) Pandas UDF executed twice if used in projection followed by filter

[ https://issues.apache.org/jira/browse/SPARK-39481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Dijamco updated SPARK-39481: Description: In this scenario, a Pandas UDF will be executed twice: # Projection that

[jira] [Created] (SPARK-39481) Pandas UDF executed twice if used in projection followed by filter

Timothy Dijamco created SPARK-39481: --- Summary: Pandas UDF executed twice if used in projection followed by filter Key: SPARK-39481 URL: https://issues.apache.org/jira/browse/SPARK-39481 Project:

[jira] [Assigned] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39480: Assignee: Apache Spark > Parquet bit-packing de/encode optimization >

[jira] [Assigned] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39480: Assignee: (was: Apache Spark) > Parquet bit-packing de/encode optimization >

[jira] [Commented] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554672#comment-17554672 ] Apache Spark commented on SPARK-39480: -- User 'Fang-Xie' has created a pull request for this issue:

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Description: Current Spark use Parquet-mr as parquet reader/writer library, but the built-in

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Attachment: image-2022-06-15-22-54-07-288.png > Parquet bit-packing de/encode optimization >

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Attachment: image-2022-06-15-22-53-35-937.png > Parquet bit-packing de/encode optimization >

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Attachment: image-2022-06-15-22-52-56-792.png > Parquet bit-packing de/encode optimization >

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Attachment: (was: image-2022-06-15-22-48-46-554.png) > Parquet bit-packing de/encode optimization >

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Description: Current Spark use Parquet-mr as parquet reader/writer library, but the built-in

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Attachment: image-2022-06-15-22-50-12-759.png > Parquet bit-packing de/encode optimization >

[jira] [Commented] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554639#comment-17554639 ] Fang-Xie commented on SPARK-39480: -- !image-2022-06-15-22-48-46-554.png! > Parquet bit-packing

[jira] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480 ] Fang-Xie deleted comment on SPARK-39480: -- was (Author: JIRAUSER288151): !image-2022-06-15-22-48-46-554.png! > Parquet bit-packing de/encode optimization >

[jira] [Updated] (SPARK-39480) Parquet bit-packing de/encode optimization

[ https://issues.apache.org/jira/browse/SPARK-39480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fang-Xie updated SPARK-39480: - Attachment: image-2022-06-15-22-48-46-554.png > Parquet bit-packing de/encode optimization >

[jira] [Created] (SPARK-39480) Parquet bit-packing de/encode optimization

Fang-Xie created SPARK-39480: Summary: Parquet bit-packing de/encode optimization Key: SPARK-39480 URL: https://issues.apache.org/jira/browse/SPARK-39480 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39074: - Priority: Minor (was: Major) > Fail on uploading test files, not when downloading them >

[jira] [Assigned] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39074: Assignee: Enrico Minack > Fail on uploading test files, not when downloading them >

[jira] [Resolved] (SPARK-39074) Fail on uploading test files, not when downloading them

[ https://issues.apache.org/jira/browse/SPARK-39074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39074. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36413

[jira] [Commented] (SPARK-38292) Support `na_filter` for pyspark.pandas.read_csv

[ https://issues.apache.org/jira/browse/SPARK-38292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554551#comment-17554551 ] pralabhkumar commented on SPARK-38292: -- [~itholic] I would like to work on this .  > Support

[jira] [Resolved] (SPARK-39477) Remove "Number of queries" info from the golden files of SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-39477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39477. -- Fix Version/s: 3.4.0 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-39479) DS V2 supports push down math functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554463#comment-17554463 ] Apache Spark commented on SPARK-39479: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39479) DS V2 supports push down math functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39479: Assignee: Apache Spark > DS V2 supports push down math functions(non ANSI) >

[jira] [Assigned] (SPARK-39479) DS V2 supports push down math functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39479: Assignee: (was: Apache Spark) > DS V2 supports push down math functions(non ANSI) >

[jira] [Commented] (SPARK-39479) DS V2 supports push down math functions(non ANSI)

[ https://issues.apache.org/jira/browse/SPARK-39479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554462#comment-17554462 ] Apache Spark commented on SPARK-39479: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-39479) DS V2 supports push down math functions(non ANSI)

jiaan.geng created SPARK-39479: -- Summary: DS V2 supports push down math functions(non ANSI) Key: SPARK-39479 URL: https://issues.apache.org/jira/browse/SPARK-39479 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39430) The inconsistent timezone in Spark History Server UI

[ https://issues.apache.org/jira/browse/SPARK-39430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surbhi updated SPARK-39430: --- Priority: Critical (was: Major) > The inconsistent timezone in Spark History Server UI >

  1   2   >