[jira] [Commented] (SPARK-39457) Support IPv6-only environment

[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554830#comment-17554830 ] DB Tsai commented on SPARK-39457: - If there is any IPv6 issue in Hadoop client side, we might hit it

[jira] [Created] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

DB Tsai created SPARK-39459: --- Summary: LocalSchedulerBackend doesn't support IPV6 Key: SPARK-39459 URL: https://issues.apache.org/jira/browse/SPARK-39459 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39457) Support pure IPV6 environment without IPV4

DB Tsai created SPARK-39457: --- Summary: Support pure IPV6 environment without IPV4 Key: SPARK-39457 URL: https://issues.apache.org/jira/browse/SPARK-39457 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-36895) Add Create Index syntax support

[ https://issues.apache.org/jira/browse/SPARK-36895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36895. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34148

[jira] [Assigned] (SPARK-36895) Add Create Index syntax support

[ https://issues.apache.org/jira/browse/SPARK-36895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36895: --- Assignee: Huaxin Gao > Add Create Index syntax support > --- > >

[jira] [Resolved] (SPARK-37113) Upgrade Parquet to 1.12.2

[ https://issues.apache.org/jira/browse/SPARK-37113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-37113. - Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37113) Upgrade Parquet to 1.12.2

[ https://issues.apache.org/jira/browse/SPARK-37113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-37113: --- Assignee: Chao Sun > Upgrade Parquet to 1.12.2 > - > >

[jira] [Assigned] (SPARK-36821) Create a test to extend ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-36821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36821: --- Assignee: Yufei Gu > Create a test to extend ColumnarBatch > -

[jira] [Resolved] (SPARK-36821) Create a test to extend ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-36821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36821. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34087

[jira] [Assigned] (SPARK-36814) Make class ColumnarBatch extendable

[ https://issues.apache.org/jira/browse/SPARK-36814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36814: --- Assignee: Yufei Gu > Make class ColumnarBatch extendable > --- > >

[jira] [Resolved] (SPARK-36814) Make class ColumnarBatch extendable

[ https://issues.apache.org/jira/browse/SPARK-36814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36814. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34054

[jira] [Comment Edited] (SPARK-36696) spark.read.parquet loads empty dataset

[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415703#comment-17415703 ] DB Tsai edited comment on SPARK-36696 at 9/15/21, 7:21 PM: --- This issue is

[jira] [Comment Edited] (SPARK-36696) spark.read.parquet loads empty dataset

[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415703#comment-17415703 ] DB Tsai edited comment on SPARK-36696 at 9/15/21, 7:20 PM: --- This issue is

[jira] [Commented] (SPARK-36696) spark.read.parquet loads empty dataset

[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415703#comment-17415703 ] DB Tsai commented on SPARK-36696: - This issue is addressed by

[jira] [Resolved] (SPARK-36726) Upgrade Parquet to 1.12.1

[ https://issues.apache.org/jira/browse/SPARK-36726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36726. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33969

[jira] [Assigned] (SPARK-36726) Upgrade Parquet to 1.12.1

[ https://issues.apache.org/jira/browse/SPARK-36726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36726: --- Assignee: Chao Sun > Upgrade Parquet to 1.12.1 > - > >

[jira] [Resolved] (SPARK-36644) Push down boolean column filter

[ https://issues.apache.org/jira/browse/SPARK-36644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36644. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33898

[jira] [Assigned] (SPARK-36644) Push down boolean column filter

[ https://issues.apache.org/jira/browse/SPARK-36644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36644: --- Assignee: Kazuyuki Tanimura > Push down boolean column filter > --- >

[jira] [Resolved] (SPARK-36481) Expose LogisticRegression.setInitialModel

[ https://issues.apache.org/jira/browse/SPARK-36481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36481. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33710

[jira] [Resolved] (SPARK-35921) ${spark.yarn.isHadoopProvided} in config.properties is not edited if build with SBT

[ https://issues.apache.org/jira/browse/SPARK-35921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-35921. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33121

[jira] [Commented] (SPARK-35782) leveldbjni doesn't work in Apple Silicon on macOS

[ https://issues.apache.org/jira/browse/SPARK-35782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365014#comment-17365014 ] DB Tsai commented on SPARK-35782: - [~yikunkero] It will only work for Apple Silicon on Linux but not

[jira] [Updated] (SPARK-35782) leveldbjni doesn't work in Apple Silicon on macOS

[ https://issues.apache.org/jira/browse/SPARK-35782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-35782: Description: leveldbjni doesn't contain the native library for Apple Silicon on macOS. We will need to

[jira] [Created] (SPARK-35782) leveldbjni doesn't work in Apple Silicon on macOS

DB Tsai created SPARK-35782: --- Summary: leveldbjni doesn't work in Apple Silicon on macOS Key: SPARK-35782 URL: https://issues.apache.org/jira/browse/SPARK-35782 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively

[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-35781: Description: This is an umbrella JIRA tracking the progress of supporting Apple Silicon on macOS

[jira] [Created] (SPARK-35781) Support Spark on Apple Silicon on macOS natively

DB Tsai created SPARK-35781: --- Summary: Support Spark on Apple Silicon on macOS natively Key: SPARK-35781 URL: https://issues.apache.org/jira/browse/SPARK-35781 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-35640) Refactor Parquet vectorized reader to remove duplicated code paths

[ https://issues.apache.org/jira/browse/SPARK-35640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-35640. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32777

[jira] [Commented] (SPARK-33966) Two-tier encryption key management

[ https://issues.apache.org/jira/browse/SPARK-33966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259454#comment-17259454 ] DB Tsai commented on SPARK-33966: - cc [~dongjoon] [~chaosun] and [~viirya] > Two-tier encryption key

[jira] [Resolved] (SPARK-33212) Move to shaded clients for Hadoop 3.x profile

[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-33212. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29843

[jira] [Assigned] (SPARK-33212) Move to shaded clients for Hadoop 3.x profile

[ https://issues.apache.org/jira/browse/SPARK-33212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-33212: --- Assignee: Chao Sun > Move to shaded clients for Hadoop 3.x profile >

[jira] [Resolved] (SPARK-32721) Simplify if clauses with null and boolean

[ https://issues.apache.org/jira/browse/SPARK-32721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-32721. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29567

[jira] [Assigned] (SPARK-32721) Simplify if clauses with null and boolean

[ https://issues.apache.org/jira/browse/SPARK-32721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-32721: --- Assignee: Chao Sun > Simplify if clauses with null and boolean >

[jira] [Updated] (SPARK-22231) Support of map, filter, withField, dropFields in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-22231: Summary: Support of map, filter, withField, dropFields in nested list of structures (was: Support of

[jira] [Resolved] (SPARK-32397) Snapshot artifacts can have differing timestamps, making it hard to consume

[ https://issues.apache.org/jira/browse/SPARK-32397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-32397. - Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution: Fixed Issue

[jira] [Comment Edited] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167504#comment-17167504 ] DB Tsai edited comment on SPARK-32385 at 7/29/20, 9:04 PM: --- +1 This will be

[jira] [Commented] (SPARK-32385) Publish a "bill of materials" (BOM) descriptor for Spark with correct versions of various dependencies

[ https://issues.apache.org/jira/browse/SPARK-32385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167504#comment-17167504 ] DB Tsai commented on SPARK-32385: - +1 This will be very useful for users to include Spark as deps.  

[jira] [Resolved] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31960. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28788

[jira] [Updated] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31960: Parent: SPARK-31582 Issue Type: Sub-task (was: Bug) > Only populate Hadoop classpath for

[jira] [Updated] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31960: Summary: Only populate Hadoop classpath for no-hadoop build (was: Only populate Hadoop classpath when

[jira] [Created] (SPARK-31960) Only populate Hadoop classpath when hadoop is provided

DB Tsai created SPARK-31960: --- Summary: Only populate Hadoop classpath when hadoop is provided Key: SPARK-31960 URL: https://issues.apache.org/jira/browse/SPARK-31960 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-31876) Upgrade to Zstd 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-31876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31876: --- Assignee: William Hyun > Upgrade to Zstd 1.4.5 > - > > Key:

[jira] [Resolved] (SPARK-31876) Upgrade to Zstd 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-31876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31876. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28682

[jira] [Updated] (SPARK-31399) Closure cleaner broken in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-31399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31399: Fix Version/s: 2.4.6 > Closure cleaner broken in Scala 2.12 > > >

[jira] [Comment Edited] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105680#comment-17105680 ] DB Tsai edited comment on SPARK-25557 at 5/12/20, 6:57 PM: --- [~omalley] No

[jira] [Commented] (SPARK-25557) ORC predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-25557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105680#comment-17105680 ] DB Tsai commented on SPARK-25557: - [~omalley] No missing part on ORC side. We already have the

[jira] [Updated] (SPARK-31582) Be able to not populate Hadoop classpath

[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31582: Fix Version/s: 3.0.0 > Be able to not populate Hadoop classpath >

[jira] [Updated] (SPARK-31582) Being able to not populate Hadoop classpath

[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31582: Summary: Being able to not populate Hadoop classpath (was: Be able to not populate Hadoop classpath) >

[jira] [Resolved] (SPARK-31582) Be able to not populate Hadoop classpath

[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31582. - Fix Version/s: 2.4.6 Resolution: Fixed Issue resolved by pull request 28376

[jira] [Assigned] (SPARK-31582) Be able to not populate Hadoop classpath

[ https://issues.apache.org/jira/browse/SPARK-31582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31582: --- Assignee: DB Tsai > Be able to not populate Hadoop classpath >

[jira] [Created] (SPARK-31582) Be able to not populate Hadoop classpath

DB Tsai created SPARK-31582: --- Summary: Be able to not populate Hadoop classpath Key: SPARK-31582 URL: https://issues.apache.org/jira/browse/SPARK-31582 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-31364) Benchmark Nested Parquet Predicate Pushdown

[ https://issues.apache.org/jira/browse/SPARK-31364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31364. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28319

[jira] [Updated] (SPARK-31364) Benchmark Nested Parquet Predicate Pushdown

[ https://issues.apache.org/jira/browse/SPARK-31364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31364: Summary: Benchmark Nested Parquet Predicate Pushdown (was: Benchmark Parquet Predicate Pushdown) >

[jira] [Created] (SPARK-31365) Enable nested predicate pushdown per data sources

DB Tsai created SPARK-31365: --- Summary: Enable nested predicate pushdown per data sources Key: SPARK-31365 URL: https://issues.apache.org/jira/browse/SPARK-31365 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-25558) Pushdown predicates for nested fields in DataSource Strategy

[ https://issues.apache.org/jira/browse/SPARK-25558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076731#comment-17076731 ] DB Tsai edited comment on SPARK-25558 at 4/6/20, 11:05 PM: --- Issue resolved by 

[jira] [Resolved] (SPARK-25558) Pushdown predicates for nested fields in DataSource Strategy

[ https://issues.apache.org/jira/browse/SPARK-25558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-25558. - Fix Version/s: 3.0.0 Resolution: Fixed > Pushdown predicates for nested fields in DataSource

[jira] [Commented] (SPARK-25558) Pushdown predicates for nested fields in DataSource Strategy

[ https://issues.apache.org/jira/browse/SPARK-25558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076731#comment-17076731 ] DB Tsai commented on SPARK-25558: - Issued resolved by [https://github.com/apache/spark/pull/27728] >

[jira] [Created] (SPARK-31364) Benchmark Parquet Predicate Pushdown

DB Tsai created SPARK-31364: --- Summary: Benchmark Parquet Predicate Pushdown Key: SPARK-31364 URL: https://issues.apache.org/jira/browse/SPARK-31364 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-27644) Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-27644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-27644. - Resolution: Duplicate > Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default >

[jira] [Updated] (SPARK-29805) Enable nested schema pruning and pruning on expressions by default

[ https://issues.apache.org/jira/browse/SPARK-29805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-29805: Parent: SPARK-25603 Issue Type: Sub-task (was: New Feature) > Enable nested schema pruning and

[jira] [Updated] (SPARK-27644) Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-27644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-27644: Parent: (was: SPARK-25556) Issue Type: New Feature (was: Sub-task) > Enable

[jira] [Updated] (SPARK-27644) Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-27644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-27644: Parent: SPARK-25603 Issue Type: Sub-task (was: New Feature) > Enable

[jira] [Resolved] (SPARK-31313) Add `m01` node name to support Minikube 1.8.x

[ https://issues.apache.org/jira/browse/SPARK-31313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31313. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28080

[jira] [Assigned] (SPARK-31313) Add `m01` node name to support Minikube 1.8.x

[ https://issues.apache.org/jira/browse/SPARK-31313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31313: --- Assignee: Dongjoon Hyun > Add `m01` node name to support Minikube 1.8.x >

[jira] [Commented] (SPARK-17636) Parquet predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072142#comment-17072142 ] DB Tsai commented on SPARK-17636: - [~MasterDDT] we are not able to merge a new feature to an old

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071969#comment-17071969 ] DB Tsai commented on SPARK-22231: - [~fqaiser94] Thanks for continuing this work. We implemented this

[jira] [Created] (SPARK-31317) Add withField method to Column class

DB Tsai created SPARK-31317: --- Summary: Add withField method to Column class Key: SPARK-31317 URL: https://issues.apache.org/jira/browse/SPARK-31317 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-22231: --- Assignee: (was: Jeremy Smith) > Support of map, filter, withColumn, dropColumn in nested list

[jira] [Assigned] (SPARK-31064) New Parquet Predicate Filter APIs with multi-part Identifier Support

[ https://issues.apache.org/jira/browse/SPARK-31064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31064: --- Assignee: DB Tsai > New Parquet Predicate Filter APIs with multi-part Identifier Support >

[jira] [Resolved] (SPARK-31064) New Parquet Predicate Filter APIs with multi-part Identifier Support

[ https://issues.apache.org/jira/browse/SPARK-31064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31064. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27824

[jira] [Created] (SPARK-31064) New Parquet Predicate Filter APIs with multi-part Identifier Support

DB Tsai created SPARK-31064: --- Summary: New Parquet Predicate Filter APIs with multi-part Identifier Support Key: SPARK-31064 URL: https://issues.apache.org/jira/browse/SPARK-31064 Project: Spark

[jira] [Resolved] (SPARK-31058) Consolidate the implementation of quoteIfNeeded

[ https://issues.apache.org/jira/browse/SPARK-31058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31058. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27814

[jira] [Assigned] (SPARK-31058) Consolidate the implementation of quoteIfNeeded

[ https://issues.apache.org/jira/browse/SPARK-31058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31058: --- Assignee: DB Tsai > Consolidate the implementation of quoteIfNeeded >

[jira] [Created] (SPARK-31060) Handle column names containing `dots` in data source `Filter`

DB Tsai created SPARK-31060: --- Summary: Handle column names containing `dots` in data source `Filter` Key: SPARK-31060 URL: https://issues.apache.org/jira/browse/SPARK-31060 Project: Spark Issue

[jira] [Created] (SPARK-31058) Consolidate the implementation of quoteIfNeeded

DB Tsai created SPARK-31058: --- Summary: Consolidate the implementation of quoteIfNeeded Key: SPARK-31058 URL: https://issues.apache.org/jira/browse/SPARK-31058 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31027) Refactor `DataSourceStrategy.scala` to minimize the changes to support nested predicate pushdown

[ https://issues.apache.org/jira/browse/SPARK-31027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31027: Fix Version/s: (was: 3.1.0) 3.0.0 > Refactor `DataSourceStrategy.scala` to

[jira] [Updated] (SPARK-31026) Parquet predicate pushdown on columns with dots

[ https://issues.apache.org/jira/browse/SPARK-31026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31026: Summary: Parquet predicate pushdown on columns with dots (was: Enable Parquet predicate pushdown on

[jira] [Created] (SPARK-31027) Refactor `DataSourceStrategy.scala` to minimize the changes to support nested predicate pushdown

DB Tsai created SPARK-31027: --- Summary: Refactor `DataSourceStrategy.scala` to minimize the changes to support nested predicate pushdown Key: SPARK-31027 URL: https://issues.apache.org/jira/browse/SPARK-31027

[jira] [Created] (SPARK-31026) Enable Parquet predicate pushdown on columns with dots

DB Tsai created SPARK-31026: --- Summary: Enable Parquet predicate pushdown on columns with dots Key: SPARK-31026 URL: https://issues.apache.org/jira/browse/SPARK-31026 Project: Spark Issue Type: New

[jira] [Created] (SPARK-30920) DSv2 Predicate Framework

DB Tsai created SPARK-30920: --- Summary: DSv2 Predicate Framework Key: SPARK-30920 URL: https://issues.apache.org/jira/browse/SPARK-30920 Project: Spark Issue Type: New Feature Components:

[jira] [Resolved] (SPARK-30289) Partitioned by Nested Column for `InMemoryTable`

[ https://issues.apache.org/jira/browse/SPARK-30289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-30289. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26929

[jira] [Updated] (SPARK-30289) Partitioned by Nested Column for `InMemoryTable`

[ https://issues.apache.org/jira/browse/SPARK-30289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-30289: Summary: Partitioned by Nested Column for `InMemoryTable` (was: DSv2 partitioning should not accept

[jira] [Created] (SPARK-30289) DSv2 partitioning should not accept nested columns

DB Tsai created SPARK-30289: --- Summary: DSv2 partitioning should not accept nested columns Key: SPARK-30289 URL: https://issues.apache.org/jira/browse/SPARK-30289 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-25694. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26530

[jira] [Assigned] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-25694: --- Assignee: Dongjoon Hyun > URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection

[jira] [Resolved] (SPARK-24203) Make executor's bindAddress configurable

[ https://issues.apache.org/jira/browse/SPARK-24203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-24203. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26331

[jira] [Resolved] (SPARK-29805) Enable nested schema pruning and pruning on expressions by default

[ https://issues.apache.org/jira/browse/SPARK-29805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29805. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26443

[jira] [Created] (SPARK-29805) Enable nested schema pruning and pruning on expressions by default

DB Tsai created SPARK-29805: --- Summary: Enable nested schema pruning and pruning on expressions by default Key: SPARK-29805 URL: https://issues.apache.org/jira/browse/SPARK-29805 Project: Spark

[jira] [Assigned] (SPARK-24203) Make executor's bindAddress configurable

[ https://issues.apache.org/jira/browse/SPARK-24203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-24203: --- Assignee: Nishchal Venkataramana > Make executor's bindAddress configurable >

[jira] [Reopened] (SPARK-24203) Make executor's bindAddress configurable

[ https://issues.apache.org/jira/browse/SPARK-24203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reopened SPARK-24203: - > Make executor's bindAddress configurable > > >

[jira] [Commented] (SPARK-29670) Make executor's bindAddress configurable

[ https://issues.apache.org/jira/browse/SPARK-29670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964599#comment-16964599 ] DB Tsai commented on SPARK-29670: - This is a duplication of SPARK-29670 > Make executor's bindAddress

[jira] [Resolved] (SPARK-29670) Make executor's bindAddress configurable

[ https://issues.apache.org/jira/browse/SPARK-29670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29670. - Resolution: Duplicate > Make executor's bindAddress configurable >

[jira] [Created] (SPARK-29576) Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

DB Tsai created SPARK-29576: --- Summary: Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus Key: SPARK-29576 URL: https://issues.apache.org/jira/browse/SPARK-29576 Project: Spark Issue

[jira] [Assigned] (SPARK-29515) MapStatuses SerDeser Benchmark

[ https://issues.apache.org/jira/browse/SPARK-29515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-29515: --- Assignee: DB Tsai > MapStatuses SerDeser Benchmark > -- > >

[jira] [Resolved] (SPARK-29515) MapStatuses SerDeser Benchmark

[ https://issues.apache.org/jira/browse/SPARK-29515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29515. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26169

[jira] [Updated] (SPARK-29515) MapStatuses SerDeser Benchmark

[ https://issues.apache.org/jira/browse/SPARK-29515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-29515: Affects Version/s: (was: 3.0.0) 2.4.4 > MapStatuses SerDeser Benchmark >

[jira] [Created] (SPARK-29515) MapStatuses SerDeser Benchmark

DB Tsai created SPARK-29515: --- Summary: MapStatuses SerDeser Benchmark Key: SPARK-29515 URL: https://issues.apache.org/jira/browse/SPARK-29515 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-29434) Improve the MapStatuses serialization performance

DB Tsai created SPARK-29434: --- Summary: Improve the MapStatuses serialization performance Key: SPARK-29434 URL: https://issues.apache.org/jira/browse/SPARK-29434 Project: Spark Issue Type: New

[jira] [Created] (SPARK-29351) Avoid full synchronization in ShuffleMapStage

DB Tsai created SPARK-29351: --- Summary: Avoid full synchronization in ShuffleMapStage Key: SPARK-29351 URL: https://issues.apache.org/jira/browse/SPARK-29351 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-29079) Enable GitHub Action on PR

[ https://issues.apache.org/jira/browse/SPARK-29079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29079. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25786

[jira] [Resolved] (SPARK-29032) Simplify Prometheus support by adding PrometheusServlet

[ https://issues.apache.org/jira/browse/SPARK-29032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29032. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25769

[jira] [Resolved] (SPARK-29064) Add PrometheusResource to export Executor metrics

[ https://issues.apache.org/jira/browse/SPARK-29064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-29064. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25770

  1   2   3   4   5   6   7   >