[jira] [Assigned] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

[ https://issues.apache.org/jira/browse/SPARK-34854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34854: Assignee: Apache Spark > Report metrics for streaming source through progress reporter

[jira] [Assigned] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

[ https://issues.apache.org/jira/browse/SPARK-34854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34854: Assignee: (was: Apache Spark) > Report metrics for streaming source through progress

[jira] [Commented] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

[ https://issues.apache.org/jira/browse/SPARK-34854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307630#comment-17307630 ] Apache Spark commented on SPARK-34854: -- User 'yijiacui-db' has created a pull request for this

[jira] [Assigned] (SPARK-34477) Kryo NPEs when serializing Avro GenericData objects (except GenericRecord)

[ https://issues.apache.org/jira/browse/SPARK-34477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-34477: -- Assignee: Shardul Mahadik > Kryo NPEs when serializing Avro GenericData objects

[jira] [Resolved] (SPARK-34477) Kryo NPEs when serializing Avro GenericData objects (except GenericRecord)

[ https://issues.apache.org/jira/browse/SPARK-34477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34477. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31597

[jira] [Updated] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

[ https://issues.apache.org/jira/browse/SPARK-34854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijia Cui updated SPARK-34854: -- Description: Report Metrics for streaming source through progress reporter to users. Add kafka micro

[jira] [Updated] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

[ https://issues.apache.org/jira/browse/SPARK-34854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijia Cui updated SPARK-34854: -- Description: Report Metrics for streaming source through progress reporter to users. Add kafka micro

[jira] [Updated] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

[ https://issues.apache.org/jira/browse/SPARK-34854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijia Cui updated SPARK-34854: -- Description: Report Metrics for streaming source through progress reporter to users. Add kafka micro

[jira] [Resolved] (SPARK-34825) pyspark.sql.function.lit is treating '1' the same as 1

[ https://issues.apache.org/jira/browse/SPARK-34825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34825. -- Resolution: Invalid > pyspark.sql.function.lit is treating '1' the same as 1 >

[jira] [Commented] (SPARK-34825) pyspark.sql.function.lit is treating '1' the same as 1

[ https://issues.apache.org/jira/browse/SPARK-34825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307623#comment-17307623 ] Hyukjin Kwon commented on SPARK-34825: -- It treats as a string properly. It just internally casts to

[jira] [Resolved] (SPARK-34830) Some UDF calls inside transform are broken

[ https://issues.apache.org/jira/browse/SPARK-34830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34830. -- Resolution: Duplicate It's very likely the same issue I believe .. > Some UDF calls inside

[jira] [Created] (SPARK-34854) Report metrics for streaming source through progress reporter with Kafka source use-case

Yijia Cui created SPARK-34854: - Summary: Report metrics for streaming source through progress reporter with Kafka source use-case Key: SPARK-34854 URL: https://issues.apache.org/jira/browse/SPARK-34854

[jira] [Resolved] (SPARK-34831) spark2.3 can't add column in carbondata table

[ https://issues.apache.org/jira/browse/SPARK-34831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34831. -- Resolution: Not A Problem > spark2.3 can't add column in carbondata table >

[jira] [Commented] (SPARK-34831) spark2.3 can't add column in carbondata table

[ https://issues.apache.org/jira/browse/SPARK-34831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307618#comment-17307618 ] Hyukjin Kwon commented on SPARK-34831: -- It's very likely from the source implementation. Spark

[jira] [Assigned] (SPARK-34853) Move partitioning and ordering to common limit trait

[ https://issues.apache.org/jira/browse/SPARK-34853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34853: Assignee: Apache Spark > Move partitioning and ordering to common limit trait >

[jira] [Assigned] (SPARK-34853) Move partitioning and ordering to common limit trait

[ https://issues.apache.org/jira/browse/SPARK-34853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34853: Assignee: (was: Apache Spark) > Move partitioning and ordering to common limit trait

[jira] [Commented] (SPARK-34853) Move partitioning and ordering to common limit trait

[ https://issues.apache.org/jira/browse/SPARK-34853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307614#comment-17307614 ] Apache Spark commented on SPARK-34853: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-34849) SPIP: Support pandas API layer on PySpark

[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307610#comment-17307610 ] Hyukjin Kwon commented on SPARK-34849: -- The official SPIP preparation is in progress. It will be

[jira] [Created] (SPARK-34853) Move partitioning and ordering to common limit trait

Cheng Su created SPARK-34853: Summary: Move partitioning and ordering to common limit trait Key: SPARK-34853 URL: https://issues.apache.org/jira/browse/SPARK-34853 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Shepherd: Hyukjin Kwon > SPIP: Support pandas API layer on PySpark >

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Updated] (SPARK-34849) SPIP: Support pandas API layer on PySpark

[ https://issues.apache.org/jira/browse/SPARK-34849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34849: - Description: This is a SPIP for porting [Koalas project|https://github.com/databricks/koalas] 

[jira] [Commented] (SPARK-34851) Add scope tag in configuration

[ https://issues.apache.org/jira/browse/SPARK-34851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307608#comment-17307608 ] Takeshi Yamamuro commented on SPARK-34851: -- Fill the description, please. > Add scope tag in

[jira] [Assigned] (SPARK-34852) Close Hive session state should use withHiveState

[ https://issues.apache.org/jira/browse/SPARK-34852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34852: Assignee: (was: Apache Spark) > Close Hive session state should use withHiveState >

[jira] [Assigned] (SPARK-34852) Close Hive session state should use withHiveState

[ https://issues.apache.org/jira/browse/SPARK-34852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34852: Assignee: Apache Spark > Close Hive session state should use withHiveState >

[jira] [Commented] (SPARK-34852) Close Hive session state should use withHiveState

[ https://issues.apache.org/jira/browse/SPARK-34852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307607#comment-17307607 ] Apache Spark commented on SPARK-34852: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-34852) Close Hive session state should use withHiveState

ulysses you created SPARK-34852: --- Summary: Close Hive session state should use withHiveState Key: SPARK-34852 URL: https://issues.apache.org/jira/browse/SPARK-34852 Project: Spark Issue Type:

[jira] [Created] (SPARK-34851) Add scope tag in configuration

angerszhu created SPARK-34851: - Summary: Add scope tag in configuration Key: SPARK-34851 URL: https://issues.apache.org/jira/browse/SPARK-34851 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307590#comment-17307590 ] Li Xian commented on SPARK-26345: - [~yumwang] I think the current implementation has a problem. the

[jira] [Assigned] (SPARK-34848) add duration in TaskMetricsDistribution

[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34848: Assignee: (was: Apache Spark) > add duration in TaskMetricsDistribution >

[jira] [Assigned] (SPARK-34848) add duration in TaskMetricsDistribution

[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34848: Assignee: Apache Spark > add duration in TaskMetricsDistribution >

[jira] [Commented] (SPARK-34848) add duration in TaskMetricsDistribution

[ https://issues.apache.org/jira/browse/SPARK-34848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307588#comment-17307588 ] Apache Spark commented on SPARK-34848: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-34850) Multiply day-time interval by numeric

[ https://issues.apache.org/jira/browse/SPARK-34850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34850: - Description: Support the multiply op over day-time interval by numeric types including: # ByteType #

[jira] [Created] (SPARK-34850) Multiply day-time interval by numeric

Max Gekk created SPARK-34850: Summary: Multiply day-time interval by numeric Key: SPARK-34850 URL: https://issues.apache.org/jira/browse/SPARK-34850 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34849) SPIP: Support pandas API layer on PySpark

Haejoon Lee created SPARK-34849: --- Summary: SPIP: Support pandas API layer on PySpark Key: SPARK-34849 URL: https://issues.apache.org/jira/browse/SPARK-34849 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-34848) add duration in TaskMetricsDistribution

angerszhu created SPARK-34848: - Summary: add duration in TaskMetricsDistribution Key: SPARK-34848 URL: https://issues.apache.org/jira/browse/SPARK-34848 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-34832) ExternalAppendOnlyUnsafeRowArrayBenchmark can't run with spark-submit

[ https://issues.apache.org/jira/browse/SPARK-34832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34832. -- Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution:

[jira] [Assigned] (SPARK-34832) ExternalAppendOnlyUnsafeRowArrayBenchmark can't run with spark-submit

[ https://issues.apache.org/jira/browse/SPARK-34832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34832: Assignee: Yang Jie > ExternalAppendOnlyUnsafeRowArrayBenchmark can't run with

<    1   2