[jira] [Commented] (SPARK-32839) Make Spark scripts working with the spaces in paths on Windows

[ https://issues.apache.org/jira/browse/SPARK-32839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193409#comment-17193409 ] Apache Spark commented on SPARK-32839: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32839) Make Spark scripts working with the spaces in paths on Windows

[ https://issues.apache.org/jira/browse/SPARK-32839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32839: Assignee: (was: Apache Spark) > Make Spark scripts working with the spaces in paths o

[jira] [Assigned] (SPARK-32839) Make Spark scripts working with the spaces in paths on Windows

[ https://issues.apache.org/jira/browse/SPARK-32839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32839: Assignee: Apache Spark > Make Spark scripts working with the spaces in paths on Windows >

[jira] [Resolved] (SPARK-32832) Use CaseInsensitiveMap for DataStreamReader/Writer options

[ https://issues.apache.org/jira/browse/SPARK-32832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32832. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pul

[jira] [Created] (SPARK-32839) Make Spark scripts working with the spaces in paths on Windows

Hyukjin Kwon created SPARK-32839: Summary: Make Spark scripts working with the spaces in paths on Windows Key: SPARK-32839 URL: https://issues.apache.org/jira/browse/SPARK-32839 Project: Spark

[jira] [Assigned] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

[ https://issues.apache.org/jira/browse/SPARK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-32831: Assignee: Jungtaek Lim > Refactor SupportsStreamingUpdate to represent actual meaning of

[jira] [Resolved] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

[ https://issues.apache.org/jira/browse/SPARK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-32831. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29693 [https://gi

[jira] [Resolved] (SPARK-32312) Upgrade Apache Arrow to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-32312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32312. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29686 [https://gi

[jira] [Assigned] (SPARK-32312) Upgrade Apache Arrow to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-32312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32312: Assignee: Bryan Cutler > Upgrade Apache Arrow to 1.0.0 > - >

[jira] [Commented] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193374#comment-17193374 ] Apache Spark commented on SPARK-32819: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193372#comment-17193372 ] Apache Spark commented on SPARK-32819: -- User 'viirya' has created a pull request fo

[jira] [Resolved] (SPARK-32826) Add test case for get null columns using SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-32826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32826. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29687 [https://gith

[jira] [Assigned] (SPARK-32826) Add test case for get null columns using SparkGetColumnsOperation

[ https://issues.apache.org/jira/browse/SPARK-32826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32826: --- Assignee: Kent Yao > Add test case for get null columns using SparkGetColumnsOperation > --

[jira] [Updated] (SPARK-32834) from_avro is giving empty result

[ https://issues.apache.org/jira/browse/SPARK-32834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaitanya updated SPARK-32834: -- Description: I am trying to read a Kafka topic with Spark readStream but getting problem while applyi

[jira] [Commented] (SPARK-32058) Use Apache Hadoop 3.2.0 dependency by default

[ https://issues.apache.org/jira/browse/SPARK-32058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193364#comment-17193364 ] Apache Spark commented on SPARK-32058: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32017) Make Pyspark Hadoop 3.2+ Variant available in PyPI

[ https://issues.apache.org/jira/browse/SPARK-32017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193357#comment-17193357 ] Apache Spark commented on SPARK-32017: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32017) Make Pyspark Hadoop 3.2+ Variant available in PyPI

[ https://issues.apache.org/jira/browse/SPARK-32017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32017: Assignee: (was: Apache Spark) > Make Pyspark Hadoop 3.2+ Variant available in PyPI >

[jira] [Commented] (SPARK-32017) Make Pyspark Hadoop 3.2+ Variant available in PyPI

[ https://issues.apache.org/jira/browse/SPARK-32017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193356#comment-17193356 ] Apache Spark commented on SPARK-32017: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32017) Make Pyspark Hadoop 3.2+ Variant available in PyPI

[ https://issues.apache.org/jira/browse/SPARK-32017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32017: Assignee: Apache Spark > Make Pyspark Hadoop 3.2+ Variant available in PyPI > ---

[jira] [Commented] (SPARK-32838) Connot overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193354#comment-17193354 ] lithiumlee-_- commented on SPARK-32838: --- meet same problem. > Connot overwite dif

[jira] [Updated] (SPARK-32838) Connot overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-32838: Description: When: {code:java} CREATE TABLE tmp.spark3_snap ( id string ) PARTITIONED BY (dt string) STORED AS ORC

[jira] [Updated] (SPARK-32838) Connot overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-32838: Description: When: {code:java} CREATE TABLE tmp.spark3_snap ( id string ) PARTITIONED BY (dt string) STORED AS ORC

[jira] [Updated] (SPARK-32838) Connot overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-32838: Description: When: {code:java} CREATE TABLE tmp.spark3_snap ( id string ) PARTITIONED BY (dt string) STORED AS ORC

[jira] [Updated] (SPARK-32838) Connot overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-32838: Description: When: {code:java} CREATE TABLE tmp.spark3_snap ( id string ) PARTITIONED BY (dt string) STORED AS ORC

[jira] [Updated] (SPARK-32838) Connot overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] CHC updated SPARK-32838: Description: When: {code:java} CREATE TABLE tmp.spark3_snap ( id string ) PARTITIONED BY (dt string) STORED AS ORC

[jira] [Created] (SPARK-32838) Connot overwite different partition with same table

CHC created SPARK-32838: --- Summary: Connot overwite different partition with same table Key: SPARK-32838 URL: https://issues.apache.org/jira/browse/SPARK-32838 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-32837) Leverage pip and setup.py configurations to pass Hadoop and Hive options in pip installation

[ https://issues.apache.org/jira/browse/SPARK-32837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32837: - Component/s: Build > Leverage pip and setup.py configurations to pass Hadoop and Hive options in

[jira] [Created] (SPARK-32837) Leverage pip and setup.py configurations to pass Hadoop and Hive options in pip installation

Hyukjin Kwon created SPARK-32837: Summary: Leverage pip and setup.py configurations to pass Hadoop and Hive options in pip installation Key: SPARK-32837 URL: https://issues.apache.org/jira/browse/SPARK-32837

[jira] [Resolved] (SPARK-32589) NoSuchElementException: None.get for needsUnsafeRowConversion

[ https://issues.apache.org/jira/browse/SPARK-32589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-32589. - Resolution: Duplicate > NoSuchElementException: None.get for needsUnsafeRowConversion >

[jira] [Commented] (SPARK-24194) HadoopFsRelation cannot overwrite a path that is also being read from

[ https://issues.apache.org/jira/browse/SPARK-24194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193329#comment-17193329 ] CHC commented on SPARK-24194: - I met this on spark 3.0.0 too When: {code:java} insert overw

[jira] [Assigned] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32819: --- Assignee: L. C. Hsieh > Spark SQL aggregate() fails on nested string arrays > -

[jira] [Resolved] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32819. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29698 [https://gith

[jira] [Updated] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32836: -- Fix Version/s: (was: 2.4.7) 2.4.8 > Fix DataStreamReaderWriterSuite to

[jira] [Assigned] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32836: - Assignee: Dongjoon Hyun > Fix DataStreamReaderWriterSuite to check writer options corre

[jira] [Resolved] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32836. --- Fix Version/s: 3.0.2 3.1.0 2.4.7 Resolution: Fix

[jira] [Commented] (SPARK-32825) CTE support on MSSQL

[ https://issues.apache.org/jira/browse/SPARK-32825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193313#comment-17193313 ] Takeshi Yamamuro commented on SPARK-32825: -- +1 on the viirya comment above and

[jira] [Resolved] (SPARK-32825) CTE support on MSSQL

[ https://issues.apache.org/jira/browse/SPARK-32825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32825. -- Resolution: Invalid > CTE support on MSSQL > > >

[jira] [Resolved] (SPARK-32259) tmpfs=true, not pointing to SPARK_LOCAL_DIRS in k8s

[ https://issues.apache.org/jira/browse/SPARK-32259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakash Rajendran resolved SPARK-32259. --- Resolution: Not A Bug working as expected > tmpfs=true, not pointing to SPARK_LOCAL

[jira] [Commented] (SPARK-32832) Use CaseInsensitiveMap for DataStreamReader/Writer options

[ https://issues.apache.org/jira/browse/SPARK-32832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193278#comment-17193278 ] Apache Spark commented on SPARK-32832: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-32832) Use CaseInsensitiveMap for DataStreamReader/Writer options

[ https://issues.apache.org/jira/browse/SPARK-32832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193279#comment-17193279 ] Apache Spark commented on SPARK-32832: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32836: -- Affects Version/s: 2.0.2 > Fix DataStreamReaderWriterSuite to check writer options correctly >

[jira] [Assigned] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32836: Assignee: (was: Apache Spark) > Fix DataStreamReaderWriterSuite to check writer optio

[jira] [Assigned] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32836: Assignee: Apache Spark > Fix DataStreamReaderWriterSuite to check writer options correctl

[jira] [Commented] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193270#comment-17193270 ] Apache Spark commented on SPARK-32836: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32836: -- Affects Version/s: 2.1.3 > Fix DataStreamReaderWriterSuite to check writer options correctly >

[jira] [Updated] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32836: -- Affects Version/s: 2.3.4 > Fix DataStreamReaderWriterSuite to check writer options correctly >

[jira] [Updated] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32836: -- Affects Version/s: 2.2.3 > Fix DataStreamReaderWriterSuite to check writer options correctly >

[jira] [Updated] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

[ https://issues.apache.org/jira/browse/SPARK-32836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32836: -- Affects Version/s: 2.4.6 3.0.1 > Fix DataStreamReaderWriterSuite to che

[jira] [Created] (SPARK-32836) Fix DataStreamReaderWriterSuite to check writer options correctly

Dongjoon Hyun created SPARK-32836: - Summary: Fix DataStreamReaderWriterSuite to check writer options correctly Key: SPARK-32836 URL: https://issues.apache.org/jira/browse/SPARK-32836 Project: Spark

[jira] [Assigned] (SPARK-32677) Load function resource before create

[ https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32677: Assignee: (was: Apache Spark) > Load function resource before create > --

[jira] [Assigned] (SPARK-32677) Load function resource before create

[ https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32677: Assignee: Apache Spark > Load function resource before create > -

[jira] [Commented] (SPARK-32794) Rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 streaming sources

[ https://issues.apache.org/jira/browse/SPARK-32794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193259#comment-17193259 ] Apache Spark commented on SPARK-32794: -- User 'tdas' has created a pull request for

[jira] [Commented] (SPARK-32835) Add withField to PySpark Column class

[ https://issues.apache.org/jira/browse/SPARK-32835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193237#comment-17193237 ] Apache Spark commented on SPARK-32835: -- User 'Kimahriman' has created a pull reques

[jira] [Commented] (SPARK-32835) Add withField to PySpark Column class

[ https://issues.apache.org/jira/browse/SPARK-32835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193235#comment-17193235 ] Apache Spark commented on SPARK-32835: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-32835) Add withField to PySpark Column class

[ https://issues.apache.org/jira/browse/SPARK-32835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32835: Assignee: (was: Apache Spark) > Add withField to PySpark Column class > -

[jira] [Assigned] (SPARK-32835) Add withField to PySpark Column class

[ https://issues.apache.org/jira/browse/SPARK-32835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32835: Assignee: Apache Spark > Add withField to PySpark Column class >

[jira] [Created] (SPARK-32835) Add withField to PySpark Column class

Adam Binford created SPARK-32835: Summary: Add withField to PySpark Column class Key: SPARK-32835 URL: https://issues.apache.org/jira/browse/SPARK-32835 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32835) Add withField to PySpark Column class

[ https://issues.apache.org/jira/browse/SPARK-32835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193216#comment-17193216 ] Adam Binford commented on SPARK-32835: -- I think I already have a working version of

[jira] [Updated] (SPARK-32825) CTE support on MSSQL

[ https://issues.apache.org/jira/browse/SPARK-32825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32825: Component/s: (was: Spark Core) SQL > CTE support on MSSQL > -

[jira] [Commented] (SPARK-32825) CTE support on MSSQL

[ https://issues.apache.org/jira/browse/SPARK-32825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193200#comment-17193200 ] L. C. Hsieh commented on SPARK-32825: - The user provided query should be a query tha

[jira] [Updated] (SPARK-32815) Fix LibSVM data source loading error on file paths with glob metacharacters

[ https://issues.apache.org/jira/browse/SPARK-32815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32815: -- Affects Version/s: 2.4.6 3.0.1 > Fix LibSVM data source loading error o

[jira] [Commented] (SPARK-32677) Load function resource before create

[ https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193180#comment-17193180 ] Dongjoon Hyun commented on SPARK-32677: --- This is reverted via https://github.com/

[jira] [Reopened] (SPARK-32677) Load function resource before create

[ https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-32677: --- Assignee: (was: ulysses you) > Load function resource before create >

[jira] [Updated] (SPARK-32677) Load function resource before create

[ https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32677: -- Fix Version/s: (was: 3.1.0) > Load function resource before create > -

[jira] [Updated] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32819: Priority: Major (was: Minor) > Spark SQL aggregate() fails on nested string arrays >

[jira] [Assigned] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32819: Assignee: Apache Spark > Spark SQL aggregate() fails on nested string arrays > --

[jira] [Assigned] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32819: Assignee: (was: Apache Spark) > Spark SQL aggregate() fails on nested string arrays >

[jira] [Commented] (SPARK-32819) Spark SQL aggregate() fails on nested string arrays

[ https://issues.apache.org/jira/browse/SPARK-32819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193140#comment-17193140 ] Apache Spark commented on SPARK-32819: -- User 'viirya' has created a pull request fo

[jira] [Updated] (SPARK-32794) Rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 streaming sources

[ https://issues.apache.org/jira/browse/SPARK-32794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-32794: -- Fix Version/s: 3.0.2 3.1.0 2.4.8 > Rare corner case erro

[jira] [Commented] (SPARK-32516) path option is treated differently for 'format("parquet").load(path)' vs. 'parquet(path)'

[ https://issues.apache.org/jira/browse/SPARK-32516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193127#comment-17193127 ] Apache Spark commented on SPARK-32516: -- User 'imback82' has created a pull request

[jira] [Commented] (SPARK-32794) Rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 streaming sources

[ https://issues.apache.org/jira/browse/SPARK-32794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193096#comment-17193096 ] Apache Spark commented on SPARK-32794: -- User 'tdas' has created a pull request for

[jira] [Commented] (SPARK-32794) Rare corner case error in micro-batch engine with some stateful queries + no-data-batches + V1 streaming sources

[ https://issues.apache.org/jira/browse/SPARK-32794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193093#comment-17193093 ] Apache Spark commented on SPARK-32794: -- User 'tdas' has created a pull request for

[jira] [Commented] (SPARK-32833) JDBC V2 Datasource aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-32833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193092#comment-17193092 ] Apache Spark commented on SPARK-32833: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-32833) JDBC V2 Datasource aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-32833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193091#comment-17193091 ] Apache Spark commented on SPARK-32833: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-32833) JDBC V2 Datasource aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-32833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32833: Assignee: (was: Apache Spark) > JDBC V2 Datasource aggregate push down >

[jira] [Assigned] (SPARK-32833) JDBC V2 Datasource aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-32833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32833: Assignee: Apache Spark > JDBC V2 Datasource aggregate push down > ---

[jira] [Created] (SPARK-32834) from_avro is giving empty result

Chaitanya created SPARK-32834: - Summary: from_avro is giving empty result Key: SPARK-32834 URL: https://issues.apache.org/jira/browse/SPARK-32834 Project: Spark Issue Type: Bug Componen

[jira] [Created] (SPARK-32833) JDBC V2 Datasource aggregate push down

Huaxin Gao created SPARK-32833: -- Summary: JDBC V2 Datasource aggregate push down Key: SPARK-32833 URL: https://issues.apache.org/jira/browse/SPARK-32833 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-32832) Use CaseInsensitiveMap for DataStreamReader/Writer options

[ https://issues.apache.org/jira/browse/SPARK-32832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32832: - Assignee: Dongjoon Hyun > Use CaseInsensitiveMap for DataStreamReader/Writer options >

[jira] [Created] (SPARK-32832) Use CaseInsensitiveMap for DataStreamReader/Writer options

Dongjoon Hyun created SPARK-32832: - Summary: Use CaseInsensitiveMap for DataStreamReader/Writer options Key: SPARK-32832 URL: https://issues.apache.org/jira/browse/SPARK-32832 Project: Spark

[jira] [Commented] (SPARK-32187) User Guide - Shipping Python Package

[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193008#comment-17193008 ] Fabian Höring commented on SPARK-32187: --- Yes, back. Sorry, I had to handle other s

[jira] [Commented] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

[ https://issues.apache.org/jira/browse/SPARK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192825#comment-17192825 ] Apache Spark commented on SPARK-32831: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

[ https://issues.apache.org/jira/browse/SPARK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32831: Assignee: Apache Spark > Refactor SupportsStreamingUpdate to represent actual meaning of

[jira] [Assigned] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

[ https://issues.apache.org/jira/browse/SPARK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32831: Assignee: (was: Apache Spark) > Refactor SupportsStreamingUpdate to represent actual

[jira] [Commented] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

[ https://issues.apache.org/jira/browse/SPARK-32831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192823#comment-17192823 ] Apache Spark commented on SPARK-32831: -- User 'HeartSaVioR' has created a pull reque

[jira] [Created] (SPARK-32831) Refactor SupportsStreamingUpdate to represent actual meaning of the behavior

Jungtaek Lim created SPARK-32831: Summary: Refactor SupportsStreamingUpdate to represent actual meaning of the behavior Key: SPARK-32831 URL: https://issues.apache.org/jira/browse/SPARK-32831 Project:

[jira] [Updated] (SPARK-32829) while parsing the data from parquet to case class

[ https://issues.apache.org/jira/browse/SPARK-32829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-32829: - Issue Type: Bug (was: Question) > while parsing the data from parquet to case class > -

[jira] [Resolved] (SPARK-32829) while parsing the data from parquet to case class

[ https://issues.apache.org/jira/browse/SPARK-32829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32829. -- Resolution: Invalid > while parsing the data from parquet to case class >

[jira] [Commented] (SPARK-32829) while parsing the data from parquet to case class

[ https://issues.apache.org/jira/browse/SPARK-32829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192797#comment-17192797 ] Takeshi Yamamuro commented on SPARK-32829: -- If you don't provide a query to rep

[jira] [Commented] (SPARK-32067) [K8S] Executor pod template of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192764#comment-17192764 ] Vladislav Glinskiy commented on SPARK-32067: Also ran into this bug. I belie

[jira] [Comment Edited] (SPARK-17477) SparkSQL cannot handle schema evolution from Int -> Long when parquet files have Int as its type while hive metastore has Long as its type

[ https://issues.apache.org/jira/browse/SPARK-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192763#comment-17192763 ] Manjay Kumar edited comment on SPARK-17477 at 9/9/20, 10:25 AM: --

[jira] [Updated] (SPARK-32829) while parsing the data from parquet to case class

[ https://issues.apache.org/jira/browse/SPARK-32829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manjay Kumar updated SPARK-32829: - Description: Caused by: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions

[jira] [Commented] (SPARK-17477) SparkSQL cannot handle schema evolution from Int -> Long when parquet files have Int as its type while hive metastore has Long as its type

[ https://issues.apache.org/jira/browse/SPARK-17477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192763#comment-17192763 ] Manjay Kumar commented on SPARK-17477: -- i tried both the options , but did not work

[jira] [Assigned] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32830: Assignee: Apache Spark > Optimize Skewed BroadcastNestedLoopJoin with AE > --

[jira] [Assigned] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32830: Assignee: (was: Apache Spark) > Optimize Skewed BroadcastNestedLoopJoin with AE > ---

[jira] [Assigned] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32830: Assignee: (was: Apache Spark) > Optimize Skewed BroadcastNestedLoopJoin with AE > ---

[jira] [Commented] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192758#comment-17192758 ] Apache Spark commented on SPARK-32830: -- User 'AngersZh' has created a pull requ

[jira] [Updated] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32830: -- Description: For BroadcastNestedLoopJoin, we will broadcast boradcast-side child to all executor and

[jira] [Created] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

angerszhu created SPARK-32830: - Summary: Optimize Skewed BroadcastNestedLoopJoin with AE Key: SPARK-32830 URL: https://issues.apache.org/jira/browse/SPARK-32830 Project: Spark Issue Type: Sub-tas

[jira] [Comment Edited] (SPARK-32635) When pyspark.sql.functions.lit() function is used with dataframe cache, it returns wrong result

[ https://issues.apache.org/jira/browse/SPARK-32635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192740#comment-17192740 ] Peter Toth edited comment on SPARK-32635 at 9/9/20, 9:36 AM: -

  1   2   >