[jira] [Comment Edited] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

[ https://issues.apache.org/jira/browse/SPARK-32289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156472#comment-17156472 ] Yuming Wang edited comment on SPARK-32289 at 7/13/20, 4:01 AM: --- It seem we

[jira] [Commented] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

[ https://issues.apache.org/jira/browse/SPARK-32289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156472#comment-17156472 ] Yuming Wang commented on SPARK-32289: - It seem we need to write UTF-8 BOM with supercsv:

[jira] [Updated] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

[ https://issues.apache.org/jira/browse/SPARK-32289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32289: Description: How to reproduce this issue: {code:scala} spark.sql("SELECT '我爱中文' AS

[jira] [Updated] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

[ https://issues.apache.org/jira/browse/SPARK-32289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32289: Attachment: garbled.png > Chinese characters are garbled when opening csv files with Excel >

[jira] [Created] (SPARK-32289) Chinese characters are garbled when opening csv files with Excel

Yuming Wang created SPARK-32289: --- Summary: Chinese characters are garbled when opening csv files with Excel Key: SPARK-32289 URL: https://issues.apache.org/jira/browse/SPARK-32289 Project: Spark

[jira] [Commented] (SPARK-32205) Writing timestamp in mysql gets fails

[ https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156461#comment-17156461 ] Nilesh Patil commented on SPARK-32205: -- [~apachespark] [~JinxinTang]  Thanks for your efforts. When

[jira] [Assigned] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32250: Assignee: Apache Spark > Reenable MasterSuite's "Master should avoid dead loop while

[jira] [Commented] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156459#comment-17156459 ] Apache Spark commented on SPARK-32250: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32250) Reenable MasterSuite's "Master should avoid dead loop while launching executor failed in Worker"

[ https://issues.apache.org/jira/browse/SPARK-32250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32250: Assignee: (was: Apache Spark) > Reenable MasterSuite's "Master should avoid dead

[jira] [Assigned] (SPARK-32288) [UI] Add exception summary table in stage page

[ https://issues.apache.org/jira/browse/SPARK-32288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32288: Assignee: (was: Apache Spark) > [UI] Add exception summary table in stage page >

[jira] [Commented] (SPARK-32288) [UI] Add exception summary table in stage page

[ https://issues.apache.org/jira/browse/SPARK-32288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156446#comment-17156446 ] Apache Spark commented on SPARK-32288: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-32288) [UI] Add exception summary table in stage page

[ https://issues.apache.org/jira/browse/SPARK-32288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32288: Assignee: Apache Spark > [UI] Add exception summary table in stage page >

[jira] [Created] (SPARK-32288) [UI] Add exception summary table in stage page

Zhongwei Zhu created SPARK-32288: Summary: [UI] Add exception summary table in stage page Key: SPARK-32288 URL: https://issues.apache.org/jira/browse/SPARK-32288 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32287) Flaky test: ExecutorAllocationManagerSuite.add executors default profile

[ https://issues.apache.org/jira/browse/SPARK-32287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32287: - Component/s: Tests > Flaky test: ExecutorAllocationManagerSuite.add executors default profile >

[jira] [Commented] (SPARK-32287) Flaky test: ExecutorAllocationManagerSuite.add executors default profile

[ https://issues.apache.org/jira/browse/SPARK-32287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156441#comment-17156441 ] wuyi commented on SPARK-32287: -- cc [~tgraves] [~hyukjin.kwon] > Flaky test:

[jira] [Updated] (SPARK-32287) Flaky test: ExecutorAllocationManagerSuite.add executors default profile

[ https://issues.apache.org/jira/browse/SPARK-32287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32287: - Description: This test becomes flaky in Github Actions, see:

[jira] [Updated] (SPARK-32287) Flaky test: ExecutorAllocationManagerSuite.add executors default profile

[ https://issues.apache.org/jira/browse/SPARK-32287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-32287: - Description: This test becomes flaky in Github Actions, see:

[jira] [Created] (SPARK-32287) Flaky test: ExecutorAllocationManagerSuite.add executors default profile

wuyi created SPARK-32287: Summary: Flaky test: ExecutorAllocationManagerSuite.add executors default profile Key: SPARK-32287 URL: https://issues.apache.org/jira/browse/SPARK-32287 Project: Spark

[jira] [Updated] (SPARK-32252) Enable doctests in run-tests.py back

[ https://issues.apache.org/jira/browse/SPARK-32252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32252: - Description: In run-tests.py script, we're skipping the tests when {{TEST_ONLY_MODULES}} is

[jira] [Commented] (SPARK-29765) Monitoring UI throws IndexOutOfBoundsException when accessing metrics of attempt in stage

[ https://issues.apache.org/jira/browse/SPARK-29765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156429#comment-17156429 ] Jacob Niebloom commented on SPARK-29765: What was the resolution to this? Thanks! [~shahid]

[jira] [Commented] (SPARK-32271) Update CrossValidator to parallelize fit method across folds

[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156417#comment-17156417 ] Apache Spark commented on SPARK-32271: -- User 'adjordan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32271) Update CrossValidator to parallelize fit method across folds

[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32271: Assignee: Apache Spark > Update CrossValidator to parallelize fit method across folds >

[jira] [Assigned] (SPARK-32271) Update CrossValidator to parallelize fit method across folds

[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32271: Assignee: (was: Apache Spark) > Update CrossValidator to parallelize fit method

[jira] [Commented] (SPARK-32271) Update CrossValidator to parallelize fit method across folds

[ https://issues.apache.org/jira/browse/SPARK-32271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156415#comment-17156415 ] Apache Spark commented on SPARK-32271: -- User 'adjordan' has created a pull request for this issue:

[jira] [Commented] (SPARK-32226) JDBC TimeStamp predicates always append `.0`

[ https://issues.apache.org/jira/browse/SPARK-32226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156413#comment-17156413 ] Mathew Wicks commented on SPARK-32226: -- [~Chen Zhang], thanks for the idea! However, while

[jira] [Assigned] (SPARK-32286) Coalesce bucketed tables for shuffled hash join if applicable

[ https://issues.apache.org/jira/browse/SPARK-32286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32286: Assignee: (was: Apache Spark) > Coalesce bucketed tables for shuffled hash join if

[jira] [Assigned] (SPARK-32286) Coalesce bucketed tables for shuffled hash join if applicable

[ https://issues.apache.org/jira/browse/SPARK-32286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32286: Assignee: Apache Spark > Coalesce bucketed tables for shuffled hash join if applicable >

[jira] [Commented] (SPARK-32286) Coalesce bucketed tables for shuffled hash join if applicable

[ https://issues.apache.org/jira/browse/SPARK-32286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156409#comment-17156409 ] Apache Spark commented on SPARK-32286: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-32286) Coalesce bucketed tables for shuffled hash join if applicable

Cheng Su created SPARK-32286: Summary: Coalesce bucketed tables for shuffled hash join if applicable Key: SPARK-32286 URL: https://issues.apache.org/jira/browse/SPARK-32286 Project: Spark Issue

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156405#comment-17156405 ] Apache Spark commented on SPARK-29292: -- User 'srowen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32258) NormalizeFloatingNumbers can directly normalize on certain children expressions

[ https://issues.apache.org/jira/browse/SPARK-32258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32258. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29061

[jira] [Updated] (SPARK-32258) NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

[ https://issues.apache.org/jira/browse/SPARK-32258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32258: -- Summary: NormalizeFloatingNumbers directly normalizes IF/CaseWhen/Coalesce child expressions

[jira] [Updated] (SPARK-21187) Complete support for remaining Spark data types in Arrow Converters

[ https://issues.apache.org/jira/browse/SPARK-21187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-21187: - Description: This is to track adding the remaining type support in Arrow Converters.

[jira] [Created] (SPARK-32285) Add PySpark support for nested timestamps with arrow

Bryan Cutler created SPARK-32285: Summary: Add PySpark support for nested timestamps with arrow Key: SPARK-32285 URL: https://issues.apache.org/jira/browse/SPARK-32285 Project: Spark Issue

[jira] [Commented] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause

[ https://issues.apache.org/jira/browse/SPARK-24163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156398#comment-17156398 ] Xiao Li commented on SPARK-24163: - [~Qin Yao]  [~dkbiswal] Are you interested in this?   cc

[jira] [Updated] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause

[ https://issues.apache.org/jira/browse/SPARK-24163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24163: Labels: (was: bulk-closed) > Support "ANY" or sub-query for Pivot "IN" clause >

[jira] [Reopened] (SPARK-24163) Support "ANY" or sub-query for Pivot "IN" clause

[ https://issues.apache.org/jira/browse/SPARK-24163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-24163: - > Support "ANY" or sub-query for Pivot "IN" clause > > >

[jira] [Commented] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156378#comment-17156378 ] Apache Spark commented on SPARK-31985: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31985: Assignee: (was: Apache Spark) > Remove the incomplete code path on aggregation for

[jira] [Assigned] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31985: Assignee: Apache Spark > Remove the incomplete code path on aggregation for continuous

[jira] [Commented] (SPARK-31985) Remove the incomplete code path on aggregation for continuous mode

[ https://issues.apache.org/jira/browse/SPARK-31985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156377#comment-17156377 ] Apache Spark commented on SPARK-31985: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

[ https://issues.apache.org/jira/browse/SPARK-31831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-31831: Assignee: Frank Yin (was: Jungtaek Lim) > Flaky test:

[jira] [Updated] (SPARK-32284) Avoid expanding too many CNF predicates in partition pruning

[ https://issues.apache.org/jira/browse/SPARK-32284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-32284: --- Summary: Avoid expanding too many CNF predicates in partition pruning (was: Avoid pushing

[jira] [Resolved] (SPARK-32270) Use text file sources in CSV's schema inference even in different encoding

[ https://issues.apache.org/jira/browse/SPARK-32270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32270. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29063

[jira] [Assigned] (SPARK-32270) Use text file sources in CSV's schema inference even in different encoding

[ https://issues.apache.org/jira/browse/SPARK-32270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32270: - Assignee: Hyukjin Kwon > Use text file sources in CSV's schema inference even in

[jira] [Commented] (SPARK-32245) Implement the base to run Spark tests in GitHun Actions

[ https://issues.apache.org/jira/browse/SPARK-32245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156335#comment-17156335 ] Apache Spark commented on SPARK-32245: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-32245) Implement the base to run Spark tests in GitHun Actions

[ https://issues.apache.org/jira/browse/SPARK-32245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156334#comment-17156334 ] Apache Spark commented on SPARK-32245: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-32283) Multiple Kryo registrators can't be used anymore

[ https://issues.apache.org/jira/browse/SPARK-32283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lorenz Bühmann updated SPARK-32283: --- Priority: Minor (was: Major) > Multiple Kryo registrators can't be used anymore >

[jira] [Assigned] (SPARK-32284) Avoid pushing down too many CNF filters for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-32284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32284: Assignee: Apache Spark (was: Gengliang Wang) > Avoid pushing down too many CNF filters

[jira] [Assigned] (SPARK-32284) Avoid pushing down too many CNF filters for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-32284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32284: Assignee: Gengliang Wang (was: Apache Spark) > Avoid pushing down too many CNF filters

[jira] [Commented] (SPARK-32284) Avoid pushing down too many CNF filters for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-32284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156313#comment-17156313 ] Apache Spark commented on SPARK-32284: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-32284) Avoid pushing down too many CNF filters for partition pruning

Gengliang Wang created SPARK-32284: -- Summary: Avoid pushing down too many CNF filters for partition pruning Key: SPARK-32284 URL: https://issues.apache.org/jira/browse/SPARK-32284 Project: Spark

[jira] [Created] (SPARK-32283) Multiple Kryo registrators can't be used anymore

Lorenz Bühmann created SPARK-32283: -- Summary: Multiple Kryo registrators can't be used anymore Key: SPARK-32283 URL: https://issues.apache.org/jira/browse/SPARK-32283 Project: Spark Issue

[jira] [Commented] (SPARK-32226) JDBC TimeStamp predicates always append `.0`

[ https://issues.apache.org/jira/browse/SPARK-32226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156287#comment-17156287 ] Chen Zhang commented on SPARK-32226: Hello [~thesuperzapper], The dialect of Informix database is

[jira] [Updated] (SPARK-32268) Bloom Filter Join

[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32268: Description: We can improve the performance of some joins by pre-filtering one side of a join

[jira] [Updated] (SPARK-32268) Bloom Filter Join

[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32268: Description: We can improve the performance of some joins by pre-filtering one side of a join