[jira] [Resolved] (SPARK-29575) from_json can produce nulls for fields which are marked as non-nullable

[ https://issues.apache.org/jira/browse/SPARK-29575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29575. -- Resolution: Not A Problem > from_json can produce nulls for fields which are marked as

[jira] [Created] (SPARK-29956) A literal number with an exponent should be converted into Double

wuyi created SPARK-29956: Summary: A literal number with an exponent should be converted into Double Key: SPARK-29956 URL: https://issues.apache.org/jira/browse/SPARK-29956 Project: Spark Issue

[jira] [Resolved] (SPARK-29948) make the default alias consistent between date, timestamp and interval

[ https://issues.apache.org/jira/browse/SPARK-29948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29948. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26579

[jira] [Assigned] (SPARK-29869) HiveMetastoreCatalog#convertToLogicalRelation throws AssertionError

[ https://issues.apache.org/jira/browse/SPARK-29869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29869: --- Assignee: Lantao Jin > HiveMetastoreCatalog#convertToLogicalRelation throws AssertionError

[jira] [Resolved] (SPARK-29869) HiveMetastoreCatalog#convertToLogicalRelation throws AssertionError

[ https://issues.apache.org/jira/browse/SPARK-29869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29869. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26499

[jira] [Commented] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977183#comment-16977183 ] Terry Kim commented on SPARK-29890: --- I also noticed that `drop()` also behaves the same. I will work

[jira] [Comment Edited] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977183#comment-16977183 ] Terry Kim edited comment on SPARK-29890 at 11/19/19 7:10 AM: - I also noticed

[jira] [Commented] (SPARK-27558) NPE in TaskCompletionListener due to Spark OOM in UnsafeExternalSorter causing tasks to hang

[ https://issues.apache.org/jira/browse/SPARK-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977154#comment-16977154 ] Xingbo Jiang commented on SPARK-27558: -- Trying to clarify the behavior: did the task failed, or did

[jira] [Resolved] (SPARK-27558) NPE in TaskCompletionListener due to Spark OOM in UnsafeExternalSorter causing tasks to hang

[ https://issues.apache.org/jira/browse/SPARK-27558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingbo Jiang resolved SPARK-27558. -- Assignee: Artsiom Yudovin Resolution: Fixed Resolved by

[jira] [Commented] (SPARK-29955) Can't cast String MapType to MapType

[ https://issues.apache.org/jira/browse/SPARK-29955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977135#comment-16977135 ] Ramanand Jaiswal commented on SPARK-29955: -- cc: [~sowen]  

[jira] [Created] (SPARK-29955) Can't cast String MapType to MapType

Ramanand Jaiswal created SPARK-29955: Summary: Can't cast String MapType to MapType Key: SPARK-29955 URL: https://issues.apache.org/jira/browse/SPARK-29955 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29111) Support snapshot/restore of KVStore

[ https://issues.apache.org/jira/browse/SPARK-29111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29111: - Parent: SPARK-28870 Issue Type: Sub-task (was: New Feature) > Support snapshot/restore

[jira] [Updated] (SPARK-29111) Support snapshot/restore of KVStore

[ https://issues.apache.org/jira/browse/SPARK-29111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29111: - Parent: (was: SPARK-28594) Issue Type: New Feature (was: Sub-task) > Support

[jira] [Updated] (SPARK-29261) Support recover live entities from KVStore for (SQL)AppStatusListener

[ https://issues.apache.org/jira/browse/SPARK-29261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29261: - Parent: SPARK-28870 Issue Type: Sub-task (was: New Feature) > Support recover live

[jira] [Updated] (SPARK-29261) Support recover live entities from KVStore for (SQL)AppStatusListener

[ https://issues.apache.org/jira/browse/SPARK-29261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-29261: - Parent: (was: SPARK-28594) Issue Type: New Feature (was: Sub-task) > Support

[jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading

[ https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28870: - Description: This issue tracks the effort on snapshotting the current status of

[jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading

[ https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28870: - Description: This issue tracks the effort on snapshotting the current status of

[jira] [Commented] (SPARK-28870) Snapshot event log files to support incremental reading

[ https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977128#comment-16977128 ] Jungtaek Lim commented on SPARK-28870: -- Given we have SPARK-29779, this issue is orthogonal to

[jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading

[ https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28870: - Parent: (was: SPARK-28594) Issue Type: New Feature (was: Sub-task) > Snapshot

[jira] [Resolved] (SPARK-29579) Guarantee compatibility of snapshot (live entities, KVstore entities)

[ https://issues.apache.org/jira/browse/SPARK-29579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-29579. -- Resolution: Invalid SPARK-29779 invalidates the needs of this. Closing. > Guarantee

[jira] [Issue Comment Deleted] (SPARK-29947) Improve ResolveRelations and ResolveTables performance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Comment: was deleted (was: I'm working on.) > Improve ResolveRelations and ResolveTables

[jira] [Created] (SPARK-29954) collect the runtime statistics of row count in map stage

Ke Jia created SPARK-29954: -- Summary: collect the runtime statistics of row count in map stage Key: SPARK-29954 URL: https://issues.apache.org/jira/browse/SPARK-29954 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-29728) ALTER TABLE (RENAME TABLE) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29728: --- Assignee: Terry Kim > ALTER TABLE (RENAME TABLE) should look up catalog/table like v2

[jira] [Resolved] (SPARK-29728) ALTER TABLE (RENAME TABLE) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29728. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26539

[jira] [Commented] (SPARK-29953) File stream source cleanup options may break a file sink output

[ https://issues.apache.org/jira/browse/SPARK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977111#comment-16977111 ] Jungtaek Lim commented on SPARK-29953: -- [~zsxwing] Just raised the PR

[jira] [Commented] (SPARK-28531) Improve Extract Python UDFs optimizer rule to enforce idempotence

[ https://issues.apache.org/jira/browse/SPARK-28531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977109#comment-16977109 ] Manu Zhang commented on SPARK-28531: [~manifoldQAQ], I saw the PR was closed. What's the status of

[jira] [Issue Comment Deleted] (SPARK-29644) Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29644: -- Comment: was deleted (was: Issue resolved by pull request 26301

[jira] [Updated] (SPARK-29644) Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29644: -- Fix Version/s: (was: 3.0.0) > Corrected ShortType and ByteType mapping to SmallInt and

[jira] [Reopened] (SPARK-29644) Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-29644: --- Assignee: (was: Shiv Prashant Sood) > Corrected ShortType and ByteType mapping to

[jira] [Updated] (SPARK-29947) Improve ResolveRelations and ResolveTables performance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Summary: Improve ResolveRelations and ResolveTables performance (was: Improve ResolveRelations

[jira] [Commented] (SPARK-29946) Special serialization for certain key types of Map type in JacksonGenerator

[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977063#comment-16977063 ] YoungGyu Chun commented on SPARK-29946: --- Thanks for the quick respose. I will look into this :) >

[jira] [Resolved] (SPARK-29944) Spark testing on ARM

[ https://issues.apache.org/jira/browse/SPARK-29944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo resolved SPARK-29944. - Resolution: Invalid > Spark testing on ARM > > > Key: SPARK-29944

[jira] [Closed] (SPARK-29944) Spark testing on ARM

[ https://issues.apache.org/jira/browse/SPARK-29944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo closed SPARK-29944. --- duplicated Jira ISSUE > Spark testing on ARM > > > Key: SPARK-29944 >

[jira] [Commented] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977044#comment-16977044 ] zhao bo commented on SPARK-28467: - https://github.com/apache/spark/pull/25864 > Flaky test:

[jira] [Commented] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977020#comment-16977020 ] Terry Kim commented on SPARK-29890: --- Got it. Thanks. > Unable to fill na with 0 with duplicate

[jira] [Commented] (SPARK-29953) File stream source cleanup options may break a file sink output

[ https://issues.apache.org/jira/browse/SPARK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977019#comment-16977019 ] Jungtaek Lim commented on SPARK-29953: -- Thanks for pinging me, [~zsxwing]. Totally makes sense.

[jira] [Resolved] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29777. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26429

[jira] [Assigned] (SPARK-29777) SparkR::cleanClosure aggressively removes a function required by user function

[ https://issues.apache.org/jira/browse/SPARK-29777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29777: Assignee: Hossein Falaki > SparkR::cleanClosure aggressively removes a function required

[jira] [Updated] (SPARK-29953) File stream source cleanup options may break a file sink output

[ https://issues.apache.org/jira/browse/SPARK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-29953: - Description: SPARK-20568 added options to file streaming source to clean up processed files.

[jira] [Commented] (SPARK-29953) File stream source cleanup options may break a file sink output

[ https://issues.apache.org/jira/browse/SPARK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976971#comment-16976971 ] Shixiong Zhu commented on SPARK-29953: -- cc [~kabhwan] > File stream source cleanup options may

[jira] [Created] (SPARK-29953) File stream source cleanup options may break a file sink output

Shixiong Zhu created SPARK-29953: Summary: File stream source cleanup options may break a file sink output Key: SPARK-29953 URL: https://issues.apache.org/jira/browse/SPARK-29953 Project: Spark

[jira] [Commented] (SPARK-29946) Special serialization for certain key types of Map type in JacksonGenerator

[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976960#comment-16976960 ] L. C. Hsieh commented on SPARK-29946: - Ur, this is for Map type data serialization in

[jira] [Created] (SPARK-29952) Pandas UDFs do not support vectors as input

koba created SPARK-29952: Summary: Pandas UDFs do not support vectors as input Key: SPARK-29952 URL: https://issues.apache.org/jira/browse/SPARK-29952 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29946) Special serialization for certain key types of Map type in JacksonGenerator

[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976921#comment-16976921 ] YoungGyu Chun commented on SPARK-29946: --- Hi [~viirya]   I am trying to sort out this issue. What

[jira] [Comment Edited] (SPARK-29946) Special serialization for certain key types of Map type in JacksonGenerator

[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976921#comment-16976921 ] YoungGyu Chun edited comment on SPARK-29946 at 11/18/19 9:56 PM: - Hi

[jira] [Updated] (SPARK-29946) Special serialization for certain key types of Map type in JacksonGenerator

[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YoungGyu Chun updated SPARK-29946: -- Attachment: image-2019-11-18-16-54-46-341.png > Special serialization for certain key types

[jira] [Created] (SPARK-29951) Make the behavior of Postgre dialect independent of ansi mode config

Yuanjian Li created SPARK-29951: --- Summary: Make the behavior of Postgre dialect independent of ansi mode config Key: SPARK-29951 URL: https://issues.apache.org/jira/browse/SPARK-29951 Project: Spark

[jira] [Created] (SPARK-29950) Deleted excess executors can connect back to driver in K8S with dyn alloc on

Marcelo Masiero Vanzin created SPARK-29950: -- Summary: Deleted excess executors can connect back to driver in K8S with dyn alloc on Key: SPARK-29950 URL: https://issues.apache.org/jira/browse/SPARK-29950

[jira] [Created] (SPARK-29949) JSON/CSV formats timestamps incorrectly

Maxim Gekk created SPARK-29949: -- Summary: JSON/CSV formats timestamps incorrectly Key: SPARK-29949 URL: https://issues.apache.org/jira/browse/SPARK-29949 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-29644) Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29644: -- Fix Version/s: (was: 2.4.5) > Corrected ShortType and ByteType mapping to SmallInt and

[jira] [Commented] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976642#comment-16976642 ] rameshkrishnan muthusamy commented on SPARK-27194: -- [~ajithshetty] is this being worked

[jira] [Assigned] (SPARK-29941) Support dec as shorthand for decimal

[ https://issues.apache.org/jira/browse/SPARK-29941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29941: --- Assignee: Kent Yao > Support dec as shorthand for decimal >

[jira] [Resolved] (SPARK-29941) Support dec as shorthand for decimal

[ https://issues.apache.org/jira/browse/SPARK-29941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29941. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26574

[jira] [Updated] (SPARK-29947) Improve ResolveRelations and ResolveTables perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Summary: Improve ResolveRelations and ResolveTables perrformance (was: Improve ResolveRelations

[jira] [Commented] (SPARK-29947) Improve ResolveRelations perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976520#comment-16976520 ] Yuming Wang commented on SPARK-29947: - I'm working on. > Improve ResolveRelations perrformance >

[jira] [Updated] (SPARK-29947) Improve ResolveRelations perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Description: For SQL in SPARK-29606. The physical plan in: {noformat} == Physical Plan == *(12)

[jira] [Created] (SPARK-29948) make the default alias consistent between date, timestamp and interval

Wenchen Fan created SPARK-29948: --- Summary: make the default alias consistent between date, timestamp and interval Key: SPARK-29948 URL: https://issues.apache.org/jira/browse/SPARK-29948 Project: Spark

[jira] [Updated] (SPARK-29947) Improve ResolveRelations perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Description: For SQL in SPARK-29606. The physical plan in: {noformat} == Physical Plan == *(12)

[jira] [Updated] (SPARK-29947) Improve ResolveRelations perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Description: For SQL in SPARK-29606. The physical plan in: {noformat} == Physical Plan == *(12)

[jira] [Resolved] (SPARK-29859) ALTER DATABASE (SET LOCATION) should look up catalog like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29859. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26562

[jira] [Assigned] (SPARK-29859) ALTER DATABASE (SET LOCATION) should look up catalog like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29859: --- Assignee: Hu Fuwang > ALTER DATABASE (SET LOCATION) should look up catalog like v2

[jira] [Updated] (SPARK-29947) Improve ResolveRelations perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Description: For SQL in SPARK-29606. The py > Improve ResolveRelations perrformance >

[jira] [Updated] (SPARK-29947) Improve ResolveRelations perrformance

[ https://issues.apache.org/jira/browse/SPARK-29947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-29947: Summary: Improve ResolveRelations perrformance (was: Implement ResolveRelations perrformance) >

[jira] [Created] (SPARK-29947) Implement ResolveRelations perrformance

Yuming Wang created SPARK-29947: --- Summary: Implement ResolveRelations perrformance Key: SPARK-29947 URL: https://issues.apache.org/jira/browse/SPARK-29947 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29946) Special serialization for certain key types of Map type in JacksonGenerator

L. C. Hsieh created SPARK-29946: --- Summary: Special serialization for certain key types of Map type in JacksonGenerator Key: SPARK-29946 URL: https://issues.apache.org/jira/browse/SPARK-29946 Project:

[jira] [Updated] (SPARK-29569) doc build fails with `/api/scala/lib/jquery.js` doesn't exist

[ https://issues.apache.org/jira/browse/SPARK-29569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-29569: Component/s: (was: docs) Documentation > doc build fails with

[jira] [Created] (SPARK-29945) do not handle negative sign specially in the parser

Wenchen Fan created SPARK-29945: --- Summary: do not handle negative sign specially in the parser Key: SPARK-29945 URL: https://issues.apache.org/jira/browse/SPARK-29945 Project: Spark Issue

[jira] [Updated] (SPARK-29944) Spark testing on ARM

[ https://issues.apache.org/jira/browse/SPARK-29944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhao bo updated SPARK-29944: Description: We plan to make spark testing on ARM, via ARM resources and human resources contribute in

[jira] [Commented] (SPARK-28467) Flaky test: org.apache.spark.SparkContextSuite.test driver discovery under local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-28467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976482#comment-16976482 ] zhao bo commented on SPARK-28467: - https://github.com/apache/spark/pull/25864 > Flaky test:

[jira] [Commented] (SPARK-29286) UnicodeDecodeError raised when running python tests on arm instance

[ https://issues.apache.org/jira/browse/SPARK-29286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976483#comment-16976483 ] zhao bo commented on SPARK-29286: - https://github.com/apache/spark/pull/26021 > UnicodeDecodeError

[jira] [Commented] (SPARK-28433) Incorrect assertion in scala test for aarch64 platform

[ https://issues.apache.org/jira/browse/SPARK-28433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976481#comment-16976481 ] zhao bo commented on SPARK-28433: - https://github.com/apache/spark/pull/25186 > Incorrect assertion in

[jira] [Commented] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976480#comment-16976480 ] zhao bo commented on SPARK-28519: - https://github.com/apache/spark/pull/25279 > Tests failed on aarch64

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976478#comment-16976478 ] zhao bo commented on SPARK-28770: - https://github.com/apache/spark/pull/25673 > Flaky Tests: Test

[jira] [Created] (SPARK-29944) Spark testing on ARM

zhao bo created SPARK-29944: --- Summary: Spark testing on ARM Key: SPARK-29944 URL: https://issues.apache.org/jira/browse/SPARK-29944 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-29943) Improve error messages for unsupported data type

dzcxzl created SPARK-29943: -- Summary: Improve error messages for unsupported data type Key: SPARK-29943 URL: https://issues.apache.org/jira/browse/SPARK-29943 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-29927) Parse timestamps in microsecond precision by `to_timestamp`, `to_unix_timestamp`, `unix_timestamp`

[ https://issues.apache.org/jira/browse/SPARK-29927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976449#comment-16976449 ] Wenchen Fan commented on SPARK-29927: - SGTM > Parse timestamps in microsecond precision by

[jira] [Commented] (SPARK-29890) Unable to fill na with 0 with duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976448#comment-16976448 ] Wenchen Fan commented on SPARK-29890: - When we do `.fill(0, Seq("abc"))`, I think we should report

[jira] [Created] (SPARK-29942) Impl Complement Naive Bayes Classifier

zhengruifeng created SPARK-29942: Summary: Impl Complement Naive Bayes Classifier Key: SPARK-29942 URL: https://issues.apache.org/jira/browse/SPARK-29942 Project: Spark Issue Type:

[jira] [Commented] (SPARK-29941) Support dec as shorthand for decimal

[ https://issues.apache.org/jira/browse/SPARK-29941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976411#comment-16976411 ] Kent Yao commented on SPARK-29941: -- working on this > Support dec as shorthand for decimal >

[jira] [Created] (SPARK-29941) Support dec as shorthand for decimal

Kent Yao created SPARK-29941: Summary: Support dec as shorthand for decimal Key: SPARK-29941 URL: https://issues.apache.org/jira/browse/SPARK-29941 Project: Spark Issue Type: Sub-task