[jira] [Updated] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-26634: - Affects Version/s: (was: 2.4.0) > OutputCommitCoordinator may allow task of FetchFailureStag

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16421530#comment-16421530 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:56 AM: -

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432207#comment-16432207 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:56 AM: -

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:54 AM: -

[jira] [Updated] (SPARK-26641) Seperate capacity Configurations of different event queue.

[ https://issues.apache.org/jira/browse/SPARK-26641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26641: --- Description: I always maintance a spark on yarn cluster on line.I always found the error: `Dropping

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432207#comment-16432207 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:55 AM: -

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:51 AM: -

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:50 AM: -

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:49 AM: -

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744524#comment-16744524 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:47 AM: -

[jira] [Assigned] (SPARK-26641) Seperate capacity Configurations of different event queue.

[ https://issues.apache.org/jira/browse/SPARK-26641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26641: Assignee: Apache Spark > Seperate capacity Configurations of different event queue. > ---

[jira] [Assigned] (SPARK-26641) Seperate capacity Configurations of different event queue.

[ https://issues.apache.org/jira/browse/SPARK-26641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26641: Assignee: (was: Apache Spark) > Seperate capacity Configurations of different event q

[jira] [Created] (SPARK-26641) Seperate capacity Configurations of different event queue.

jiaan.geng created SPARK-26641: -- Summary: Seperate capacity Configurations of different event queue. Key: SPARK-26641 URL: https://issues.apache.org/jira/browse/SPARK-26641 Project: Spark Issue

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744675#comment-16744675 ] Kingsley Jones commented on SPARK-12216: Okay, so I think we have a candidate fo

[jira] [Assigned] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit categories.

[ https://issues.apache.org/jira/browse/SPARK-26466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26466: - Assignee: Jungtaek Lim > Use ConfigEntry for hardcoded configs for submit categories. > ---

[jira] [Resolved] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit categories.

[ https://issues.apache.org/jira/browse/SPARK-26466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26466. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23532 [https://github.c

[jira] [Assigned] (SPARK-26600) Update spark-submit usage message

[ https://issues.apache.org/jira/browse/SPARK-26600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26600: - Assignee: Luca Canali > Update spark-submit usage message > - >

[jira] [Resolved] (SPARK-26600) Update spark-submit usage message

[ https://issues.apache.org/jira/browse/SPARK-26600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26600. --- Resolution: Fixed Issue resolved by pull request 23518 [https://github.com/apache/spark/pull/23518]

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744620#comment-16744620 ] Ke Jia commented on SPARK-26639: [~hyukjin.kwon] Thanks for your interesting.  As discu

[jira] [Assigned] (SPARK-26640) Code cleanup from lgtm.com analysis

[ https://issues.apache.org/jira/browse/SPARK-26640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26640: Assignee: Apache Spark (was: Sean Owen) > Code cleanup from lgtm.com analysis >

[jira] [Assigned] (SPARK-26640) Code cleanup from lgtm.com analysis

[ https://issues.apache.org/jira/browse/SPARK-26640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26640: Assignee: Sean Owen (was: Apache Spark) > Code cleanup from lgtm.com analysis >

[jira] [Resolved] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26636. -- Resolution: Invalid > How to know that a partition is ready when using Structured Streaming >

[jira] [Created] (SPARK-26640) Code cleanup from lgtm.com analysis

Sean Owen created SPARK-26640: - Summary: Code cleanup from lgtm.com analysis Key: SPARK-26640 URL: https://issues.apache.org/jira/browse/SPARK-26640 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744614#comment-16744614 ] Hyukjin Kwon commented on SPARK-26636: -- For questions. should better go to mailing

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744613#comment-16744613 ] Hyukjin Kwon commented on SPARK-26639: -- What's the input/output, and expected input

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744606#comment-16744606 ] Ke Jia commented on SPARK-26639: [@davies|https://github.com/davies] [@hvanhovell|https:

[jira] [Updated] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26639: --- Description: The subquery reuse feature has done in  [https://github.com/apache/spark/pull/14548] In my tes

[jira] [Updated] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26639: --- Description: The subquery reuse feature has done in  [PR#14548|[https://github.com/apache/spark/pull/14548]]

[jira] [Updated] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26639: --- Description: The subquery reuse feature has done in  [14548|[https://github.com/apache/spark/pull/14548]|htt

[jira] [Created] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

Ke Jia created SPARK-26639: -- Summary: The reuse subquery function maybe does not work in SPARK SQL Key: SPARK-26639 URL: https://issues.apache.org/jira/browse/SPARK-26639 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-26633) Add ExecutorClassLoader.getResourceAsStream

[ https://issues.apache.org/jira/browse/SPARK-26633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26633. - Resolution: Fixed Assignee: Kris Mok Fix Version/s: 3.0.0 2.4.1 > Add

[jira] [Assigned] (SPARK-26638) Pyspark vector classes always return error for unary negation

[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26638: Assignee: Apache Spark (was: Sean Owen) > Pyspark vector classes always return error for

[jira] [Assigned] (SPARK-26638) Pyspark vector classes always return error for unary negation

[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26638: Assignee: Sean Owen (was: Apache Spark) > Pyspark vector classes always return error for

[jira] [Created] (SPARK-26638) Pyspark vector classes always return error for unary negation

Sean Owen created SPARK-26638: - Summary: Pyspark vector classes always return error for unary negation Key: SPARK-26638 URL: https://issues.apache.org/jira/browse/SPARK-26638 Project: Spark Issu

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744524#comment-16744524 ] Kingsley Jones commented on SPARK-12216: I am going down the Rabbit Hole of the

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Description: _This is just a placeholder for now to collect what needs to be fixed when we upgr

[jira] [Resolved] (SPARK-26625) spark.redaction.regex should include oauthToken

[ https://issues.apache.org/jira/browse/SPARK-26625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-26625. Resolution: Fixed Fix Version/s: 3.0.0 > spark.redaction.regex should include oauthToken >

[jira] [Assigned] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-26619: --- Assignee: Liang-Chi Hsieh > Prune the unused serializers from `SerializeFromObject` > -

[jira] [Resolved] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-26619. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23562 [https://github.com/a

[jira] [Resolved] (SPARK-26550) New datasource for benchmarking

[ https://issues.apache.org/jira/browse/SPARK-26550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26550. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > New da

[jira] [Updated] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26629: - Fix Version/s: (was: 2.3.4) > Error with multiple file stream in a query + restart on a batc

[jira] [Updated] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26629: - Fix Version/s: 3.0.0 2.4.1 2.3.4 > Error with multiple fil

[jira] [Resolved] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-26629. -- Resolution: Fixed > Error with multiple file stream in a query + restart on a batch that has n

[jira] [Commented] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744288#comment-16744288 ] Bryan Cutler commented on SPARK-26591: -- [~elch10] please go ahead and make a Jira f

[jira] [Updated] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26629: - Affects Version/s: 2.3.3 > Error with multiple file stream in a query + restart on a batch that

[jira] [Assigned] (SPARK-25713) Implement copy() for ColumnarArray

[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25713: Assignee: Apache Spark > Implement copy() for ColumnarArray > ---

[jira] [Commented] (SPARK-25713) Implement copy() for ColumnarArray

[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744259#comment-16744259 ] Apache Spark commented on SPARK-25713: -- User 'ayudovin' has created a pull request

[jira] [Commented] (SPARK-25713) Implement copy() for ColumnarArray

[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744257#comment-16744257 ] Apache Spark commented on SPARK-25713: -- User 'ayudovin' has created a pull request

[jira] [Assigned] (SPARK-25713) Implement copy() for ColumnarArray

[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25713: Assignee: (was: Apache Spark) > Implement copy() for ColumnarArray >

[jira] [Resolved] (SPARK-25992) Accumulators giving KeyError in pyspark

[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25992. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Fixed at https://github

[jira] [Resolved] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26615. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Issue resolved by pull reques

[jira] [Assigned] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26615: - Assignee: Attila Zsolt Piros > Fixing transport server/client resource leaks in the core unitte

[jira] [Resolved] (SPARK-26429) Add jdbc sink support for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Yanlin resolved SPARK-26429. - Resolution: Duplicate > Add jdbc sink support for Structured Streaming > ---

[jira] [Updated] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guo Wei updated SPARK-26636: Description: When using structured streaming, we use "partitionBy" api  to partition the output data, and

[jira] [Assigned] (SPARK-26637) Makes GetArrayItem nullability more precise

[ https://issues.apache.org/jira/browse/SPARK-26637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26637: Assignee: (was: Apache Spark) > Makes GetArrayItem nullability more precise > ---

[jira] [Updated] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guo Wei updated SPARK-26636: Summary: How to know that a partition is ready when using Structured Streaming (was: How to know a parti

[jira] [Assigned] (SPARK-26637) Makes GetArrayItem nullability more precise

[ https://issues.apache.org/jira/browse/SPARK-26637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26637: Assignee: Apache Spark > Makes GetArrayItem nullability more precise > --

[jira] [Created] (SPARK-26637) Makes GetArrayItem nullability more precise

Takeshi Yamamuro created SPARK-26637: Summary: Makes GetArrayItem nullability more precise Key: SPARK-26637 URL: https://issues.apache.org/jira/browse/SPARK-26637 Project: Spark Issue Typ

[jira] [Created] (SPARK-26636) How to know a partition is ready when using Structured Streaming

Guo Wei created SPARK-26636: --- Summary: How to know a partition is ready when using Structured Streaming Key: SPARK-26636 URL: https://issues.apache.org/jira/browse/SPARK-26636 Project: Spark Issu

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743838#comment-16743838 ] Kingsley Jones commented on SPARK-12216: I had another go at investigating this

[jira] [Commented] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743783#comment-16743783 ] Prashant Sharma commented on SPARK-26059: - One work around is to capture the JVM

[jira] [Updated] (SPARK-26616) Expose document frequency in IDFModel

[ https://issues.apache.org/jira/browse/SPARK-26616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jatin Puri updated SPARK-26616: --- Docs Text: Provide DocumentFrequency in IDF (was: Provide DocumentFrequency vector in IDF) > Expos

[jira] [Resolved] (SPARK-26635) illegal hardware instruction

[ https://issues.apache.org/jira/browse/SPARK-26635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin resolved SPARK-26635. Resolution: Fixed > illegal hardware instruction > > > Key: S

[jira] [Closed] (SPARK-26635) illegal hardware instruction

[ https://issues.apache.org/jira/browse/SPARK-26635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin closed SPARK-26635. -- > illegal hardware instruction > > > Key: SPARK-26635 >

[jira] [Created] (SPARK-26635) illegal hardware instruction

Elchin created SPARK-26635: -- Summary: illegal hardware instruction Key: SPARK-26635 URL: https://issues.apache.org/jira/browse/SPARK-26635 Project: Spark Issue Type: Bug Components: PySpar

[jira] [Closed] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin closed SPARK-26591. -- > Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain > environment > --

[jira] [Resolved] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin resolved SPARK-26591. Resolution: Feedback Received > Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain

[jira] [Commented] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743761#comment-16743761 ] Hyukjin Kwon commented on SPARK-26591: -- Hm, I see. The problem is specific to PyArr

[jira] [Assigned] (SPARK-25992) Accumulators giving KeyError in pyspark

[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25992: Assignee: (was: Apache Spark) > Accumulators giving KeyError in pyspark > ---

[jira] [Assigned] (SPARK-25992) Accumulators giving KeyError in pyspark

[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25992: Assignee: Apache Spark > Accumulators giving KeyError in pyspark > --

[jira] [Commented] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743758#comment-16743758 ] Elchin commented on SPARK-26591: [~bryanc] I even can't import pyarrow: {code:java} >>>

[jira] [Assigned] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26634: Assignee: Apache Spark > OutputCommitCoordinator may allow task of FetchFailureStage comm

[jira] [Assigned] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26634: Assignee: (was: Apache Spark) > OutputCommitCoordinator may allow task of FetchFailur

[jira] [Assigned] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26619: Assignee: (was: Apache Spark) > Prune the unused serializers from `SerializeFromObjec

[jira] [Assigned] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26619: Assignee: Apache Spark > Prune the unused serializers from `SerializeFromObject` > --