[jira] [Updated] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

2019-01-16 Thread liupengcheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-26634: - Affects Version/s: (was: 2.4.0) > OutputCommitCoordinator may allow task of

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421530#comment-16421530 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:56 AM: - Same

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432207#comment-16432207 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:56 AM: -  

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:54 AM: - Okay,

[jira] [Updated] (SPARK-26641) Seperate capacity Configurations of different event queue.

2019-01-16 Thread jiaan.geng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-26641: --- Description: I always maintance a spark on yarn cluster on line.I always found the error:

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432207#comment-16432207 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:55 AM: -  

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:51 AM: - Okay,

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:50 AM: - Okay,

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744675#comment-16744675 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:49 AM: - Okay,

[jira] [Comment Edited] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744524#comment-16744524 ] Kingsley Jones edited comment on SPARK-12216 at 1/17/19 4:47 AM: - I am

[jira] [Assigned] (SPARK-26641) Seperate capacity Configurations of different event queue.

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26641: Assignee: Apache Spark > Seperate capacity Configurations of different event queue. >

[jira] [Assigned] (SPARK-26641) Seperate capacity Configurations of different event queue.

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26641: Assignee: (was: Apache Spark) > Seperate capacity Configurations of different event

[jira] [Created] (SPARK-26641) Seperate capacity Configurations of different event queue.

2019-01-16 Thread jiaan.geng (JIRA)
jiaan.geng created SPARK-26641: -- Summary: Seperate capacity Configurations of different event queue. Key: SPARK-26641 URL: https://issues.apache.org/jira/browse/SPARK-26641 Project: Spark Issue

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744675#comment-16744675 ] Kingsley Jones commented on SPARK-12216: Okay, so I think we have a candidate for what is

[jira] [Assigned] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit categories.

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26466: - Assignee: Jungtaek Lim > Use ConfigEntry for hardcoded configs for submit categories. >

[jira] [Resolved] (SPARK-26466) Use ConfigEntry for hardcoded configs for submit categories.

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26466. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23532

[jira] [Assigned] (SPARK-26600) Update spark-submit usage message

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26600: - Assignee: Luca Canali > Update spark-submit usage message > -

[jira] [Resolved] (SPARK-26600) Update spark-submit usage message

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26600. --- Resolution: Fixed Issue resolved by pull request 23518 [https://github.com/apache/spark/pull/23518]

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744620#comment-16744620 ] Ke Jia commented on SPARK-26639: [~hyukjin.kwon] Thanks for your interesting.  As discussion in

[jira] [Assigned] (SPARK-26640) Code cleanup from lgtm.com analysis

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26640: Assignee: Apache Spark (was: Sean Owen) > Code cleanup from lgtm.com analysis >

[jira] [Assigned] (SPARK-26640) Code cleanup from lgtm.com analysis

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26640: Assignee: Sean Owen (was: Apache Spark) > Code cleanup from lgtm.com analysis >

[jira] [Resolved] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

2019-01-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26636. -- Resolution: Invalid > How to know that a partition is ready when using Structured Streaming

[jira] [Created] (SPARK-26640) Code cleanup from lgtm.com analysis

2019-01-16 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26640: - Summary: Code cleanup from lgtm.com analysis Key: SPARK-26640 URL: https://issues.apache.org/jira/browse/SPARK-26640 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

2019-01-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744614#comment-16744614 ] Hyukjin Kwon commented on SPARK-26636: -- For questions. should better go to mailing list. Let's

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744613#comment-16744613 ] Hyukjin Kwon commented on SPARK-26639: -- What's the input/output, and expected input/output? Can you

[jira] [Commented] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744606#comment-16744606 ] Ke Jia commented on SPARK-26639: [@davies|https://github.com/davies] 

[jira] [Updated] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26639: --- Description: The subquery reuse feature has done in  [https://github.com/apache/spark/pull/14548] In my

[jira] [Updated] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26639: --- Description: The subquery reuse feature has done in 

[jira] [Updated] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-26639: --- Description: The subquery reuse feature has done in 

[jira] [Created] (SPARK-26639) The reuse subquery function maybe does not work in SPARK SQL

2019-01-16 Thread Ke Jia (JIRA)
Ke Jia created SPARK-26639: -- Summary: The reuse subquery function maybe does not work in SPARK SQL Key: SPARK-26639 URL: https://issues.apache.org/jira/browse/SPARK-26639 Project: Spark Issue

[jira] [Resolved] (SPARK-26633) Add ExecutorClassLoader.getResourceAsStream

2019-01-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26633. - Resolution: Fixed Assignee: Kris Mok Fix Version/s: 3.0.0 2.4.1 >

[jira] [Assigned] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26638: Assignee: Apache Spark (was: Sean Owen) > Pyspark vector classes always return error

[jira] [Assigned] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26638: Assignee: Sean Owen (was: Apache Spark) > Pyspark vector classes always return error

[jira] [Created] (SPARK-26638) Pyspark vector classes always return error for unary negation

2019-01-16 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26638: - Summary: Pyspark vector classes always return error for unary negation Key: SPARK-26638 URL: https://issues.apache.org/jira/browse/SPARK-26638 Project: Spark

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744524#comment-16744524 ] Kingsley Jones commented on SPARK-12216: I am going down the Rabbit Hole of the Scala REPL. I

[jira] [Updated] (SPARK-26566) Upgrade apache/arrow to 0.12.0

2019-01-16 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-26566: - Description: _This is just a placeholder for now to collect what needs to be fixed when we

[jira] [Resolved] (SPARK-26625) spark.redaction.regex should include oauthToken

2019-01-16 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-26625. Resolution: Fixed Fix Version/s: 3.0.0 > spark.redaction.regex should include oauthToken >

[jira] [Assigned] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

2019-01-16 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-26619: --- Assignee: Liang-Chi Hsieh > Prune the unused serializers from `SerializeFromObject` >

[jira] [Resolved] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

2019-01-16 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-26619. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23562

[jira] [Resolved] (SPARK-26550) New datasource for benchmarking

2019-01-16 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26550. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > New

[jira] [Updated] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26629: - Fix Version/s: (was: 2.3.4) > Error with multiple file stream in a query + restart on a

[jira] [Updated] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26629: - Fix Version/s: 3.0.0 2.4.1 2.3.4 > Error with multiple

[jira] [Resolved] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-26629. -- Resolution: Fixed > Error with multiple file stream in a query + restart on a batch that has

[jira] [Commented] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

2019-01-16 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744288#comment-16744288 ] Bryan Cutler commented on SPARK-26591: -- [~elch10] please go ahead and make a Jira for Arrow

[jira] [Updated] (SPARK-26629) Error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-26629: - Affects Version/s: 2.3.3 > Error with multiple file stream in a query + restart on a batch that

[jira] [Assigned] (SPARK-25713) Implement copy() for ColumnarArray

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25713: Assignee: Apache Spark > Implement copy() for ColumnarArray >

[jira] [Commented] (SPARK-25713) Implement copy() for ColumnarArray

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744259#comment-16744259 ] Apache Spark commented on SPARK-25713: -- User 'ayudovin' has created a pull request for this issue:

[jira] [Commented] (SPARK-25713) Implement copy() for ColumnarArray

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744257#comment-16744257 ] Apache Spark commented on SPARK-25713: -- User 'ayudovin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25713) Implement copy() for ColumnarArray

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25713: Assignee: (was: Apache Spark) > Implement copy() for ColumnarArray >

[jira] [Resolved] (SPARK-25992) Accumulators giving KeyError in pyspark

2019-01-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25992. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Fixed at

[jira] [Resolved] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26615. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Issue resolved by pull

[jira] [Assigned] (SPARK-26615) Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26615: - Assignee: Attila Zsolt Piros > Fixing transport server/client resource leaks in the core

[jira] [Resolved] (SPARK-26429) Add jdbc sink support for Structured Streaming

2019-01-16 Thread Wang Yanlin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang Yanlin resolved SPARK-26429. - Resolution: Duplicate > Add jdbc sink support for Structured Streaming >

[jira] [Updated] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

2019-01-16 Thread Guo Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guo Wei updated SPARK-26636: Description: When using structured streaming, we use "partitionBy" api  to partition the output data, and

[jira] [Assigned] (SPARK-26637) Makes GetArrayItem nullability more precise

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26637: Assignee: (was: Apache Spark) > Makes GetArrayItem nullability more precise >

[jira] [Updated] (SPARK-26636) How to know that a partition is ready when using Structured Streaming

2019-01-16 Thread Guo Wei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guo Wei updated SPARK-26636: Summary: How to know that a partition is ready when using Structured Streaming (was: How to know a

[jira] [Assigned] (SPARK-26637) Makes GetArrayItem nullability more precise

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26637: Assignee: Apache Spark > Makes GetArrayItem nullability more precise >

[jira] [Created] (SPARK-26637) Makes GetArrayItem nullability more precise

2019-01-16 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-26637: Summary: Makes GetArrayItem nullability more precise Key: SPARK-26637 URL: https://issues.apache.org/jira/browse/SPARK-26637 Project: Spark Issue

[jira] [Created] (SPARK-26636) How to know a partition is ready when using Structured Streaming

2019-01-16 Thread Guo Wei (JIRA)
Guo Wei created SPARK-26636: --- Summary: How to know a partition is ready when using Structured Streaming Key: SPARK-26636 URL: https://issues.apache.org/jira/browse/SPARK-26636 Project: Spark

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2019-01-16 Thread Kingsley Jones (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743838#comment-16743838 ] Kingsley Jones commented on SPARK-12216: I had another go at investigating this as it continues

[jira] [Commented] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2019-01-16 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743783#comment-16743783 ] Prashant Sharma commented on SPARK-26059: - One work around is to capture the JVM exit code for

[jira] [Updated] (SPARK-26616) Expose document frequency in IDFModel

2019-01-16 Thread Jatin Puri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jatin Puri updated SPARK-26616: --- Docs Text: Provide DocumentFrequency in IDF (was: Provide DocumentFrequency vector in IDF) >

[jira] [Resolved] (SPARK-26635) illegal hardware instruction

2019-01-16 Thread Elchin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin resolved SPARK-26635. Resolution: Fixed > illegal hardware instruction > > > Key:

[jira] [Closed] (SPARK-26635) illegal hardware instruction

2019-01-16 Thread Elchin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin closed SPARK-26635. -- > illegal hardware instruction > > > Key: SPARK-26635 >

[jira] [Created] (SPARK-26635) illegal hardware instruction

2019-01-16 Thread Elchin (JIRA)
Elchin created SPARK-26635: -- Summary: illegal hardware instruction Key: SPARK-26635 URL: https://issues.apache.org/jira/browse/SPARK-26635 Project: Spark Issue Type: Bug Components:

[jira] [Closed] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

2019-01-16 Thread Elchin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin closed SPARK-26591. -- > Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain > environment >

[jira] [Resolved] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

2019-01-16 Thread Elchin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elchin resolved SPARK-26591. Resolution: Feedback Received > Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain

[jira] [Commented] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

2019-01-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743761#comment-16743761 ] Hyukjin Kwon commented on SPARK-26591: -- Hm, I see. The problem is specific to PyArrow then. Let's

[jira] [Assigned] (SPARK-25992) Accumulators giving KeyError in pyspark

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25992: Assignee: (was: Apache Spark) > Accumulators giving KeyError in pyspark >

[jira] [Assigned] (SPARK-25992) Accumulators giving KeyError in pyspark

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25992: Assignee: Apache Spark > Accumulators giving KeyError in pyspark >

[jira] [Commented] (SPARK-26591) Scalar Pandas UDF fails with 'illegal hardware instruction' in a certain environment

2019-01-16 Thread Elchin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743758#comment-16743758 ] Elchin commented on SPARK-26591: [~bryanc] I even can't import pyarrow: {code:java} >>> import pyarrow

[jira] [Assigned] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26634: Assignee: Apache Spark > OutputCommitCoordinator may allow task of FetchFailureStage

[jira] [Assigned] (SPARK-26634) OutputCommitCoordinator may allow task of FetchFailureStage commit again

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26634: Assignee: (was: Apache Spark) > OutputCommitCoordinator may allow task of

[jira] [Assigned] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26619: Assignee: (was: Apache Spark) > Prune the unused serializers from

[jira] [Assigned] (SPARK-26619) Prune the unused serializers from `SerializeFromObject`

2019-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26619: Assignee: Apache Spark > Prune the unused serializers from `SerializeFromObject` >