[jira] [Commented] (SPARK-22867) Add Isolation Forest algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301072#comment-16301072 ] Fangzhou Yang commented on SPARK-22867: --- Currently, there is no special algorithm for novelty and

[jira] [Assigned] (SPARK-22873) Init lastReportTimestamp with system current time when start() called in AsyncEventQueue

[ https://issues.apache.org/jira/browse/SPARK-22873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22873: Assignee: (was: Apache Spark) > Init lastReportTimestamp with system current time

[jira] [Commented] (SPARK-22873) Init lastReportTimestamp with system current time when start() called in AsyncEventQueue

[ https://issues.apache.org/jira/browse/SPARK-22873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301021#comment-16301021 ] Apache Spark commented on SPARK-22873: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22873) Init lastReportTimestamp with system current time when start() called in AsyncEventQueue

[ https://issues.apache.org/jira/browse/SPARK-22873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22873: Assignee: Apache Spark > Init lastReportTimestamp with system current time when start()

[jira] [Commented] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301015#comment-16301015 ] Felix Cheung commented on SPARK-20007: -- any taker on this for 2.3.0? > Make SparkR apply()

[jira] [Commented] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length

[ https://issues.apache.org/jira/browse/SPARK-21076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301011#comment-16301011 ] Felix Cheung commented on SPARK-21076: -- any taker on this for 2.3.0? > R dapply doesn't return

[jira] [Updated] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length

[ https://issues.apache.org/jira/browse/SPARK-21076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21076: - Target Version/s: 2.3.0 > R dapply doesn't return array or raw columns when array have different

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Updated] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21291: - Target Version/s: 2.3.0 > R bucketBy partitionBy API > -- > >

[jira] [Commented] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301006#comment-16301006 ] Felix Cheung commented on SPARK-22632: -- how are we on this for 2.3? > Fix the behavior of timestamp

[jira] [Updated] (SPARK-21940) Support timezone for timestamps in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21940: - Target Version/s: 2.3.0 > Support timezone for timestamps in SparkR >

[jira] [Updated] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22632: - Target Version/s: 2.3.0 > Fix the behavior of timestamp values for R's DataFrame to respect

[jira] [Updated] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20007: - Target Version/s: 2.3.0 > Make SparkR apply() functions robust to workers that return empty

[jira] [Updated] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21208: - Target Version/s: 2.3.0 > Ability to "setLocalProperty" from sc, in sparkR >

[jira] [Commented] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301012#comment-16301012 ] Felix Cheung commented on SPARK-21208: -- any taker on this for 2.3.0? > Ability to

[jira] [Updated] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21030: - Target Version/s: 2.3.0 > extend hint syntax to support any expression for Python and R >

[jira] [Commented] (SPARK-21030) extend hint syntax to support any expression for Python and R

[ https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301014#comment-16301014 ] Felix Cheung commented on SPARK-21030: -- any taker on this for 2.3.0? > extend hint syntax to

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301010#comment-16301010 ] Felix Cheung commented on SPARK-21291: -- any taker on this for 2.3.0? > R bucketBy partitionBy API >

[jira] [Commented] (SPARK-21940) Support timezone for timestamps in SparkR

[ https://issues.apache.org/jira/browse/SPARK-21940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301007#comment-16301007 ] Felix Cheung commented on SPARK-21940: -- any taker on this for 2.3.0? > Support timezone for

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Updated] (SPARK-22843) R localCheckpoint API

[ https://issues.apache.org/jira/browse/SPARK-22843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22843: - Target Version/s: 2.3.0 > R localCheckpoint API > - > > Key:

[jira] [Commented] (SPARK-22843) R localCheckpoint API

[ https://issues.apache.org/jira/browse/SPARK-22843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301005#comment-16301005 ] Felix Cheung commented on SPARK-22843: -- any taker on this for 2.3.0? > R localCheckpoint API >

[jira] [Created] (SPARK-22873) Init lastReportTimestamp with system current time when start() called in AsyncEventQueue

wuyi created SPARK-22873: Summary: Init lastReportTimestamp with system current time when start() called in AsyncEventQueue Key: SPARK-22873 URL: https://issues.apache.org/jira/browse/SPARK-22873 Project:

[jira] [Commented] (SPARK-22766) Install R linter package in spark lib directory

[ https://issues.apache.org/jira/browse/SPARK-22766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301003#comment-16301003 ] Felix Cheung commented on SPARK-22766: -- how is this vs SPARK-22063 ? > Install R linter

[jira] [Commented] (SPARK-20694) Document DataFrameWriter partitionBy, bucketBy and sortBy in SQL guide

[ https://issues.apache.org/jira/browse/SPARK-20694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301000#comment-16301000 ] Apache Spark commented on SPARK-20694: -- User 'CNRui' has created a pull request for this issue:

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Issue Comment Deleted] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Comment: was deleted (was: [^jpmml-research.jpg]) > Spark ML Pipeline Model Persistent Support Save Schema

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Attachment: jpmml-research.jpg [^jpmml-research.jpg] > Spark ML Pipeline Model Persistent Support Save

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Attachment: (was: jpmml-research.jpg) > Spark ML Pipeline Model Persistent Support Save Schema Info >

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Attachment: jpmml-research.jpg > Spark ML Pipeline Model Persistent Support Save Schema Info >

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Attachment: ppmml-design2.jpg > Spark ML Pipeline Model Persistent Support Save Schema Info >

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Attachment: (was: ppmml-design2.jpg) > Spark ML Pipeline Model Persistent Support Save Schema Info >

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Updated] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

[ https://issues.apache.org/jira/browse/SPARK-22872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyanny updated SPARK-22872: --- Description: Hi all, I recently did a research about pmml, and my project needs to transform many models

[jira] [Created] (SPARK-22872) Spark ML Pipeline Model Persistent Support Save Schema Info

Cyanny created SPARK-22872: -- Summary: Spark ML Pipeline Model Persistent Support Save Schema Info Key: SPARK-22872 URL: https://issues.apache.org/jira/browse/SPARK-22872 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-22862) Docs on lazy elimination of columns missing from an encoder.

[ https://issues.apache.org/jira/browse/SPARK-22862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22862. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 2.1.3 > Docs

[jira] [Commented] (SPARK-22867) Add Isolation Forest algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300979#comment-16300979 ] Sean Owen commented on SPARK-22867: --- Before you add a bunch of these -- this is already in the right

[jira] [Commented] (SPARK-22871) Add GBT+LR Algorithm in MLlib

[ https://issues.apache.org/jira/browse/SPARK-22871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300972#comment-16300972 ] Fangzhou Yang commented on SPARK-22871: --- GBTLRClassifier on Spark is designed and implemented by

[jira] [Created] (SPARK-22871) Add GBT+LR Algorithm in MLlib

Fangzhou Yang created SPARK-22871: - Summary: Add GBT+LR Algorithm in MLlib Key: SPARK-22871 URL: https://issues.apache.org/jira/browse/SPARK-22871 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300965#comment-16300965 ] Felix Cheung commented on SPARK-21727: -- Neil McQuarrie is going to work on this > Operating on an

[jira] [Assigned] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21727: Assignee: Neil McQuarrie > Operating on an ArrayType in a SparkR DataFrame throws error >

[jira] [Updated] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-22866: Fix Version/s: (was: 3.0.0) 2.3.0 > Kubernetes dockerfile

[jira] [Resolved] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-22866. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-22868) 64KB JVM bytecode limit problem with aggregation

[ https://issues.apache.org/jira/browse/SPARK-22868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22868: - Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit

[jira] [Updated] (SPARK-22869) 64KB JVM bytecode limit problem with filter

[ https://issues.apache.org/jira/browse/SPARK-22869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22869: - Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit

[jira] [Comment Edited] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300926#comment-16300926 ] Xuefu Zhang edited comment on SPARK-22765 at 12/22/17 4:43 AM: --- Did some

[jira] [Created] (SPARK-22870) Dynamic allocation should allow 0 idle time

Xuefu Zhang created SPARK-22870: --- Summary: Dynamic allocation should allow 0 idle time Key: SPARK-22870 URL: https://issues.apache.org/jira/browse/SPARK-22870 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22869) 64KB JVM bytecode limit problem with filter

[ https://issues.apache.org/jira/browse/SPARK-22869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300946#comment-16300946 ] Kazuaki Ishizaki commented on SPARK-22869: -- I am working for this and waiting for merging

[jira] [Commented] (SPARK-22868) 64KB JVM bytecode limit problem with aggregation

[ https://issues.apache.org/jira/browse/SPARK-22868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300945#comment-16300945 ] Kazuaki Ishizaki commented on SPARK-22868: -- I am working for this and waiting for merging

[jira] [Created] (SPARK-22869) 64KB JVM bytecode limit problem with filter

Kazuaki Ishizaki created SPARK-22869: Summary: 64KB JVM bytecode limit problem with filter Key: SPARK-22869 URL: https://issues.apache.org/jira/browse/SPARK-22869 Project: Spark Issue

[jira] [Created] (SPARK-22868) 64KB JVM bytecode limit problem with aggregation

Kazuaki Ishizaki created SPARK-22868: Summary: 64KB JVM bytecode limit problem with aggregation Key: SPARK-22868 URL: https://issues.apache.org/jira/browse/SPARK-22868 Project: Spark

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300926#comment-16300926 ] Xuefu Zhang commented on SPARK-22765: - Did some benchmarking with a set of 20 queries on upfront

[jira] [Commented] (SPARK-22867) Add Isolation Forest algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-22867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300919#comment-16300919 ] Fangzhou Yang commented on SPARK-22867: --- We design and implement a distributed iForest on Spark,

[jira] [Created] (SPARK-22867) Add Isolation Forest algorithm to MLlib

Fangzhou Yang created SPARK-22867: - Summary: Add Isolation Forest algorithm to MLlib Key: SPARK-22867 URL: https://issues.apache.org/jira/browse/SPARK-22867 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22866: Assignee: Apache Spark > Kubernetes dockerfile path needs update >

[jira] [Commented] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300917#comment-16300917 ] Apache Spark commented on SPARK-22866: -- User 'foxish' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22866: Assignee: (was: Apache Spark) > Kubernetes dockerfile path needs update >

[jira] [Created] (SPARK-22866) Kubernetes dockerfile path needs update

Anirudh Ramanathan created SPARK-22866: -- Summary: Kubernetes dockerfile path needs update Key: SPARK-22866 URL: https://issues.apache.org/jira/browse/SPARK-22866 Project: Spark Issue

[jira] [Assigned] (SPARK-22750) Introduce reusable mutable states

[ https://issues.apache.org/jira/browse/SPARK-22750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22750: --- Assignee: Marco Gaido > Introduce reusable mutable states >

[jira] [Resolved] (SPARK-22750) Introduce reusable mutable states

[ https://issues.apache.org/jira/browse/SPARK-22750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22750. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19940

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300838#comment-16300838 ] Sean Owen commented on SPARK-22851: --- That I don't know. It would be at best an ASF INFRA question. yes,

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300814#comment-16300814 ] John Brock commented on SPARK-22851: I wouldn't call this resolved yet. Is there a way to contact

[jira] [Resolved] (SPARK-19552) Upgrade Netty version to 4.1.x final

[ https://issues.apache.org/jira/browse/SPARK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19552. -- Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.3.0 Resolved by

[jira] [Resolved] (SPARK-22854) AppStatusListener should get Spark version by SparkListenerLogStart

[ https://issues.apache.org/jira/browse/SPARK-22854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22854. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20049

[jira] [Created] (SPARK-22865) Publish Official Apache Spark Docker images

Anirudh Ramanathan created SPARK-22865: -- Summary: Publish Official Apache Spark Docker images Key: SPARK-22865 URL: https://issues.apache.org/jira/browse/SPARK-22865 Project: Spark

[jira] [Assigned] (SPARK-22854) AppStatusListener should get Spark version by SparkListenerLogStart

[ https://issues.apache.org/jira/browse/SPARK-22854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22854: --- Assignee: Marcelo Vanzin > AppStatusListener should get Spark version by

[jira] [Resolved] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan resolved SPARK-22647. Resolution: Fixed > Docker files for image creation >

[jira] [Commented] (SPARK-22647) Docker files for image creation

[ https://issues.apache.org/jira/browse/SPARK-22647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300810#comment-16300810 ] Anirudh Ramanathan commented on SPARK-22647: The dockerfiles themselves have been checked in

[jira] [Resolved] (SPARK-22648) Documentation for Kubernetes Scheduler Backend

[ https://issues.apache.org/jira/browse/SPARK-22648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-22648. - Resolution: Fixed Assignee: Anirudh Ramanathan Fix Version/s: 2.3.0 >

[jira] [Resolved] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22851. --- Resolution: Not A Problem That's great research. Yes, consistent with the bug report above too. OK,

[jira] [Comment Edited] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300740#comment-16300740 ] John Brock edited comment on SPARK-22851 at 12/21/17 11:59 PM: --- I think the

[jira] [Comment Edited] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300740#comment-16300740 ] John Brock edited comment on SPARK-22851 at 12/21/17 11:57 PM: --- I think the

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300740#comment-16300740 ] John Brock commented on SPARK-22851: I think the inconsistent behavior in Chrome is due to different

[jira] [Assigned] (SPARK-22861) SQLAppStatusListener should track all stages in multi-job executions

[ https://issues.apache.org/jira/browse/SPARK-22861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-22861: -- Assignee: Imran Rashid (was: Apache Spark) > SQLAppStatusListener should track all

[jira] [Resolved] (SPARK-22861) SQLAppStatusListener should track all stages in multi-job executions

[ https://issues.apache.org/jira/browse/SPARK-22861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22861. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20047

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300708#comment-16300708 ] Sean Owen commented on SPARK-22851: --- I think it is Chrome. You can see that the file in question is

[jira] [Commented] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

[ https://issues.apache.org/jira/browse/SPARK-22864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300694#comment-16300694 ] Apache Spark commented on SPARK-22864: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

[ https://issues.apache.org/jira/browse/SPARK-22864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22864: Assignee: Apache Spark > Flaky test: ExecutorAllocationManagerSuite "cancel pending

[jira] [Assigned] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

[ https://issues.apache.org/jira/browse/SPARK-22864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22864: Assignee: (was: Apache Spark) > Flaky test: ExecutorAllocationManagerSuite "cancel

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300599#comment-16300599 ] Felix Cheung commented on SPARK-22851: -- Ah then it’s the browser - i know Safari does unpack it

[jira] [Commented] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

[ https://issues.apache.org/jira/browse/SPARK-22864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300577#comment-16300577 ] Marcelo Vanzin commented on SPARK-22864: The exception seems to also happen on success (and is

[jira] [Created] (SPARK-22864) Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed"

Marcelo Vanzin created SPARK-22864: -- Summary: Flaky test: ExecutorAllocationManagerSuite "cancel pending executors when no longer needed" Key: SPARK-22864 URL: https://issues.apache.org/jira/browse/SPARK-22864

[jira] [Created] (SPARK-22863) Make MicroBatchExecution also support MicroBatchRead/WriteSupport

Shixiong Zhu created SPARK-22863: Summary: Make MicroBatchExecution also support MicroBatchRead/WriteSupport Key: SPARK-22863 URL: https://issues.apache.org/jira/browse/SPARK-22863 Project: Spark

[jira] [Assigned] (SPARK-22854) AppStatusListener should get Spark version by SparkListenerLogStart

[ https://issues.apache.org/jira/browse/SPARK-22854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22854: Assignee: (was: Apache Spark) > AppStatusListener should get Spark version by

[jira] [Assigned] (SPARK-22854) AppStatusListener should get Spark version by SparkListenerLogStart

[ https://issues.apache.org/jira/browse/SPARK-22854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22854: Assignee: Apache Spark > AppStatusListener should get Spark version by

[jira] [Commented] (SPARK-22854) AppStatusListener should get Spark version by SparkListenerLogStart

[ https://issues.apache.org/jira/browse/SPARK-22854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300548#comment-16300548 ] Apache Spark commented on SPARK-22854: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22862) Docs on lazy elimination of columns missing from an encoder.

[ https://issues.apache.org/jira/browse/SPARK-22862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22862: Assignee: Michael Armbrust (was: Apache Spark) > Docs on lazy elimination of columns

[jira] [Assigned] (SPARK-22862) Docs on lazy elimination of columns missing from an encoder.

[ https://issues.apache.org/jira/browse/SPARK-22862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22862: Assignee: Apache Spark (was: Michael Armbrust) > Docs on lazy elimination of columns

[jira] [Commented] (SPARK-22862) Docs on lazy elimination of columns missing from an encoder.

[ https://issues.apache.org/jira/browse/SPARK-22862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300496#comment-16300496 ] Apache Spark commented on SPARK-22862: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Created] (SPARK-22862) Docs on lazy elimination of columns missing from an encoder.

Michael Armbrust created SPARK-22862: Summary: Docs on lazy elimination of columns missing from an encoder. Key: SPARK-22862 URL: https://issues.apache.org/jira/browse/SPARK-22862 Project: Spark

[jira] [Commented] (SPARK-22853) K8s or Kubernetes?

[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300434#comment-16300434 ] Anirudh Ramanathan commented on SPARK-22853: The CNCF owns the trademark for Kubernetes but

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300428#comment-16300428 ] John Brock commented on SPARK-22851: Interesting... for that specific pair.com mirror, I'm also

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300409#comment-16300409 ] Sean Owen commented on SPARK-22851: --- Hm, I note that these downloads are fine when I use curl or wget,

[jira] [Commented] (SPARK-22851) Download mirror for spark-2.2.1-bin-hadoop2.7.tgz has file with incorrect checksum

[ https://issues.apache.org/jira/browse/SPARK-22851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300391#comment-16300391 ] Sean Owen commented on SPARK-22851: --- I'd still be really surprised if mirrors were somehow unzipping a

[jira] [Commented] (SPARK-22853) K8s or Kubernetes?

[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300371#comment-16300371 ] Sean Owen commented on SPARK-22853: --- The project (and therefore trademark owners) are what counts in

[jira] [Commented] (SPARK-22683) DynamicAllocation wastes resources by allocating containers that will barely be used

[ https://issues.apache.org/jira/browse/SPARK-22683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300370#comment-16300370 ] Julien Cuquemelle commented on SPARK-22683: --- Thanks [~xuefuz] for your tests. I think it all

[jira] [Commented] (SPARK-22853) K8s or Kubernetes?

[ https://issues.apache.org/jira/browse/SPARK-22853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300363#comment-16300363 ] Reynold Xin commented on SPARK-22853: - I think most of your questions can be answered by Google

  1   2   >