[jira] [Updated] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16144: -- Assignee: Xin Ren > Add a separate Rd for ML generic methods: read.ml, write.ml, summary,

[jira] [Comment Edited] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352409#comment-15352409 ] Xiangrui Meng edited comment on SPARK-16144 at 6/28/16 5:57 AM: Please

[jira] [Updated] (SPARK-16248) Whitelist the list of Hive fallback functions

[ https://issues.apache.org/jira/browse/SPARK-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16248: Description: This patch removes the blind fallback into Hive for functions. Instead, it creates a

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352409#comment-15352409 ] Xiangrui Meng commented on SPARK-16144: --- Please hold because this should be combined with

[jira] [Assigned] (SPARK-16248) Whitelist the list of Hive fallback functions

[ https://issues.apache.org/jira/browse/SPARK-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16248: Assignee: Apache Spark (was: Reynold Xin) > Whitelist the list of Hive fallback

[jira] [Commented] (SPARK-16248) Whitelist the list of Hive fallback functions

[ https://issues.apache.org/jira/browse/SPARK-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352405#comment-15352405 ] Apache Spark commented on SPARK-16248: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16248) Whitelist the list of Hive fallback functions

[ https://issues.apache.org/jira/browse/SPARK-16248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16248: Assignee: Reynold Xin (was: Apache Spark) > Whitelist the list of Hive fallback

[jira] [Created] (SPARK-16248) Whitelist the list of Hive fallback functions

Reynold Xin created SPARK-16248: --- Summary: Whitelist the list of Hive fallback functions Key: SPARK-16248 URL: https://issues.apache.org/jira/browse/SPARK-16248 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15863) Update SQL programming guide for Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352390#comment-15352390 ] Apache Spark commented on SPARK-15863: -- User 'yhuai' has created a pull request for this issue:

[jira] [Resolved] (SPARK-16132) model loading backward compatibility for tree model (DecisionTree, RF, GBT)

[ https://issues.apache.org/jira/browse/SPARK-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang resolved SPARK-16132. Resolution: Not A Problem > model loading backward compatibility for tree model (DecisionTree, RF,

[jira] [Commented] (SPARK-16243) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352382#comment-15352382 ] yuhao yang commented on SPARK-16243: Close this as it's duplicated to

[jira] [Resolved] (SPARK-16243) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang resolved SPARK-16243. Resolution: Duplicate > model loading backward compatibility for ml.feature.PCA >

[jira] [Updated] (SPARK-16247) Using pyspark dataframe with pipeline and cross validator

[ https://issues.apache.org/jira/browse/SPARK-16247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Ma updated SPARK-16247: -- Description: I am using pyspark with dataframe. Using pipeline operation to train and predict the

[jira] [Updated] (SPARK-16247) Using pyspark dataframe with pipeline and cross validator

[ https://issues.apache.org/jira/browse/SPARK-16247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Ma updated SPARK-16247: -- Description: I am using pyspark with dataframe. Using pipeline operation to train and predict the

[jira] [Created] (SPARK-16247) Using pyspark dataframe with pipeline and cross validator

Edward Ma created SPARK-16247: - Summary: Using pyspark dataframe with pipeline and cross validator Key: SPARK-16247 URL: https://issues.apache.org/jira/browse/SPARK-16247 Project: Spark Issue

[jira] [Created] (SPARK-16246) Too many block-manager-slave-async-thread opened (TIMED_WAITING) for spark Kafka streaming

Alex Jiang created SPARK-16246: -- Summary: Too many block-manager-slave-async-thread opened (TIMED_WAITING) for spark Kafka streaming Key: SPARK-16246 URL: https://issues.apache.org/jira/browse/SPARK-16246

[jira] [Resolved] (SPARK-16221) Redirect Parquet JUL logger via SLF4J for WRITE operations

[ https://issues.apache.org/jira/browse/SPARK-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16221. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-16221) Redirect Parquet JUL logger via SLF4J for WRITE operations

[ https://issues.apache.org/jira/browse/SPARK-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16221: --- Assignee: Dongjoon Hyun > Redirect Parquet JUL logger via SLF4J for WRITE operations >

[jira] [Resolved] (SPARK-16111) Hide SparkOrcNewRecordReader in API docs

[ https://issues.apache.org/jira/browse/SPARK-16111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16111. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.0.0 > Hide

[jira] [Commented] (SPARK-15558) Deadlock when retreiving shuffled cached data

[ https://issues.apache.org/jira/browse/SPARK-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352361#comment-15352361 ] Alex Jiang commented on SPARK-15558: I don't know if our spark streaming issue is related to this.

[jira] [Assigned] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16245: Assignee: Apache Spark > model loading backward compatibility for ml.feature.PCA >

[jira] [Commented] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352350#comment-15352350 ] Apache Spark commented on SPARK-16245: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16245: Assignee: (was: Apache Spark) > model loading backward compatibility for

[jira] [Created] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

Yanbo Liang created SPARK-16245: --- Summary: model loading backward compatibility for ml.feature.PCA Key: SPARK-16245 URL: https://issues.apache.org/jira/browse/SPARK-16245 Project: Spark Issue

[jira] [Updated] (SPARK-16244) Failed job/stage couldn't stop JobGenerator immediately.

[ https://issues.apache.org/jira/browse/SPARK-16244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated SPARK-16244: --- Description: This streaming job has a very simple DAG. Each batch have only 1 job, and each job has

[jira] [Created] (SPARK-16244) Failed job/stage couldn't stop JobGenerator immediately.

Liyin Tang created SPARK-16244: -- Summary: Failed job/stage couldn't stop JobGenerator immediately. Key: SPARK-16244 URL: https://issues.apache.org/jira/browse/SPARK-16244 Project: Spark Issue

[jira] [Commented] (SPARK-16132) model loading backward compatibility for tree model (DecisionTree, RF, GBT)

[ https://issues.apache.org/jira/browse/SPARK-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352301#comment-15352301 ] Yanbo Liang commented on SPARK-16132: - Since we did not support DecisionTree, RandomForest and GBT

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352296#comment-15352296 ] Yanbo Liang commented on SPARK-16240: - Since we did not back port

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352289#comment-15352289 ] Xiangrui Meng commented on SPARK-15799: --- [~sunrui] Maybe we can download the corresponding Spark

[jira] [Updated] (SPARK-16242) Wrap the Matrix conversion utils in Python

[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16242: -- Assignee: Yanbo Liang > Wrap the Matrix conversion utils in Python >

[jira] [Resolved] (SPARK-16143) Group survival analysis methods in generated doc

[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16143. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Commented] (SPARK-16243) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352277#comment-15352277 ] Apache Spark commented on SPARK-16243: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16243) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16243: Assignee: (was: Apache Spark) > model loading backward compatibility for

[jira] [Assigned] (SPARK-16243) model loading backward compatibility for ml.feature.PCA

[ https://issues.apache.org/jira/browse/SPARK-16243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16243: Assignee: Apache Spark > model loading backward compatibility for ml.feature.PCA >

[jira] [Created] (SPARK-16243) model loading backward compatibility for ml.feature.PCA

yuhao yang created SPARK-16243: -- Summary: model loading backward compatibility for ml.feature.PCA Key: SPARK-16243 URL: https://issues.apache.org/jira/browse/SPARK-16243 Project: Spark Issue

[jira] [Assigned] (SPARK-16242) Wrap the Matrix conversion utils in Python

[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16242: Assignee: (was: Apache Spark) > Wrap the Matrix conversion utils in Python >

[jira] [Commented] (SPARK-16242) Wrap the Matrix conversion utils in Python

[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352269#comment-15352269 ] Apache Spark commented on SPARK-16242: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16242) Wrap the Matrix conversion utils in Python

[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16242: Assignee: Apache Spark > Wrap the Matrix conversion utils in Python >

[jira] [Commented] (SPARK-16241) model loading backward compatibility for ml NaiveBayes

[ https://issues.apache.org/jira/browse/SPARK-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352266#comment-15352266 ] yuhao yang commented on SPARK-16241: Sure, please refer the fix of

[jira] [Commented] (SPARK-16241) model loading backward compatibility for ml NaiveBayes

[ https://issues.apache.org/jira/browse/SPARK-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352263#comment-15352263 ] Li Ping Zhang commented on SPARK-16241: --- Can I help on this? > model loading backward

[jira] [Created] (SPARK-16242) Wrap the Matrix conversion utils in Python

Yanbo Liang created SPARK-16242: --- Summary: Wrap the Matrix conversion utils in Python Key: SPARK-16242 URL: https://issues.apache.org/jira/browse/SPARK-16242 Project: Spark Issue Type:

[jira] [Created] (SPARK-16241) model loading backward compatibility for ml NaiveBayes

yuhao yang created SPARK-16241: -- Summary: model loading backward compatibility for ml NaiveBayes Key: SPARK-16241 URL: https://issues.apache.org/jira/browse/SPARK-16241 Project: Spark Issue

[jira] [Commented] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352225#comment-15352225 ] yuhao yang commented on SPARK-16240: cc [~yanboliang] [~josephkb] > model loading backward

[jira] [Created] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

yuhao yang created SPARK-16240: -- Summary: model loading backward compatibility for ml.clustering.LDA Key: SPARK-16240 URL: https://issues.apache.org/jira/browse/SPARK-16240 Project: Spark Issue

[jira] [Created] (SPARK-16239) SQL issues with cast from date to string around daylight savings time

Glen Maisey created SPARK-16239: --- Summary: SQL issues with cast from date to string around daylight savings time Key: SPARK-16239 URL: https://issues.apache.org/jira/browse/SPARK-16239 Project: Spark

[jira] [Commented] (SPARK-16238) Metrics for generated method bytecode size

[ https://issues.apache.org/jira/browse/SPARK-16238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352136#comment-15352136 ] Apache Spark commented on SPARK-16238: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16238) Metrics for generated method bytecode size

[ https://issues.apache.org/jira/browse/SPARK-16238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16238: Assignee: Apache Spark > Metrics for generated method bytecode size >

[jira] [Assigned] (SPARK-16238) Metrics for generated method bytecode size

[ https://issues.apache.org/jira/browse/SPARK-16238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16238: Assignee: (was: Apache Spark) > Metrics for generated method bytecode size >

[jira] [Created] (SPARK-16238) Metrics for generated method bytecode size

Eric Liang created SPARK-16238: -- Summary: Metrics for generated method bytecode size Key: SPARK-16238 URL: https://issues.apache.org/jira/browse/SPARK-16238 Project: Spark Issue Type:

[jira] [Created] (SPARK-16237) PySpark gapply

Vladimir Feinberg created SPARK-16237: - Summary: PySpark gapply Key: SPARK-16237 URL: https://issues.apache.org/jira/browse/SPARK-16237 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-16236) Add Path Option back to Load API in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352085#comment-15352085 ] Apache Spark commented on SPARK-16236: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16236) Add Path Option back to Load API in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16236: Assignee: (was: Apache Spark) > Add Path Option back to Load API in DataFrameReader >

[jira] [Assigned] (SPARK-16236) Add Path Option back to Load API in DataFrameReader

[ https://issues.apache.org/jira/browse/SPARK-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16236: Assignee: Apache Spark > Add Path Option back to Load API in DataFrameReader >

[jira] [Resolved] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16220. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.1 > Revert

[jira] [Created] (SPARK-16236) Add Path Option back to Load API in DataFrameReader

Xiao Li created SPARK-16236: --- Summary: Add Path Option back to Load API in DataFrameReader Key: SPARK-16236 URL: https://issues.apache.org/jira/browse/SPARK-16236 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16055) sparkR.init() can not load sparkPackages when executing an R file

[ https://issues.apache.org/jira/browse/SPARK-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352051#comment-15352051 ] Krishna Kalyan commented on SPARK-16055: Hi [~shivaram] (Spark 1.6) - Could replicate the issue

[jira] [Assigned] (SPARK-15354) Topology aware block replication strategies

[ https://issues.apache.org/jira/browse/SPARK-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15354: Assignee: Apache Spark > Topology aware block replication strategies >

[jira] [Commented] (SPARK-15354) Topology aware block replication strategies

[ https://issues.apache.org/jira/browse/SPARK-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352038#comment-15352038 ] Apache Spark commented on SPARK-15354: -- User 'shubhamchopra' has created a pull request for this

[jira] [Assigned] (SPARK-15354) Topology aware block replication strategies

[ https://issues.apache.org/jira/browse/SPARK-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15354: Assignee: (was: Apache Spark) > Topology aware block replication strategies >

[jira] [Commented] (SPARK-16235) "evaluateEachIteration" is returning wrong results when calculated for classification model.

[ https://issues.apache.org/jira/browse/SPARK-16235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352022#comment-15352022 ] Mahmoud Rawas commented on SPARK-16235: --- I am working on a fix > "evaluateEachIteration" is

[jira] [Created] (SPARK-16235) "evaluateEachIteration" is returning wrong results when calculated for classification model.

Mahmoud Rawas created SPARK-16235: - Summary: "evaluateEachIteration" is returning wrong results when calculated for classification model. Key: SPARK-16235 URL: https://issues.apache.org/jira/browse/SPARK-16235

[jira] [Commented] (SPARK-15700) Spark 2.0 dataframes using more memory (reading/writing parquet)

[ https://issues.apache.org/jira/browse/SPARK-15700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352016#comment-15352016 ] Davies Liu commented on SPARK-15700: My guess is that the SQL metrics required more memory than

[jira] [Commented] (SPARK-15621) BatchEvalPythonExec fails with OOM

[ https://issues.apache.org/jira/browse/SPARK-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352004#comment-15352004 ] Davies Liu commented on SPARK-15621: The number of rows in the queue will bounded by the number of

[jira] [Updated] (SPARK-15621) BatchEvalPythonExec fails with OOM

[ https://issues.apache.org/jira/browse/SPARK-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15621: --- Priority: Major (was: Critical) > BatchEvalPythonExec fails with OOM >

[jira] [Updated] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16224: --- Description: Hi, This is a continuation of a resolved bug

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351942#comment-15351942 ] Xusen Yin commented on SPARK-16144: --- I'd like to work on this. > Add a separate Rd for ML generic

[jira] [Commented] (SPARK-10408) Autoencoder

[ https://issues.apache.org/jira/browse/SPARK-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351922#comment-15351922 ] Alexander Ulanov commented on SPARK-10408: -- Here is the PR

[jira] [Updated] (SPARK-16234) Speculative Task may not be able to overwrite file

[ https://issues.apache.org/jira/browse/SPARK-16234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-16234: -- Description: resolved... (was: given spark.speculative set to true, I'm running a large spark

[jira] [Closed] (SPARK-16234) Speculative Task may not be able to overwrite file

[ https://issues.apache.org/jira/browse/SPARK-16234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers closed SPARK-16234. - Resolution: Resolved > Speculative Task may not be able to overwrite file >

[jira] [Resolved] (SPARK-16106) TaskSchedulerImpl does not correctly handle new executors on existing hosts

[ https://issues.apache.org/jira/browse/SPARK-16106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-16106. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 13826

[jira] [Resolved] (SPARK-16136) Flaky Test: TaskManagerSuite "Kill other task attempts when one attempt belonging to the same task succeeds"

[ https://issues.apache.org/jira/browse/SPARK-16136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-16136. -- Resolution: Fixed Fix Version/s: 2.1.0 Fixed by

[jira] [Updated] (SPARK-16234) Speculative Task may not be able to overwrite file

[ https://issues.apache.org/jira/browse/SPARK-16234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Chambers updated SPARK-16234: -- Description: given spark.speculative set to true, I'm running a large spark job with parquet

[jira] [Created] (SPARK-16234) Speculative Task may not be able to overwrite file

Bill Chambers created SPARK-16234: - Summary: Speculative Task may not be able to overwrite file Key: SPARK-16234 URL: https://issues.apache.org/jira/browse/SPARK-16234 Project: Spark Issue

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351826#comment-15351826 ] Kai Jiang commented on SPARK-15767: --- ping [~shvenkat] > Decision Tree Regression wrapper in SparkR >

[jira] [Updated] (SPARK-16233) test_sparkSQL.R is failing

[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16233: Description: By running {code} ./R/run-tests.sh {code} Getting error: {code} xin:spark xr$

[jira] [Commented] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351784#comment-15351784 ] Yin Huai commented on SPARK-16224: -- https://github.com/apache/spark/pull/13931 should fix the issue. Can

[jira] [Commented] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351783#comment-15351783 ] Apache Spark commented on SPARK-16224: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351780#comment-15351780 ] Yin Huai commented on SPARK-16224: -- https://github.com/apache/spark/pull/13931 should fix the issue. Can

[jira] [Updated] (SPARK-15581) MLlib 2.1 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15581: -- Description: This is a master list for MLlib improvements we are working on for the

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351727#comment-15351727 ] Apache Spark commented on SPARK-16228: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-16228) "Percentile" needs explicit cast to double

[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16228: Assignee: (was: Apache Spark) > "Percentile" needs explicit cast to double >

[jira] [Assigned] (SPARK-16228) "Percentile" needs explicit cast to double

[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16228: Assignee: Apache Spark > "Percentile" needs explicit cast to double >

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351708#comment-15351708 ] Dongjoon Hyun commented on SPARK-16228: --- Hi, [~epahomov] and [~srowen]. The root cause is that

[jira] [Commented] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351705#comment-15351705 ] Apache Spark commented on SPARK-16220: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351703#comment-15351703 ] Xin Ren commented on SPARK-16233: - I'm working on this > test_sparkSQL.R is failing >

[jira] [Created] (SPARK-16233) test_sparkSQL.R is failing

Xin Ren created SPARK-16233: --- Summary: test_sparkSQL.R is failing Key: SPARK-16233 URL: https://issues.apache.org/jira/browse/SPARK-16233 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16231: -- Assignee: Bryan Cutler > PySpark ML DataFrame example fails on Vector conversion >

[jira] [Resolved] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16231. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351697#comment-15351697 ] Egor Pahomov commented on SPARK-16228: -- [~srowen] "blocker" is questionable, I agree. I just

[jira] [Comment Edited] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351686#comment-15351686 ] Bill Chambers edited comment on SPARK-16220 at 6/27/16 7:53 PM: happy to

[jira] [Commented] (SPARK-16220) Revert ShowFunctions/ListFunctions in 2.0 to Reflect 1.6 Functionality

[ https://issues.apache.org/jira/browse/SPARK-16220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351686#comment-15351686 ] Bill Chambers commented on SPARK-16220: --- [~hvanhovell] I imagine I should just resolve this as

[jira] [Created] (SPARK-16232) Getting error by making columns using DataFrame

Inam Ur Rehman created SPARK-16232: -- Summary: Getting error by making columns using DataFrame Key: SPARK-16232 URL: https://issues.apache.org/jira/browse/SPARK-16232 Project: Spark Issue

[jira] [Commented] (SPARK-16232) Getting error by making columns using DataFrame

[ https://issues.apache.org/jira/browse/SPARK-16232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351655#comment-15351655 ] Sean Owen commented on SPARK-16232: --- This isn't nearly enough information, doesn't show any actual

[jira] [Commented] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351652#comment-15351652 ] Apache Spark commented on SPARK-16231: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16231: Assignee: Apache Spark > PySpark ML DataFrame example fails on Vector conversion >

[jira] [Assigned] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16231: Assignee: (was: Apache Spark) > PySpark ML DataFrame example fails on Vector

[jira] [Resolved] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16187. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by

[jira] [Updated] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16187: -- Assignee: yuhao yang > Implement util method for ML Matrix conversion in scala/java >

[jira] [Created] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

Bryan Cutler created SPARK-16231: Summary: PySpark ML DataFrame example fails on Vector conversion Key: SPARK-16231 URL: https://issues.apache.org/jira/browse/SPARK-16231 Project: Spark

[jira] [Commented] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

[ https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351636#comment-15351636 ] Tejas Patil commented on SPARK-16230: - For now, I can think of these two options: * Change scheduler

  1   2   >