[jira] [Updated] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16187: -- Assignee: yuhao yang > Implement util method for ML Matrix conversion in scala/java > -

[jira] [Resolved] (SPARK-16187) Implement util method for ML Matrix conversion in scala/java

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16187. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Resolved] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16231. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-16231) PySpark ML DataFrame example fails on Vector conversion

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16231: -- Assignee: Bryan Cutler > PySpark ML DataFrame example fails on Vector conversion >

[jira] [Resolved] (SPARK-16143) Group survival analysis methods in generated doc

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16143. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Updated] (SPARK-16242) Wrap the Matrix conversion utils in Python

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16242: -- Assignee: Yanbo Liang > Wrap the Matrix conversion utils in Python > --

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15352289#comment-15352289 ] Xiangrui Meng commented on SPARK-15799: --- [~sunrui] Maybe we can download the corres

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15352409#comment-15352409 ] Xiangrui Meng commented on SPARK-16144: --- Please hold because this should be combine

[jira] [Comment Edited] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15352409#comment-15352409 ] Xiangrui Meng edited comment on SPARK-16144 at 6/28/16 5:57 AM: ---

[jira] [Updated] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-27 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16144: -- Assignee: Xin Ren > Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predi

[jira] [Updated] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

2016-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16245: -- Assignee: Yanbo Liang > model loading backward compatibility for ml.feature.PCA > -

[jira] [Resolved] (SPARK-16245) model loading backward compatibility for ml.feature.PCA

2016-06-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16245. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Resolved] (SPARK-16140) Group k-means method in generated doc

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16140. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Group k-means method

[jira] [Updated] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16144: -- Assignee: Yanbo Liang (was: Xin Ren) > Add a separate Rd for ML generic methods: read.ml, writ

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15355599#comment-15355599 ] Xiangrui Meng commented on SPARK-16144: --- [~yanboliang] Do you have time to make a f

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15355601#comment-15355601 ] Xiangrui Meng commented on SPARK-16144: --- [~iamshrek] Thanks for helping! I asked Ya

[jira] [Resolved] (SPARK-16294) Labelling support for the include_example Jekyll plugin

2016-06-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16294. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13972 [https://g

[jira] [Created] (SPARK-16442) MLlib wrappers for SparkR 2.1

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16442: - Summary: MLlib wrappers for SparkR 2.1 Key: SPARK-16442 URL: https://issues.apache.org/jira/browse/SPARK-16442 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-16442) MLlib wrappers for SparkR 2.1

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-16442: - Assignee: Xiangrui Meng > MLlib wrappers for SparkR 2.1 > -

[jira] [Updated] (SPARK-15581) MLlib 2.1 Roadmap

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15581: -- Description: This is a master list for MLlib improvements we are working on for the next relea

[jira] [Created] (SPARK-16443) ALS wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16443: - Summary: ALS wrapper in SparkR Key: SPARK-16443 URL: https://issues.apache.org/jira/browse/SPARK-16443 Project: Spark Issue Type: Sub-task Repo

[jira] [Created] (SPARK-16444) IsotonicRegression in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16444: - Summary: IsotonicRegression in SparkR Key: SPARK-16444 URL: https://issues.apache.org/jira/browse/SPARK-16444 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16444: -- Target Version/s: 2.1.0 Description: Implement Isotonic Regression wrapper and other u

[jira] [Commented] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367924#comment-15367924 ] Xiangrui Meng commented on SPARK-16444: --- [~wangmiao1981] Would you be interested in

[jira] [Created] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16445: - Summary: Multilayer Perceptron Classifier wrapper in SparkR Key: SPARK-16445 URL: https://issues.apache.org/jira/browse/SPARK-16445 Project: Spark Issue Ty

[jira] [Updated] (SPARK-16137) Random Forest wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16137: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-16442 > Random Forest wrapper in

[jira] [Updated] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15767: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-16442 > Decision Tree Regression

[jira] [Created] (SPARK-16447) LDA wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16447: - Summary: LDA wrapper in SparkR Key: SPARK-16447 URL: https://issues.apache.org/jira/browse/SPARK-16447 Project: Spark Issue Type: Sub-task Repo

[jira] [Created] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-16446: - Summary: Gaussian Mixture Model wrapper in SparkR Key: SPARK-16446 URL: https://issues.apache.org/jira/browse/SPARK-16446 Project: Spark Issue Type: Sub-ta

[jira] [Commented] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15367937#comment-15367937 ] Xiangrui Meng commented on SPARK-16446: --- [~yanboliang] Do you have time to work on

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2016-07-08 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368547#comment-15368547 ] Xiangrui Meng commented on SPARK-15767: --- This was discussed in SPARK-14831. We shou

[jira] [Updated] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16444: -- Assignee: Miao Wang > Isotonic Regression wrapper in SparkR > -

[jira] [Updated] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16445: -- Assignee: Xin Ren > Multilayer Perceptron Classifier wrapper in SparkR > --

[jira] [Commented] (SPARK-16447) LDA wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371384#comment-15371384 ] Xiangrui Meng commented on SPARK-16447: --- Assigned. Thanks! > LDA wrapper in SparkR

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371382#comment-15371382 ] Xiangrui Meng commented on SPARK-16445: --- The target version is 2.1.0. So no strict

[jira] [Updated] (SPARK-16447) LDA wrapper in SparkR

2016-07-11 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16447: -- Assignee: Xusen Yin > LDA wrapper in SparkR > - > > Key: SP

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16538: -- Fix Version/s: 1.6.3 > Cannot use "SparkR::sql" > > >

[jira] [Updated] (SPARK-16579) Add a spark install function

2016-07-18 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16579: -- Assignee: Junyang Qian > Add a spark install function > > >

[jira] [Updated] (SPARK-16444) Isotonic Regression wrapper in SparkR

2016-07-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16444: -- Shepherd: Junyang Qian > Isotonic Regression wrapper in SparkR > --

[jira] [Commented] (SPARK-16446) Gaussian Mixture Model wrapper in SparkR

2016-07-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394639#comment-15394639 ] Xiangrui Meng commented on SPARK-16446: --- [~yanboliang] Any updates? > Gaussian Mix

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-26 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394642#comment-15394642 ] Xiangrui Meng commented on SPARK-16445: --- [~iamshrek] Any updates? > Multilayer Per

[jira] [Updated] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25994: -- Component/s: (was: GraphX) Graph > SPIP: Property Graphs, Cypher Queries,

[jira] [Updated] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25994: -- Issue Type: Epic (was: New Feature) > SPIP: Property Graphs, Cypher Queries, and Algorithms >

[jira] [Created] (SPARK-27299) Design: Property graph construction, save/load, and query APIs

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27299: - Summary: Design: Property graph construction, save/load, and query APIs Key: SPARK-27299 URL: https://issues.apache.org/jira/browse/SPARK-27299 Project: Spark

[jira] [Updated] (SPARK-27299) Design: Property graph construction, save/load, and query APIs

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27299: -- Description: Design doc for property graph and Cypher queries. * Construct a property graph.

[jira] [Updated] (SPARK-27299) Design: Property graph construction, save/load, and query APIs

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27299: -- Description: Design doc for property graph and Cypher queries. * Construct a property graph.

[jira] [Created] (SPARK-27300) Create the new graph projects in Spark

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27300: - Summary: Create the new graph projects in Spark Key: SPARK-27300 URL: https://issues.apache.org/jira/browse/SPARK-27300 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27302) Design: graph algorithms based on property graphs

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27302: - Summary: Design: graph algorithms based on property graphs Key: SPARK-27302 URL: https://issues.apache.org/jira/browse/SPARK-27302 Project: Spark Issue Typ

[jira] [Created] (SPARK-27303) PropertyGraph construction (Scala/Java)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27303: - Summary: PropertyGraph construction (Scala/Java) Key: SPARK-27303 URL: https://issues.apache.org/jira/browse/SPARK-27303 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27304) PropertyGraph save/load (Scala/Java)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27304: - Summary: PropertyGraph save/load (Scala/Java) Key: SPARK-27304 URL: https://issues.apache.org/jira/browse/SPARK-27304 Project: Spark Issue Type: Story

[jira] [Updated] (SPARK-27300) Create the new graph projects in Spark and set up build/test

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27300: -- Summary: Create the new graph projects in Spark and set up build/test (was: Create the new gr

[jira] [Created] (SPARK-27305) PropertyGraph Cypher query (Java/Scala)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27305: - Summary: PropertyGraph Cypher query (Java/Scala) Key: SPARK-27305 URL: https://issues.apache.org/jira/browse/SPARK-27305 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27306) PropertyGraph construction (Python)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27306: - Summary: PropertyGraph construction (Python) Key: SPARK-27306 URL: https://issues.apache.org/jira/browse/SPARK-27306 Project: Spark Issue Type: Story

[jira] [Updated] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-25994: -- Epic Name: Property Graph / Cypher / Algorithms > SPIP: Property Graphs, Cypher Queries, and A

[jira] [Updated] (SPARK-27306) PropertyGraph construction (Python)

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27306: -- Description: Python API and test for SPARK-27303. (was: Python API for SPARK-27303.) > Prope

[jira] [Created] (SPARK-27308) PropertyGraph Cypher query (Python)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27308: - Summary: PropertyGraph Cypher query (Python) Key: SPARK-27308 URL: https://issues.apache.org/jira/browse/SPARK-27308 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27307) PropertyGraph save/load (Python)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27307: - Summary: PropertyGraph save/load (Python) Key: SPARK-27307 URL: https://issues.apache.org/jira/browse/SPARK-27307 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27309) ProperGraph SparkSession adapter (Scala/Java)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27309: - Summary: ProperGraph SparkSession adapter (Scala/Java) Key: SPARK-27309 URL: https://issues.apache.org/jira/browse/SPARK-27309 Project: Spark Issue Type: S

[jira] [Created] (SPARK-27310) PropertyGraph SparkSession adapter (Python)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27310: - Summary: PropertyGraph SparkSession adapter (Python) Key: SPARK-27310 URL: https://issues.apache.org/jira/browse/SPARK-27310 Project: Spark Issue Type: Sto

[jira] [Created] (SPARK-27311) New graph component user guide (PropertyGraph / Query)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27311: - Summary: New graph component user guide (PropertyGraph / Query) Key: SPARK-27311 URL: https://issues.apache.org/jira/browse/SPARK-27311 Project: Spark Issu

[jira] [Updated] (SPARK-27300) Create the new graph projects in Spark and set up build/test

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27300: -- Description: * Create graph projects in Spark repo that works with both maven and sbt. * Add i

[jira] [Updated] (SPARK-27309) PropertyGraph SparkSession adapter (Scala/Java)

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27309: -- Summary: PropertyGraph SparkSession adapter (Scala/Java) (was: ProperGraph SparkSession adapt

[jira] [Updated] (SPARK-27309) PropertyGraph SparkSession adapter (Scala/Java)

2019-03-28 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27309: -- Description: Create SparkSession adapter to simply ProperGraph creation (Scala implicits? pend

[jira] [Created] (SPARK-27312) PropertyGraph <-> GraphX conversions

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27312: - Summary: PropertyGraph <-> GraphX conversions Key: SPARK-27312 URL: https://issues.apache.org/jira/browse/SPARK-27312 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27313) DataFrame-based PropertyGraph algorithms

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27313: - Summary: DataFrame-based PropertyGraph algorithms Key: SPARK-27313 URL: https://issues.apache.org/jira/browse/SPARK-27313 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27315) GraphX-based PropertyGraph algorithms

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27315: - Summary: GraphX-based PropertyGraph algorithms Key: SPARK-27315 URL: https://issues.apache.org/jira/browse/SPARK-27315 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27316) Query-based PropertyGraph algorithms

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27316: - Summary: Query-based PropertyGraph algorithms Key: SPARK-27316 URL: https://issues.apache.org/jira/browse/SPARK-27316 Project: Spark Issue Type: Story

[jira] [Created] (SPARK-27317) New graph component user guide (algorithms)

2019-03-28 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27317: - Summary: New graph component user guide (algorithms) Key: SPARK-27317 URL: https://issues.apache.org/jira/browse/SPARK-27317 Project: Spark Issue Type: Sto

[jira] [Commented] (SPARK-27299) Design: Property graph construction, save/load, and query APIs

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809291#comment-16809291 ] Xiangrui Meng commented on SPARK-27299: --- [~mju] Could you post the draft design do

[jira] [Assigned] (SPARK-27024) Design executor interface to support GPU resources

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-27024: - Assignee: Thomas Graves > Design executor interface to support GPU resources >

[jira] [Created] (SPARK-27360) Design: Standalone cluster mode support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27360: - Summary: Design: Standalone cluster mode support for GPU-aware scheduling Key: SPARK-27360 URL: https://issues.apache.org/jira/browse/SPARK-27360 Project: Spark

[jira] [Created] (SPARK-27361) Design: YARN support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27361: - Summary: Design: YARN support for GPU-aware scheduling Key: SPARK-27361 URL: https://issues.apache.org/jira/browse/SPARK-27361 Project: Spark Issue Type: S

[jira] [Created] (SPARK-27362) Design: Kubernetes support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27362: - Summary: Design: Kubernetes support for GPU-aware scheduling Key: SPARK-27362 URL: https://issues.apache.org/jira/browse/SPARK-27362 Project: Spark Issue T

[jira] [Created] (SPARK-27363) Design: Mesos support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27363: - Summary: Design: Mesos support for GPU-aware scheduling Key: SPARK-27363 URL: https://issues.apache.org/jira/browse/SPARK-27363 Project: Spark Issue Type:

[jira] [Created] (SPARK-27364) Design: User-facing APIs for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27364: - Summary: Design: User-facing APIs for GPU-aware scheduling Key: SPARK-27364 URL: https://issues.apache.org/jira/browse/SPARK-27364 Project: Spark Issue Typ

[jira] [Updated] (SPARK-27024) Design: Executor interface for cluster managers to support GPU resources

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27024: -- Summary: Design: Executor interface for cluster managers to support GPU resources (was: Desig

[jira] [Created] (SPARK-27365) Spark Jenkins setup to support GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27365: - Summary: Spark Jenkins setup to support GPU-aware scheduling Key: SPARK-27365 URL: https://issues.apache.org/jira/browse/SPARK-27365 Project: Spark Issue T

[jira] [Updated] (SPARK-27360) Standalone cluster mode support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27360: -- Summary: Standalone cluster mode support for GPU-aware scheduling (was: Design: Standalone cl

[jira] [Updated] (SPARK-27024) Executor interface for cluster managers to support GPU resources

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27024: -- Summary: Executor interface for cluster managers to support GPU resources (was: Design: Execu

[jira] [Updated] (SPARK-27362) Kubernetes support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27362: -- Summary: Kubernetes support for GPU-aware scheduling (was: Design: Kubernetes support for GPU

[jira] [Updated] (SPARK-27363) Mesos support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27363: -- Summary: Mesos support for GPU-aware scheduling (was: Design: Mesos support for GPU-aware sch

[jira] [Updated] (SPARK-27364) User-facing APIs for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27364: -- Summary: User-facing APIs for GPU-aware scheduling (was: Design: User-facing APIs for GPU-awa

[jira] [Updated] (SPARK-27361) YARN support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27361: -- Summary: YARN support for GPU-aware scheduling (was: Design: YARN support for GPU-aware sched

[jira] [Updated] (SPARK-27364) User-facing APIs for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27364: -- Description: Design and implement: * General guidelines for cluster managers to understand re

[jira] [Assigned] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-27005: - Assignee: Xingbo Jiang > Design sketch: Accelerator-aware scheduling >

[jira] [Created] (SPARK-27366) Spark scheduler internal changes to support GPU scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27366: - Summary: Spark scheduler internal changes to support GPU scheduling Key: SPARK-27366 URL: https://issues.apache.org/jira/browse/SPARK-27366 Project: Spark

[jira] [Updated] (SPARK-27005) Design sketch for SPIP discussion: Accelerator-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27005: -- Summary: Design sketch for SPIP discussion: Accelerator-aware scheduling (was: Design sketch:

[jira] [Resolved] (SPARK-27005) Design sketch for SPIP discussion: Accelerator-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-27005. --- Resolution: Done Fix Version/s: 3.0.0 I'm closing the ticket since SPIP passed vote.

[jira] [Assigned] (SPARK-27360) Standalone cluster mode support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-27360: - Assignee: Xiangrui Meng > Standalone cluster mode support for GPU-aware scheduling > --

[jira] [Created] (SPARK-27368) Design: Standalone supports GPU scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27368: - Summary: Design: Standalone supports GPU scheduling Key: SPARK-27368 URL: https://issues.apache.org/jira/browse/SPARK-27368 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-27369) Standalone support static conf to describe GPU resources

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27369: - Summary: Standalone support static conf to describe GPU resources Key: SPARK-27369 URL: https://issues.apache.org/jira/browse/SPARK-27369 Project: Spark Is

[jira] [Updated] (SPARK-27360) Standalone cluster mode support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27360: -- Description: Design work for the standalone manager to support GPU-aware scheduling: 1. stati

[jira] [Created] (SPARK-27370) spark-submit requests GPUs in standalone mode

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27370: - Summary: spark-submit requests GPUs in standalone mode Key: SPARK-27370 URL: https://issues.apache.org/jira/browse/SPARK-27370 Project: Spark Issue Type: S

[jira] [Created] (SPARK-27371) Standalone worker can auto discover GPUs

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27371: - Summary: Standalone worker can auto discover GPUs Key: SPARK-27371 URL: https://issues.apache.org/jira/browse/SPARK-27371 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-27372) Standalone executor process-level isolation to support GPU scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27372: - Summary: Standalone executor process-level isolation to support GPU scheduling Key: SPARK-27372 URL: https://issues.apache.org/jira/browse/SPARK-27372 Project: Spar

[jira] [Updated] (SPARK-27360) Standalone cluster mode support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27360: -- Description: Design and implement standalone manager support for GPU-aware scheduling: 1. sta

[jira] [Updated] (SPARK-27362) Kubernetes support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27362: -- Description: Design and implement k8s support for GPU-aware scheduling. > Kubernetes support f

[jira] [Created] (SPARK-27373) Design: Kubernetes support for GPU-aware scheduling

2019-04-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-27373: - Summary: Design: Kubernetes support for GPU-aware scheduling Key: SPARK-27373 URL: https://issues.apache.org/jira/browse/SPARK-27373 Project: Spark Issue T

[jira] [Updated] (SPARK-27365) Spark Jenkins to support testing GPU-aware scheduling features

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27365: -- Summary: Spark Jenkins to support testing GPU-aware scheduling features (was: Spark Jenkins s

[jira] [Updated] (SPARK-27365) Spark Jenkins supports testing GPU-aware scheduling features

2019-04-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-27365: -- Summary: Spark Jenkins supports testing GPU-aware scheduling features (was: Spark Jenkins to

  1   2   3   4   5   6   7   8   9   10   >