[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648552#comment-14648552 ] Jeremy Freeman commented on SPARK-9461: --- Ah, great to hear! Possibly slightly

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647884#comment-14647884 ] Jeremy Freeman commented on SPARK-9461: --- Interesting, the lack of failures on KMeans

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647186#comment-14647186 ] Jeremy Freeman commented on SPARK-9461: --- A couple initial observations: - the Scala

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647220#comment-14647220 ] Jeremy Freeman commented on SPARK-9461: --- I'd definitely be curious to see if these

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642207#comment-14642207 ] Jeremy Freeman commented on SPARK-4144: --- Sorry Chris! Why don't you have a go, I'd

[jira] [Commented] (SPARK-6722) Model import/export for StreamingKMeansModel

[ https://issues.apache.org/jira/browse/SPARK-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484772#comment-14484772 ] Jeremy Freeman commented on SPARK-6722: --- [~josephkb] Good question! Agreed it would

[jira] [Commented] (SPARK-6646) Spark 2.0: Rearchitecting Spark for Mobile Platforms

[ https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390176#comment-14390176 ] Jeremy Freeman commented on SPARK-6646: --- Very promising [~tdas]! We should evaluate

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming

[jira] [Updated] (SPARK-6345) Model update propagation during prediction in Streaming Regression

[ https://issues.apache.org/jira/browse/SPARK-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-6345: -- Description: During streaming regression analyses (Streaming Linear Regression and Streaming

[jira] [Created] (SPARK-6345) Model update propagation during prediction in Streaming Regression

Jeremy Freeman created SPARK-6345: - Summary: Model update propagation during prediction in Streaming Regression Key: SPARK-6345 URL: https://issues.apache.org/jira/browse/SPARK-6345 Project: Spark

[jira] [Comment Edited] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357497#comment-14357497 ] Jeremy Freeman edited comment on SPARK-2429 at 3/11/15 8:10 PM:

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357497#comment-14357497 ] Jeremy Freeman commented on SPARK-2429: --- Thanks for the update and contribution

[jira] [Commented] (SPARK-4144) Support incremental model training of Naive Bayes classifier

[ https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328726#comment-14328726 ] Jeremy Freeman commented on SPARK-4144: --- Hi all, I'd be happy to pick this up and

[jira] [Updated] (SPARK-5089) Vector conversion broken for non-float64 arrays

[ https://issues.apache.org/jira/browse/SPARK-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-5089: -- Description: Prior to performing many MLlib operations in PySpark (e.g. KMeans), data are

[jira] [Updated] (SPARK-5089) Vector conversion broken for non-float64 arrays

[ https://issues.apache.org/jira/browse/SPARK-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-5089: -- Description: Prior to performing many MLlib operations in PySpark (e.g. KMeans), data are

[jira] [Created] (SPARK-5089) Vector conversion broken for non-float64 arrays

Jeremy Freeman created SPARK-5089: - Summary: Vector conversion broken for non-float64 arrays Key: SPARK-5089 URL: https://issues.apache.org/jira/browse/SPARK-5089 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5089) Vector conversion broken for non-float64 arrays

[ https://issues.apache.org/jira/browse/SPARK-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-5089: -- Description: Prior to performing many MLlib operations in PySpark (e.g. KMeans), data are

[jira] [Created] (SPARK-4979) Add streaming logistic regression

Jeremy Freeman created SPARK-4979: - Summary: Add streaming logistic regression Key: SPARK-4979 URL: https://issues.apache.org/jira/browse/SPARK-4979 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-4980) Add decay factors to streaming linear methods

Jeremy Freeman created SPARK-4980: - Summary: Add decay factors to streaming linear methods Key: SPARK-4980 URL: https://issues.apache.org/jira/browse/SPARK-4980 Project: Spark Issue Type:

[jira] [Created] (SPARK-4969) Add binaryRecords support to streaming

Jeremy Freeman created SPARK-4969: - Summary: Add binaryRecords support to streaming Key: SPARK-4969 URL: https://issues.apache.org/jira/browse/SPARK-4969 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4727) Add dimensional RDDs (time series, spatial)

[ https://issues.apache.org/jira/browse/SPARK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234269#comment-14234269 ] Jeremy Freeman commented on SPARK-4727: --- Great to brainstorm about this RJ! To

[jira] [Commented] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227266#comment-14227266 ] Jeremy Freeman commented on SPARK-3995: --- Agree with [~mengxr], that's a better

[jira] [Commented] (SPARK-3254) Streaming K-Means

[ https://issues.apache.org/jira/browse/SPARK-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181080#comment-14181080 ] Jeremy Freeman commented on SPARK-3254: --- I'd like it to! I've got a PR ready to

[jira] [Created] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

Jeremy Freeman created SPARK-3995: - Summary: pyspark's sample methods do not work with NumPy 1.9 Key: SPARK-3995 URL: https://issues.apache.org/jira/browse/SPARK-3995 Project: Spark Issue

[jira] [Updated] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Created] (SPARK-3128) Use streaming test suite for StreamingLR

Jeremy Freeman created SPARK-3128: - Summary: Use streaming test suite for StreamingLR Key: SPARK-3128 URL: https://issues.apache.org/jira/browse/SPARK-3128 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2012) PySpark StatCounter with numpy arrays

[ https://issues.apache.org/jira/browse/SPARK-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079984#comment-14079984 ] Jeremy Freeman commented on SPARK-2012: --- [~davies] cool, that definitely makes sense

[jira] [Commented] (SPARK-2282) PySpark crashes if too many tasks complete quickly

[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069758#comment-14069758 ] Jeremy Freeman commented on SPARK-2282: --- Hi all, I'm the scientist, a couple updates

[jira] [Comment Edited] (SPARK-2282) PySpark crashes if too many tasks complete quickly

[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069758#comment-14069758 ] Jeremy Freeman edited comment on SPARK-2282 at 7/22/14 3:18 AM:

[jira] [Created] (SPARK-2438) Streaming + MLLib

Jeremy Freeman created SPARK-2438: - Summary: Streaming + MLLib Key: SPARK-2438 URL: https://issues.apache.org/jira/browse/SPARK-2438 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-2012) PySpark StatCounter with numpy arrays

Jeremy Freeman created SPARK-2012: - Summary: PySpark StatCounter with numpy arrays Key: SPARK-2012 URL: https://issues.apache.org/jira/browse/SPARK-2012 Project: Spark Issue Type: