[jira] [Assigned] (SPARK-9531) UnsafeFixedWidthAggregationMap should be able to turn itself into an UnsafeKVExternalSorter

2015-08-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9531: --- Assignee: Reynold Xin (was: Apache Spark) > UnsafeFixedWidthAggregationMap should be able to

[jira] [Commented] (SPARK-8612) Yarn application status is misreported for failed PySpark apps.

2015-08-01 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650564#comment-14650564 ] Neelesh Srinivas Salian commented on SPARK-8612: Similar to SPARK-7736? >

[jira] [Updated] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

2015-08-01 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated SPARK-9514: --- Attachment: SPARK-9514.patch Patch attached. I put EventHubsReceiver in external folder and added an

[jira] [Updated] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8874: - Assignee: Manoj Kumar > Add missing methods in Word2Vec ML > -

[jira] [Commented] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

2015-08-01 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650568#comment-14650568 ] Nan Zhu commented on SPARK-9514: Hi, [~shanyu], in Spark, we usually submit patches via G

[jira] [Updated] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8874: - Component/s: (was: PySpark) > Add missing methods in Word2Vec ML > ---

[jira] [Updated] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8874: - Component/s: PySpark > Add missing methods in Word2Vec ML > --

[jira] [Commented] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650570#comment-14650570 ] Joseph K. Bradley commented on SPARK-8874: -- [~MechCoder] I think this JIRA was or

[jira] [Comment Edited] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650570#comment-14650570 ] Joseph K. Bradley edited comment on SPARK-8874 at 8/2/15 1:14 AM: --

[jira] [Resolved] (SPARK-9495) Support prefix generation for date / timestamp data type

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9495. Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.5.0 > Support prefix generat

[jira] [Commented] (SPARK-7402) JSON serialization of params

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650594#comment-14650594 ] Joseph K. Bradley commented on SPARK-7402: -- I'm switching this to 1.6. > JSON se

[jira] [Updated] (SPARK-7402) JSON serialization of params

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7402: - Target Version/s: 1.6.0 (was: 1.5.0) > JSON serialization of params > ---

[jira] [Updated] (SPARK-8520) Improve GLM's scalability on number of features

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8520: - Target Version/s: 1.6.0 (was: 1.5.0) > Improve GLM's scalability on number of features >

[jira] [Commented] (SPARK-6517) Bisecting k-means clustering

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650595#comment-14650595 ] Joseph K. Bradley commented on SPARK-6517: -- I'm sorry, but I think we'll need to

[jira] [Updated] (SPARK-6346) Use faster converging optimization method in MLlib

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6346: - Target Version/s: (was: 1.5.0) > Use faster converging optimization method in MLlib > --

[jira] [Updated] (SPARK-6517) Bisecting k-means clustering

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6517: - Target Version/s: 1.6.0 (was: 1.5.0) > Bisecting k-means clustering > ---

[jira] [Commented] (SPARK-6346) Use faster converging optimization method in MLlib

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650596#comment-14650596 ] Joseph K. Bradley commented on SPARK-6346: -- Unsetting target version from 1.5. W

[jira] [Updated] (SPARK-5256) Improving MLlib optimization APIs

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5256: - Affects Version/s: (was: 1.2.0) Target Version/s: 1.6.0 > Improving MLlib optimiz

[jira] [Updated] (SPARK-4526) Gradient should be added batch computing interface

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4526: - Target Version/s: (was: 1.5.0) > Gradient should be added batch computing interface > --

[jira] [Commented] (SPARK-4526) Gradient should be added batch computing interface

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650598#comment-14650598 ] Joseph K. Bradley commented on SPARK-4526: -- I'm going to unset the target version

[jira] [Updated] (SPARK-7146) Should ML sharedParams be a public API?

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7146: - Target Version/s: 1.6.0 (was: 1.5.0) > Should ML sharedParams be a public API? >

[jira] [Created] (SPARK-9532) Standardize checks for Predictor and other prediction abstractions

2015-08-01 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9532: Summary: Standardize checks for Predictor and other prediction abstractions Key: SPARK-9532 URL: https://issues.apache.org/jira/browse/SPARK-9532 Project: Spa

[jira] [Updated] (SPARK-5535) Add parameter for storage levels.

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5535: - Target Version/s: 1.6.0 (was: 1.5.0) > Add parameter for storage levels. > --

[jira] [Updated] (SPARK-5114) Should Evaluator be a PipelineStage

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5114: - Issue Type: Sub-task (was: Question) Parent: SPARK-5874 > Should Evaluator be a P

[jira] [Updated] (SPARK-7809) MultivariateOnlineSummarizer should allow users to configure what to compute

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7809: - Target Version/s: 1.6.0 (was: 1.5.0) > MultivariateOnlineSummarizer should allow users to

[jira] [Updated] (SPARK-7376) Python: Add validation functionality to individual Param

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7376: - Target Version/s: 1.6.0 (was: 1.5.0) > Python: Add validation functionality to individual

[jira] [Updated] (SPARK-5832) Add Affinity Propagation clustering algorithm

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5832: - Target Version/s: 1.6.0 (was: 1.5.0) > Add Affinity Propagation clustering algorithm > --

[jira] [Commented] (SPARK-5832) Add Affinity Propagation clustering algorithm

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650600#comment-14650600 ] Joseph K. Bradley commented on SPARK-5832: -- It sounds like we need some more disc

[jira] [Resolved] (SPARK-8269) string function: initcap

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8269. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7850 [https://github.com/

[jira] [Updated] (SPARK-9191) Add ml.PCA user guide and code examples

2015-08-01 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9191: - Shepherd: Joseph K. Bradley > Add ml.PCA user guide and code examples > --

[jira] [Resolved] (SPARK-8188) date/time function: from_utc_timestamp

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8188. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7847 [https://github.com/

[jira] [Resolved] (SPARK-8185) date/time function: datediff

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8185. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7847 [https://github.com/

[jira] [Resolved] (SPARK-8191) date/time function: to_utc_timestamp

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8191. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7847 [https://github.com/

[jira] [Resolved] (SPARK-9459) avoid copy for UTF8String during unsafe sorting

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9459. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7840 [https://github.com/

[jira] [Assigned] (SPARK-9527) PrefixSpan.run should return a PrefixSpanModel instead of an RDD

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-9527: Assignee: Xiangrui Meng > PrefixSpan.run should return a PrefixSpanModel instead of an RDD

[jira] [Resolved] (SPARK-9000) Support generic item type in PrefixSpan

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9000. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7837 [https://githu

[jira] [Updated] (SPARK-9000) Support generic item type in PrefixSpan

2015-08-01 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9000: - Assignee: Feynman Liang > Support generic item type in PrefixSpan > --

[jira] [Created] (SPARK-9533) Add missing methods in Word2Vec ML (Python API)

2015-08-01 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-9533: -- Summary: Add missing methods in Word2Vec ML (Python API) Key: SPARK-9533 URL: https://issues.apache.org/jira/browse/SPARK-9533 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-01 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650619#comment-14650619 ] Manoj Kumar commented on SPARK-8874: Done. Thanks. > Add missing methods in Word2Vec

[jira] [Updated] (SPARK-7497) test_count_by_value_and_window is flaky

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7497: -- Assignee: (was: Davies Liu) > test_count_by_value_and_window is flaky >

[jira] [Commented] (SPARK-9370) Support DecimalType in UnsafeRow

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650621#comment-14650621 ] Davies Liu commented on SPARK-9370: --- This is fixed by https://github.com/apache/spark/pu

[jira] [Resolved] (SPARK-9370) Support DecimalType in UnsafeRow

2015-08-01 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9370. --- Resolution: Fixed Fix Version/s: 1.5.0 > Support DecimalType in UnsafeRow > ---

[jira] [Resolved] (SPARK-9529) Improve sort on Decimal

2015-08-01 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9529. Resolution: Fixed Fix Version/s: 1.5.0 > Improve sort on Decimal > --- >

<    1   2