[jira] [Commented] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2016-01-25 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116478#comment-15116478 ] Eron Wright commented on SPARK-4940: - Another benefit of maximizing the # of allocated executors is

[jira] [Commented] (SPARK-9704) Make some ML APIs public: VectorUDT, Identifiable, ProbabilisticClassifier

2015-08-06 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660791#comment-14660791 ] Eron Wright commented on SPARK-9704: - Thanks for accepting the suggestions, and I

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-07-31 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649759#comment-14649759 ] Eron Wright commented on SPARK-7400: - [~fliang] Seems that PR 7837 is erroneously

[jira] [Commented] (SPARK-8794) Column pruning isn't applied beneath sample

2015-07-17 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631599#comment-14631599 ] Eron Wright commented on SPARK-8794: - Would it be possible to backport this to 1.4.2?

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

2015-07-02 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612015#comment-14612015 ] Eron Wright commented on SPARK-7768: - Will this issue cover making VectorUDT public?

[jira] [Created] (SPARK-8794) Column pruning isn't applied to certain transformed DataFrames

2015-07-02 Thread Eron Wright (JIRA)
Eron Wright created SPARK-8794: --- Summary: Column pruning isn't applied to certain transformed DataFrames Key: SPARK-8794 URL: https://issues.apache.org/jira/browse/SPARK-8794 Project: Spark

[jira] [Created] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Eron Wright (JIRA)
Eron Wright created SPARK-8095: --- Summary: Spark package dependencies not resolved when package is in local-ivy-cache Key: SPARK-8095 URL: https://issues.apache.org/jira/browse/SPARK-8095 Project:

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572120#comment-14572120 ] Eron Wright commented on SPARK-8095: - Note that IBiblioResolver::setUsepoms is not

[jira] [Commented] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-03 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572179#comment-14572179 ] Eron Wright commented on SPARK-8095: - Tested with 1.4.0RC4. When package is in

[jira] [Commented] (SPARK-7205) Support local ivy cache in --packages

2015-06-03 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572123#comment-14572123 ] Eron Wright commented on SPARK-7205: - I see a potential issue here and filed

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

2015-05-23 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557550#comment-14557550 ] Eron Wright commented on SPARK-5874: - A suggestion, please pass the DataFrame (or at

[jira] [Commented] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-05-17 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547357#comment-14547357 ] Eron Wright commented on SPARK-6707: - A related enhancement would be to allow the

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-05-11 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538236#comment-14538236 ] Eron Wright commented on SPARK-7400: - Given the above, my proposal is to modify

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-05-10 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537078#comment-14537078 ] Eron Wright commented on SPARK-7400: - I tried to implement the UDT, but encountered

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

2015-05-06 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532054#comment-14532054 ] Eron Wright commented on SPARK-5874: - I suggest providing a fluent syntax or dsl for

[jira] [Created] (SPARK-7400) PortableDataStream UDT

2015-05-06 Thread Eron Wright (JIRA)
Eron Wright created SPARK-7400: --- Summary: PortableDataStream UDT Key: SPARK-7400 URL: https://issues.apache.org/jira/browse/SPARK-7400 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

2015-05-06 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530783#comment-14530783 ] Eron Wright commented on SPARK-7400: - I am thinking about ML scenarios here, with the