[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16014041#comment-16014041 ] Nick Pentreath commented on SPARK-6417: --- I think it's fairly safe to say there is not much bandwidth or support to put this into Spark itself. It can remain as an external package. Closing it off. > Add Linear Programming algorithm > - > > Key: SPARK-6417 > URL: https://issues.apache.org/jira/browse/SPARK-6417 > Project: Spark > Issue Type: New Feature > Components: MLlib >Reporter: Fan Jiang > Labels: features > > Linear programming is the problem of finding a vector x that minimizes a > linear function fTx subject to linear constraints: > minxfTx > such that one or more of the following hold: A·x ≤ b, Aeq·x = beq, l ≤ x ≤ u. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731333#comment-15731333 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- Here's my implementation inspired by Spark-TFOCS design: https://github.com/ehsanmok/spark-lp > Add Linear Programming algorithm > - > > Key: SPARK-6417 > URL: https://issues.apache.org/jira/browse/SPARK-6417 > Project: Spark > Issue Type: New Feature > Components: MLlib >Reporter: Fan Jiang > Labels: features > > Linear programming is the problem of finding a vector x that minimizes a > linear function fTx subject to linear constraints: > minxfTx > such that one or more of the following hold: A·x ≤ b, Aeq·x = beq, l ≤ x ≤ u. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009849#comment-15009849 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- As I am working on the implementation, I have some serious concerns/questions. 1) Since I am heavily using distributed matrix abstractions provided in linalg, I realized it's impossible for me to submit it as a separate package when the implementation is completed. I don't think it's possible to define new abstractions like Aaron Staple's TFOCS package, for this task. 2) Adding some functionalities like transforming a local matrix to a BlockMatrix is necessary, as the underlying matrix is a distributed BlockMatrix and that's the only distributed matrix data structure with minimal matrix operations suitable for this task (any suggestions?) 3) Because, there's no literature on LP in mapReduce, my only approach is primal-dual IPM but with underlying distributed matrix data structures, so can that be called a distributed LP solver? if so in what degree? Please let me know your opinion and it'd be great to have someone who is willing to do the code review and guide me before any submission as I'm relatively new to Scala. > Add Linear Programming algorithm > - > > Key: SPARK-6417 > URL: https://issues.apache.org/jira/browse/SPARK-6417 > Project: Spark > Issue Type: New Feature > Components: MLlib >Reporter: Fan Jiang > Labels: features > > Linear programming is the problem of finding a vector x that minimizes a > linear function fTx subject to linear constraints: > minxfTx > such that one or more of the following hold: A·x ≤ b, Aeq·x = beq, l ≤ x ≤ u. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14743896#comment-14743896 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- Thank you Joseph for the advice! I have started with the starter kit and fixed some annotations to get a sense of contributing to Spark. I am going to work on the LP implementations and perhaps submit it as a package. Regards > Add Linear Programming algorithm > - > > Key: SPARK-6417 > URL: https://issues.apache.org/jira/browse/SPARK-6417 > Project: Spark > Issue Type: New Feature > Components: MLlib >Reporter: Fan Jiang > Labels: features > > Linear programming is the problem of finding a vector x that minimizes a > linear function fTx subject to linear constraints: > minxfTx > such that one or more of the following hold: A·x ≤ b, Aeq·x = beq, l ≤ x ≤ u. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741389#comment-14741389 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- I'd like to implement LP, (and possibly use to for my research project). Can it be assigned to me? and any suggestions for the API and algorithms to implement? > Add Linear Programming algorithm > - > > Key: SPARK-6417 > URL: https://issues.apache.org/jira/browse/SPARK-6417 > Project: Spark > Issue Type: New Feature > Components: MLlib >Reporter: Fan Jiang > Labels: features > > Linear programming is the problem of finding a vector x that minimizes a > linear function fTx subject to linear constraints: > minxfTx > such that one or more of the following hold: A·x ≤ b, Aeq·x = beq, l ≤ x ≤ u. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm
[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741463#comment-14741463 ] Joseph K. Bradley commented on SPARK-6417: -- Have you contributed to Spark before? If not, I'd recommend starting on smaller tasks before working on a large JIRA like this. This link has a lot more info about contributing: [https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark] That said, if you are working on this for a research project, you should feel free to go ahead and develop it. I would recommend first posting it as a Spark Package [http://spark-packages.org/] since that will let others start using your code before it goes through the review process to get into Spark itself. If you run tests, it would be nice to see results posted here, to start the discussion about this task. Thanks! > Add Linear Programming algorithm > - > > Key: SPARK-6417 > URL: https://issues.apache.org/jira/browse/SPARK-6417 > Project: Spark > Issue Type: New Feature > Components: MLlib >Reporter: Fan Jiang > Labels: features > > Linear programming is the problem of finding a vector x that minimizes a > linear function fTx subject to linear constraints: > minxfTx > such that one or more of the following hold: A·x ≤ b, Aeq·x = beq, l ≤ x ≤ u. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
