[jira] [Commented] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529457#comment-14529457 ] Qiping Li commented on SPARK-7332: -- Yeah, In our case we need to store the ActorRef of th

[jira] [Commented] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529458#comment-14529458 ] Qiping Li commented on SPARK-7332: -- Yeah, In our case we need to store the ActorRef of th

[jira] [Created] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-03 Thread Qiping Li (JIRA)
Qiping Li created SPARK-7332: Summary: RpcCallContext.sender has a different name from the original sender's name Key: SPARK-7332 URL: https://issues.apache.org/jira/browse/SPARK-7332 Project: Spark

[jira] [Updated] (SPARK-7181) External Sorter merge with aggregation go to an infinite loop when we have a total ordering

2015-04-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-7181: - Summary: External Sorter merge with aggregation go to an infinite loop when we have a total ordering (was

[jira] [Updated] (SPARK-7181) External Sorter merge with aggregation go to an infinite loop when we have a total ordering

2015-04-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-7181: - Description: In the function {{mergeWithAggregation}} of {{ExternalSorter.scala}}, when there is a total

[jira] [Updated] (SPARK-7181) External Sorter merge with aggregation go to an infinity loop when we have a total ordering

2015-04-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-7181: - Summary: External Sorter merge with aggregation go to an infinity loop when we have a total ordering (was

[jira] [Updated] (SPARK-7181) External Sorter merge with aggregation doesn't aggregate all the values for the same key when we have a total ordering

2015-04-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-7181: - Description: In the function {{mergeWithAggregation}} of {{ExternalSorter.scala}}, when there is a total

[jira] [Created] (SPARK-7181) External Sorter merge with aggregation doesn't aggregate all the values for the same key when we have a total ordering

2015-04-27 Thread Qiping Li (JIRA)
Qiping Li created SPARK-7181: Summary: External Sorter merge with aggregation doesn't aggregate all the values for the same key when we have a total ordering Key: SPARK-7181 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-22 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508445#comment-14508445 ] Qiping Li commented on SPARK-6932: -- The code of our prototype is at https://github.com/c

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-21 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504572#comment-14504572 ] Qiping Li commented on SPARK-6932: -- [~gq], {quote} `. If the reduceFunc rely on other r

[jira] [Comment Edited] (SPARK-6932) A Prototype of Parameter Server

2015-04-21 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504572#comment-14504572 ] Qiping Li edited comment on SPARK-6932 at 4/21/15 8:17 AM: --- [~gq

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-21 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504541#comment-14504541 ] Qiping Li commented on SPARK-6932: -- Hi, Xiangrui. Our implementation has the following ch

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-18 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501665#comment-14501665 ] Qiping Li commented on SPARK-6932: -- [~srowen] I'm OK to close this issue. But since there

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-17 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501043#comment-14501043 ] Qiping Li commented on SPARK-6932: -- Hi, Reza.Thanks for your attention. As I specified ab

[jira] [Comment Edited] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497483#comment-14497483 ] Qiping Li edited comment on SPARK-6932 at 4/16/15 2:47 AM: --- [~sr

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497483#comment-14497483 ] Qiping Li commented on SPARK-6932: -- [~srowen], thanks for your comments. {quote} Yes I'

[jira] [Updated] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-6932: - Description: h2. Introduction As specified in [SPARK-4590|https://issues.apache.org/jira/browse/SPARK-45

[jira] [Updated] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-6932: - Description: h2. Introduction As specified in [SPARK-4590|https://issues.apache.org/jira/browse/SPARK-45

[jira] [Updated] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-6932: - Description: h2. Introduction As specified in [SPARK-4590|https://issues.apache.org/jira/browse/SPARK-45

[jira] [Created] (SPARK-6932) A Prototype of Parameter Server

2015-04-15 Thread Qiping Li (JIRA)
Qiping Li created SPARK-6932: Summary: A Prototype of Parameter Server Key: SPARK-6932 URL: https://issues.apache.org/jira/browse/SPARK-6932 Project: Spark Issue Type: New Feature Compo

[jira] [Commented] (SPARK-4590) Early investigation of parameter server

2015-03-17 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364803#comment-14364803 ] Qiping Li commented on SPARK-4590: -- Hi, [~rezazadeh], thanks for your investigation. It i

[jira] [Created] (SPARK-3920) Add option to support aggregation using treeAggregate in decision tree

2014-10-12 Thread Qiping Li (JIRA)
Qiping Li created SPARK-3920: Summary: Add option to support aggregation using treeAggregate in decision tree Key: SPARK-3920 URL: https://issues.apache.org/jira/browse/SPARK-3920 Project: Spark

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-09-09 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14126791#comment-14126791 ] Qiping Li commented on SPARK-3272: -- Hi Joseph, I created a PR [#2332|https://github.com/a

[jira] [Comment Edited] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116247#comment-14116247 ] Qiping Li edited comment on SPARK-3272 at 8/30/14 5:41 AM: --- Hi J

[jira] [Comment Edited] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116247#comment-14116247 ] Qiping Li edited comment on SPARK-3272 at 8/30/14 5:42 AM: --- Hi J

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116247#comment-14116247 ] Qiping Li commented on SPARK-3272: -- Hi Joseph, I have clarified in [SPARK-2207|https://i

[jira] [Commented] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116245#comment-14116245 ] Qiping Li commented on SPARK-2207: -- As Joseph in [SPARK-3272|https://issues.apache.org/ji

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115088#comment-14115088 ] Qiping Li commented on SPARK-3272: -- Hi Joseph, sorry for the late reply, I still think we

[jira] [Created] (SPARK-3291) TestcaseName in createQueryTest should not contain ":"

2014-08-28 Thread Qiping Li (JIRA)
Qiping Li created SPARK-3291: Summary: TestcaseName in createQueryTest should not contain ":" Key: SPARK-3291 URL: https://issues.apache.org/jira/browse/SPARK-3291 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-28 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114591#comment-14114591 ] Qiping Li commented on SPARK-3272: -- Hi Joseph, thanks for your comment, I think checking

[jira] [Comment Edited] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113260#comment-14113260 ] Qiping Li edited comment on SPARK-2207 at 8/28/14 3:44 AM: --- To s

[jira] [Commented] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113260#comment-14113260 ] Qiping Li commented on SPARK-2207: -- To support minimum instances per node parameter, I t

[jira] [Created] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-27 Thread Qiping Li (JIRA)
Qiping Li created SPARK-3272: Summary: Calculate prediction for nodes separately from calculating information gain for splits in decision tree Key: SPARK-3272 URL: https://issues.apache.org/jira/browse/SPARK-3272

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113224#comment-14113224 ] Qiping Li commented on SPARK-3155: -- Joseph has submitted PR [#2125|https://github.com/apa

[jira] [Comment Edited] (SPARK-3155) Support DecisionTree pruning

2014-08-27 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113224#comment-14113224 ] Qiping Li edited comment on SPARK-3155 at 8/28/14 2:18 AM: --- Jose

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-26 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111884#comment-14111884 ] Qiping Li commented on SPARK-3155: -- Joseph, I agree with you, maybe I can try to deals wi

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-26 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111743#comment-14111743 ] Qiping Li commented on SPARK-3155: -- Hi, Manish and Joseph, thanks for your comments, I wi

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

2014-08-25 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110194#comment-14110194 ] Qiping Li commented on SPARK-3155: -- Hi Joseph, glad to see you have considered to support

[jira] [Commented] (SPARK-3022) FindBinsForLevel in decision tree should call findBin only once for each feature

2014-08-13 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096526#comment-14096526 ] Qiping Li commented on SPARK-3022: -- What's more, there's no need to store `feature2bins`

[jira] [Updated] (SPARK-3022) FindBinsForLevel in decision tree should call findBin only once for each feature

2014-08-13 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qiping Li updated SPARK-3022: - Description: `findbinsForLevel` is applied to every `LabeledPoint` to find bins for all nodes at a given

[jira] [Created] (SPARK-3022) FindBinsForLevel in decision tree should call findBin only once for each feature

2014-08-13 Thread Qiping Li (JIRA)
Qiping Li created SPARK-3022: Summary: FindBinsForLevel in decision tree should call findBin only once for each feature Key: SPARK-3022 URL: https://issues.apache.org/jira/browse/SPARK-3022 Project: Spark