[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-12 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743835#comment-15743835 ] liyunzhang_intel commented on PIG-4952: --- [~nkollar]: have replied your comments on rev

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731260#comment-15731260 ] liyunzhang_intel commented on PIG-4952: --- [~nkollar]: {quote} How can we test that we a

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731254#comment-15731254 ] liyunzhang_intel commented on PIG-4952: --- [~kexianda]: "spark.default.parallism" is

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730669#comment-15730669 ] Xianda Ke commented on PIG-4952: Hi [~kellyzly] & [~nkollar], how about this: {code} // if

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728334#comment-15728334 ] Nandor Kollar commented on PIG-4952: [~kellyzly] you search for the max default parallel

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728194#comment-15728194 ] Nandor Kollar commented on PIG-4952: This is simpler than I thought! Looks good, however

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728146#comment-15728146 ] liyunzhang_intel commented on PIG-4952: --- [~xuefuz]: Help to check in PIG-4952.patch a

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-12-07 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15728138#comment-15728138 ] Xianda Ke commented on PIG-4952: max parallelism value from parent RDDs seems OK. LGTM +1

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-23 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15692024#comment-15692024 ] liyunzhang_intel commented on PIG-4952: --- [~mohitsabharwal]: Have any thoughts on how t

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-23 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691931#comment-15691931 ] liyunzhang_intel commented on PIG-4952: --- [~mohitsabharwal]: Have any thoughts on how t

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-23 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15691496#comment-15691496 ] Nandor Kollar commented on PIG-4952: Apart from the blog post you found, I didn't find a

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-23 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689310#comment-15689310 ] liyunzhang_intel commented on PIG-4952: --- [~nkollar]: thanks for taking this big work.

[jira] [Commented] (PIG-4952) Calculate the value of parallism for spark mode

2016-11-22 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687248#comment-15687248 ] Nandor Kollar commented on PIG-4952: [~kellyzly] could you please explain, what should P