[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460704#comment-13460704 ] Koji Noguchi commented on PIG-2662: --- bq. It is failing me on linux rhel5.6 + jvm1.6.0_32. However, now I see that it's succeeding on my Mac. I'll take a look tomorrow. Sorry for the delay. Created PIG-2926. > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440905#comment-13440905 ] Koji Noguchi commented on PIG-2662: --- bq. Koji, What OS, JVM are you using ? It is failing me on linux rhel5.6 + jvm1.6.0_32. However, now I see that it's succeeding on my Mac. I'll take a look tomorrow. > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440789#comment-13440789 ] Thejas M Nair commented on PIG-2662: Koji, What OS, JVM are you using ? > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440766#comment-13440766 ] Rajesh Balamohan commented on PIG-2662: --- With the trunk code, I quickly tried to run only this testcase. git status # On branch trunk nothing to commit (working directory clean) ant -Dtestcase=TestPoissonSampleLoader test-core [junit] Running org.apache.pig.test.TestPoissonSampleLoader [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 25.917 sec Plz let me know, if I am missing anything here to reproduce the issue you are seeing in your environment. > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440714#comment-13440714 ] Koji Noguchi commented on PIG-2662: --- bq. @Koji, which version of Pig are you using? Trunk. > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440706#comment-13440706 ] Rajesh Balamohan commented on PIG-2662: --- @Koji, which version of Pig are you using? > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440550#comment-13440550 ] Koji Noguchi commented on PIG-2662: --- It seems like org.apache.pig.test.TestPoissonSampleLoader.testNumSamples is failing with "expected:<47> but was:<42>" after this patch. Can someone take a look? > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair >Assignee: Rajesh Balamohan > Fix For: 0.11 > > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch, PIG-2662.3.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2662) skew join does not honor its config parameters
[ https://issues.apache.org/jira/browse/PIG-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434294#comment-13434294 ] Thejas M Nair commented on PIG-2662: Rajesh, With the patch, TestPoissonSampleLoader test cases fail. Can you please take a look ? Please let me know if you need any help with that. > skew join does not honor its config parameters > -- > > Key: PIG-2662 > URL: https://issues.apache.org/jira/browse/PIG-2662 > Project: Pig > Issue Type: Bug >Affects Versions: 0.9.2, 0.10.0 >Reporter: Thejas M Nair > Attachments: PIG-2662-0.9.2.patch, PIG-2662.2.patch > > > Skew join can be configured using pig.sksampler.samplerate and > pig.skewedjoin.reduce.memusage. But the section of code the retrieves the > config values from properties (PoissonSampleLoader.computeSamples) is not > getting called. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
