[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-2927: Fix Version/s: (was: 0.17.0) 0.18.0 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.18.0 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-2927: Fix Version/s: (was: 0.16.0) 0.17.0 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.17.0 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2927: Fix Version/s: (was: 0.15.0) 0.16.0 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.16.0 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2927: Fix Version/s: (was: 0.14.0) 0.15.0 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.15.0 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-2927: Fix Version/s: (was: 0.13.0) 0.14.0 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.14.0 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-2927: Fix Version/s: (was: 0.12.0) 0.13.0 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.13.0 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julien Le Dem updated PIG-2927: --- Fix Version/s: (was: 0.11) 0.12 This will go in the next release as we are stabilizing the 0.11 branch > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.12 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2927: -- Attachment: PIG-2927-4.patch I radically refactored it because I was getting a lot of annoying errors. It could be refactored further (and made a lot cleaner), but would rather have some eyes on it and testing it. It now passes both the unit tests and the e2e tests (though for the e2e tests to pass, JRUBY_HOME has to be set in your environment...). Would love thoughts. I focused on trying to get it to work robustly instead of making it beautiful. I can refactor to make it beautiful later :) > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.11 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch, PIG-2927-4.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-2927: Fix Version/s: 0.11 > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Fix For: 0.11 > > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2927: -- Attachment: PIG-2927-3.patch Wasn't maven. Was me overlooking the file in the git branch. Woops. Thanks for your patience, Russell. > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch, > PIG-2927-3.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2927: -- Attachment: PIG-2927-2.patch Russell, thanks for your help on this :) I think it was picking up the dep from my environment. I think it should pull it from maven now. > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Attachments: PIG-2927-0.patch, PIG-2927-1.patch, PIG-2927-2.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2927: -- Attachment: PIG-2927-1.patch > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Attachments: PIG-2927-0.patch, PIG-2927-1.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Coveney updated PIG-2927: -- Attachment: PIG-2927-0.patch I just attached a patch that adds gem support. Any script registered as so: register script.rb using jruby as myfuncs; will be instantiated locally, and the set of dependencies across scripts will be shipped. Note: - JRUBY_HOME must be set on the client side. This is so we know where to find the gems! - you need to make sure to have a "require 'pigudf'" since it is instantiated on the client side (I could probably fix this, but I think forcing this is desirable for testing of scripts etc) Russell, Any chance you can try this out and see if it works? I'll add tests sometime... > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Jonathan Coveney >Priority: Minor > Attachments: PIG-2927-0.patch > > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Jurney updated PIG-2927: Component/s: parser Environment: JRuby UDFs Affects Version/s: 0.11 Assignee: Russell Jurney > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature > Components: parser >Affects Versions: 0.11 > Environment: JRuby UDFs >Reporter: Russell Jurney >Assignee: Russell Jurney >Priority: Minor > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2927) SHIP and use JRuby gems in JRuby UDFs
[ https://issues.apache.org/jira/browse/PIG-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy V. Ryaboy updated PIG-2927: --- Priority: Minor (was: Critical) Assignee: (was: Jonathan Coveney) Russel, "critical" is for critical bugs, not for desired new features. Example of something critical: Pig produces wrong data, Pig doesn't compile, Pig exhibits 10x performance regression. For further elucidation, I refer you to Wikipedia: http://en.wikipedia.org/wiki/The_Boy_Who_Cried_Wolf > SHIP and use JRuby gems in JRuby UDFs > - > > Key: PIG-2927 > URL: https://issues.apache.org/jira/browse/PIG-2927 > Project: Pig > Issue Type: New Feature >Reporter: Russell Jurney >Priority: Minor > > It would be great to use JRuby gems in JRuby UDFs without installing them on > all machines on the cluster. Some way to SHIP them automatically with the job > would be great. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira