[jira] [Commented] (PIG-4160) Provide a way to pass local jars in pig.additional.jars when using a remote url for a script
[ https://issues.apache.org/jira/browse/PIG-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191484#comment-14191484 ] Daniel Dai commented on PIG-4160: - PIG-4160-changepropertyname.patch committed. > Provide a way to pass local jars in pig.additional.jars when using a remote > url for a script > > > Key: PIG-4160 > URL: https://issues.apache.org/jira/browse/PIG-4160 > Project: Pig > Issue Type: Improvement > Components: impl >Affects Versions: 0.14.0 >Reporter: Andrew C. Oliver >Assignee: Andrew C. Oliver > Labels: patch > Fix For: 0.14.0 > > Attachments: PIG-4160-2.patch, PIG-4160-3.patch, PIG-4160-4.patch, > PIG-4160-changepropertyname.patch, forcelocal.trunk.patch, > forcelocal.withtests.patch > > Original Estimate: 3h > Remaining Estimate: 3h > > patch adds a -j/forcelocaljars flag which if enabled allows you to do > pig -j -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig > thus loading the pig script REMOTELY > while loading the jar files LOCALLY > One does this to avoid a single point of failure but avoid one central > interversion dependent repository for all the jars across all teams/projects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4160) Provide a way to pass local jars in pig.additional.jars when using a remote url for a script
[ https://issues.apache.org/jira/browse/PIG-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191469#comment-14191469 ] Rohini Palaniswamy commented on PIG-4160: - pig.additional.jars.uris sounds good. +1 for that change. > Provide a way to pass local jars in pig.additional.jars when using a remote > url for a script > > > Key: PIG-4160 > URL: https://issues.apache.org/jira/browse/PIG-4160 > Project: Pig > Issue Type: Improvement > Components: impl >Affects Versions: 0.14.0 >Reporter: Andrew C. Oliver >Assignee: Andrew C. Oliver > Labels: patch > Fix For: 0.14.0 > > Attachments: PIG-4160-2.patch, PIG-4160-3.patch, PIG-4160-4.patch, > forcelocal.trunk.patch, forcelocal.withtests.patch > > Original Estimate: 3h > Remaining Estimate: 3h > > patch adds a -j/forcelocaljars flag which if enabled allows you to do > pig -j -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig > thus loading the pig script REMOTELY > while loading the jar files LOCALLY > One does this to avoid a single point of failure but avoid one central > interversion dependent repository for all the jars across all teams/projects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4160) Provide a way to pass local jars in pig.additional.jars when using a remote url for a script
[ https://issues.apache.org/jira/browse/PIG-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191466#comment-14191466 ] Daniel Dai commented on PIG-4160: - Agree pig.additional.jars.comma is a weird name. How about "pig.additional.jars.uris"? I prefer a simple logic to parse the string, otherwise it is hard to explain to the user and might cause unexpected result. > Provide a way to pass local jars in pig.additional.jars when using a remote > url for a script > > > Key: PIG-4160 > URL: https://issues.apache.org/jira/browse/PIG-4160 > Project: Pig > Issue Type: Improvement > Components: impl >Affects Versions: 0.14.0 >Reporter: Andrew C. Oliver >Assignee: Andrew C. Oliver > Labels: patch > Fix For: 0.14.0 > > Attachments: PIG-4160-2.patch, PIG-4160-3.patch, PIG-4160-4.patch, > forcelocal.trunk.patch, forcelocal.withtests.patch > > Original Estimate: 3h > Remaining Estimate: 3h > > patch adds a -j/forcelocaljars flag which if enabled allows you to do > pig -j -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig > thus loading the pig script REMOTELY > while loading the jar files LOCALLY > One does this to avoid a single point of failure but avoid one central > interversion dependent repository for all the jars across all teams/projects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4160) Provide a way to pass local jars in pig.additional.jars when using a remote url for a script
[ https://issues.apache.org/jira/browse/PIG-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191348#comment-14191348 ] Rohini Palaniswamy commented on PIG-4160: - [~daijy], pig.additional.jars.comma - naming sounds weird. Would it be possible to just support both : and , in pig.additional.jars itself and mention in documentation to use , as separator if path has URIs. Can split on , if present in the path else fall back to spliting on : > Provide a way to pass local jars in pig.additional.jars when using a remote > url for a script > > > Key: PIG-4160 > URL: https://issues.apache.org/jira/browse/PIG-4160 > Project: Pig > Issue Type: Improvement > Components: impl >Affects Versions: 0.14.0 >Reporter: Andrew C. Oliver >Assignee: Andrew C. Oliver > Labels: patch > Fix For: 0.14.0 > > Attachments: PIG-4160-2.patch, PIG-4160-3.patch, PIG-4160-4.patch, > forcelocal.trunk.patch, forcelocal.withtests.patch > > Original Estimate: 3h > Remaining Estimate: 3h > > patch adds a -j/forcelocaljars flag which if enabled allows you to do > pig -j -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig > thus loading the pig script REMOTELY > while loading the jar files LOCALLY > One does this to avoid a single point of failure but avoid one central > interversion dependent repository for all the jars across all teams/projects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4160) Provide a way to pass local jars in pig.additional.jars when using a remote url for a script
[ https://issues.apache.org/jira/browse/PIG-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190877#comment-14190877 ] Daniel Dai commented on PIG-4160: - Thanks [~acoliver] for discovering the issue and share the initial fix. > Provide a way to pass local jars in pig.additional.jars when using a remote > url for a script > > > Key: PIG-4160 > URL: https://issues.apache.org/jira/browse/PIG-4160 > Project: Pig > Issue Type: Improvement > Components: impl >Affects Versions: 0.14.0 >Reporter: Andrew C. Oliver >Assignee: Andrew C. Oliver > Labels: patch > Fix For: 0.14.0 > > Attachments: PIG-4160-2.patch, PIG-4160-3.patch, PIG-4160-4.patch, > forcelocal.trunk.patch, forcelocal.withtests.patch > > Original Estimate: 3h > Remaining Estimate: 3h > > patch adds a -j/forcelocaljars flag which if enabled allows you to do > pig -j -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig > thus loading the pig script REMOTELY > while loading the jar files LOCALLY > One does this to avoid a single point of failure but avoid one central > interversion dependent repository for all the jars across all teams/projects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (PIG-4160) Provide a way to pass local jars in pig.additional.jars when using a remote url for a script
[ https://issues.apache.org/jira/browse/PIG-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190848#comment-14190848 ] Thejas M Nair commented on PIG-4160: +1 > Provide a way to pass local jars in pig.additional.jars when using a remote > url for a script > > > Key: PIG-4160 > URL: https://issues.apache.org/jira/browse/PIG-4160 > Project: Pig > Issue Type: Improvement > Components: impl >Affects Versions: 0.14.0 >Reporter: Andrew C. Oliver > Labels: patch > Fix For: 0.14.0 > > Attachments: PIG-4160-2.patch, PIG-4160-3.patch, PIG-4160-4.patch, > forcelocal.trunk.patch, forcelocal.withtests.patch > > Original Estimate: 3h > Remaining Estimate: 3h > > patch adds a -j/forcelocaljars flag which if enabled allows you to do > pig -j -useHCatalog hdfs://myserver:8020/load/scripts/mydir/myscript.pig > thus loading the pig script REMOTELY > while loading the jar files LOCALLY > One does this to avoid a single point of failure but avoid one central > interversion dependent repository for all the jars across all teams/projects. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
