[ 
https://issues.apache.org/jira/browse/PIG-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sridhar Sailappan updated PIG-5261:
-----------------------------------
    Attachment: Patch_Pig_Macro_20170615.txt

> Support for macro based property definitions in Pig
> ---------------------------------------------------
>
>                 Key: PIG-5261
>                 URL: https://issues.apache.org/jira/browse/PIG-5261
>             Project: Pig
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: 0.16.0
>            Reporter: Sridhar Sailappan
>         Attachments: Patch_Pig_Macro_20170615.txt
>
>
> The attached patch provides support for property configurations with macro 
> based definitions (relying on variable expansion of Hadoop Configuration).
>  
> e.g., Consider the following definition of properties for HDFS.
> 1) The property "fs.defaultFS" is defined to have value "${fs.defaultFS.dev}"
> 2) The custom property "fs.defaultFS.dev" is defined to have value 
> "hdfs://dev-sandbox.domain.com:8020"
>  
> Now, when referencing the property "fs.defaultFS", the value should be 
> resolved to "hdfs://dev-sandbox.domain.com:8020".
>  
> This is typical variable expansion that is expected in Hadoop Configuration. 
> Refer: 
> https://hadoop.apache.org/docs/r2.6.0/api/org/apache/hadoop/conf/Configuration.html
> This functionality of variable expansion is not available with Pig. The 
> attached patch (on branch-0.16) addresses this need.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to