[ 
https://issues.apache.org/jira/browse/OOZIE-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012229#comment-14012229
 ] 

Thiruvel Thirumoolan commented on OOZIE-1741:
---------------------------------------------

There are different ways in which we can use the partitions values that 
triggered the coordinator.

1. In queries as filters.
a. This can be all partition filters - (p1=v1 and p2=v2 and p3=v3) - when we 
want to look at only one complete partition spec.
b. By not specifying all the partition keys, say (p1 = v1) and not include p2 
and p3.

2. In metadata related queries.
a. Like 'alter table t1 drop partition (p1=v1, p2=v2, p3=v3) - where all 
partition keys are specified.
b. Might not include all partition keys, say 'alter table t1 drop partition 
(p1=v1) - where all partitions that match p1=v1 will be dropped.

3. In other miscellaneous scenarios
a. HCat/Metastore client APIs or even Hive Commands. Conditions like 'p1 > v1' 
or 'p1 != v1' etc are possible. Eg: When a new partition is registered, drop 
all the partitions which are older than 30 days.

I can't think of any other possibility. Please ensure there are no confusions 
w.r.t API usage. Will let [~rohini] add her comments.

> Add new coord EL function to get input partitions value string
> --------------------------------------------------------------
>
>                 Key: OOZIE-1741
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1741
>             Project: Oozie
>          Issue Type: Improvement
>            Reporter: Satish Mittal
>            Assignee: Satish Mittal
>         Attachments: OOZIE-1741-v2.patch, OOZIE-1741-v3.patch, 
> OOZIE-1741.patch.txt
>
>
> Currently oozie provides coord EL functions to get partition filter string 
> (where key-values are separated by AND)  for various action types - 
> java/pig/hive. However this doesn't work in other cases, e.g. hive action 
> that performs export/import of hive partition. In that case, the partition 
> value is expected to be in a different format: 
> (col1="value1",col2="value2"...). We need to add a new EL function that 
> returns partition value in the above format.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to