[ https://issues.apache.org/jira/browse/PIG-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy V. Ryaboy resolved PIG-2883. ------------------------------------ Resolution: Duplicate Trunk has KEYSET, VALUESET udfs for this very purpose. > MapKeysToBag and more UDFs to manipulate maps > --------------------------------------------- > > Key: PIG-2883 > URL: https://issues.apache.org/jira/browse/PIG-2883 > Project: Pig > Issue Type: Wish > Components: piggybank > Affects Versions: 0.10.0 > Reporter: Adam Kawa > Priority: Trivial > Original Estimate: 3h > Remaining Estimate: 3h > > HBaseStorage allows a user to load many HBase columns by specifying the > prefix. The problem is to access such columns later, if their names are > dynamically created and hold some meaningful information, which you want to > process as well (it seems to be relatively common). > Quick example: > {code} > User = LOAD 'hbase://user' USING HBaseStorage('friends:*', '-loadKey true') > AS (username:bytearray, friendMap:map[]); > UserAndFriend = FOREACH User GENERATE username, > friendMap#'What_should_I_to_put_here?'; > {code} > It would be convenient to easily get the full list of key/value pairs (or > just keys or values) from a map (something like MapKeysToBag, MapValuesToBag, > MapEntriesToBag UDFs). Having such UFDs, we may FLATTEN returned bag and > generate a relation that contains unnested keys or values extracted from the > map e.g.: > {code} > UserAndFriend = FOREACH Users GENERATE username, > FLATTEN(MapKeysToTuple(friendMap)) AS friendUsername; > {code} > I have already implemented such UDFs (here is repo: > https://github.com/kawaa/Pigitos and here is a fancy example: > http://bit.ly/Sf2KCP). I would love to add it to Piggybank (I have not found > such functionality there). > If you think that it is useful and missing, I can prepare a patch as soon as > possible. Please let me know. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira