benraha opened a new pull request, #24: URL: https://github.com/apache/datafu/pull/24
Added collectLimitedList, A UDAF, which is like collect_list, but receives a parameter that limits the number of items to be collected, chosen randomly. This is useful when one wants to collect items from a skewed dataset or to sample records per group. Added a function `dedupRandomN` that uses collectLimitedList to select fixed random rows per key. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@datafu.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org