[ 
https://issues.apache.org/jira/browse/PIG-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176100#comment-15176100
 ] 

Rohini Palaniswamy commented on PIG-4819:
-----------------------------------------

+1

bq. But should I simply extend org.apache.pig.builtin.RANDOM from  
org.apache.pig.piggybank.evaluation.math.RANDOM
   Would be ideal, but if they use newer piggybank jar with older version of 
pig it will break. So I think duplicating code is better for now.


> RANDOM() udf can lead to missing or redundant records
> -----------------------------------------------------
>
>                 Key: PIG-4819
>                 URL: https://issues.apache.org/jira/browse/PIG-4819
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>            Assignee: Koji Noguchi
>         Attachments: pig-4819-v01.patch, pig-4819-v02.patch
>
>
> When RANDOM() value is used for grouping/distinct/etc, it breaks the 
> mapreduce rule and can lead to redundant or missing records. 
> Some discussion can be found in 
> https://issues.apache.org/jira/browse/PIG-3257?focusedCommentId=13669195#comment-13669195
> We should make RANDOM less random so that it'll produce the same sequence of 
> random values from the task retries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to