[jira] [Commented] (SPARK-24607) Distribute by rand() can lead to data inconsistency

2020-12-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243743#comment-17243743 ] Kent Yao commented on SPARK-24607: -- This could happen when the map stage retries, the same record that

[jira] [Commented] (SPARK-24607) Distribute by rand() can lead to data inconsistency

2018-06-21 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519119#comment-16519119 ] Liang-Chi Hsieh commented on SPARK-24607: - [~gostop_zlx] If you don't give a seed to {{rand}},

[jira] [Commented] (SPARK-24607) Distribute by rand() can lead to data inconsistency

2018-06-20 Thread zenglinxi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518230#comment-16518230 ] zenglinxi commented on SPARK-24607: --- [~viirya]  I have some tests, it seems like rand() func in

[jira] [Commented] (SPARK-24607) Distribute by rand() can lead to data inconsistency

2018-06-20 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518206#comment-16518206 ] Liang-Chi Hsieh commented on SPARK-24607: - Thanks [~mgaido]! As I check {{Rand}} expression,

[jira] [Commented] (SPARK-24607) Distribute by rand() can lead to data inconsistency

2018-06-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518196#comment-16518196 ] Marco Gaido commented on SPARK-24607: - [~viirya] please check the description in the Hive ticket.

[jira] [Commented] (SPARK-24607) Distribute by rand() can lead to data inconsistency

2018-06-20 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518184#comment-16518184 ] Liang-Chi Hsieh commented on SPARK-24607: - >From the following test, looks it is ok.