[ https://issues.apache.org/jira/browse/DATAFU-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Efrat Rotenberg updated DATAFU-158: ----------------------------------- Attachment: DATAFU-158.patch > Document Spark explodeArray function behavior > --------------------------------------------- > > Key: DATAFU-158 > URL: https://issues.apache.org/jira/browse/DATAFU-158 > Project: DataFu > Issue Type: Improvement > Reporter: Shay Elbaz > Priority: Trivial > Attachments: DATAFU-158.patch > > > The `explodeArray` function counts the size of the output array by executing > Spark job internally on the input data. This should be documented, so users > could choose whether to persist the input DataFrame, or not. -- This message was sent by Atlassian Jira (v8.3.4#803005)