[
https://issues.apache.org/jira/browse/DATAFU-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eyal Allweil closed DATAFU-158.
-------------------------------
> Document Spark explodeArray function behavior
> ---------------------------------------------
>
> Key: DATAFU-158
> URL: https://issues.apache.org/jira/browse/DATAFU-158
> Project: DataFu
> Issue Type: Improvement
> Reporter: Shay Elbaz
> Assignee: Eyal Allweil
> Priority: Trivial
> Fix For: 1.6.1
>
> Attachments: DATAFU-158.patch
>
>
> The `explodeArray` function counts the size of the output array by executing
> Spark job internally on the input data. This should be documented, so users
> could choose whether to persist the input DataFrame, or not.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)