[
https://issues.apache.org/jira/browse/ARROW-8235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067954#comment-17067954
]
Joris Van den Bossche commented on ARROW-8235:
----------------------------------------------
Is the "KEEP" option useful? I am not aware of any system that does that.
Another possible option would be "ERROR" to raise an error any time there is a
null in the mask (that's eg what Julia does for missing)
> [C++][Compute] Filter out nulls by default
> ------------------------------------------
>
> Key: ARROW-8235
> URL: https://issues.apache.org/jira/browse/ARROW-8235
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++ - Compute
> Affects Versions: 0.16.0
> Reporter: Ben Kietzman
> Assignee: Ben Kietzman
> Priority: Major
> Fix For: 0.17.0
>
>
> The filter kernel currently emits null when a slot in the selection mask is
> null. For compatibility with Kleene logic systems like SQL, this behavior
> should be configurable. Provide an option enumeration:
> {code}
> struct FilterOptions {
> enum NullSelectionBehavior {
> /// null slots in the selection mask will drop the filtered value
> DROP,
> /// null slots in the selection mask will keep the filtered value
> KEEP,
> /// null slots in the selection mask will replace the filtered value with
> null
> EMIT_NULL,
> } null_selection_behavior;
> };
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
