Yesh created ARROW-13991: ---------------------------- Summary: [C++][Dataset] - Dataset write to accept mask array to include/exclude rows Key: ARROW-13991 URL: https://issues.apache.org/jira/browse/ARROW-13991 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Yesh
Currently filesystem union datset is built out using individual in-memory tables. Prior to building out these tables into union dataset a complex filter step has already determined the rows to excluded/included via a mask array. The ask is for this mask/array to be incorporated into writer side of of the union dataset or fragments to eliminate or include rows in final file. This ask if incorporated eliminates an additional step in the application to filter out rows in a table. -- This message was sent by Atlassian Jira (v8.3.4#803005)