[ https://issues.apache.org/jira/browse/SPARK-22534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254450#comment-16254450 ]
Bryan Cutler edited comment on SPARK-22534 at 11/15/17 11:37 PM: ----------------------------------------------------------------- Opened by mistake for wrong project. was (Author: bryanc): Opened by mistake > Add integration test case to explicitly verify optional validity buffer > ----------------------------------------------------------------------- > > Key: SPARK-22534 > URL: https://issues.apache.org/jira/browse/SPARK-22534 > Project: Spark > Issue Type: Test > Components: Tests > Affects Versions: 0.8.0 > Reporter: Bryan Cutler > > When the null count of a Field is 0 the validity buffer is optional in a > RecordBatch message. From ARROW-1476, integration tests were failing because > of this (see discussion here > https://github.com/apache/arrow/pull/1316#issuecomment-344439955). The > failure occurred due to chance of the random seed for generating the validity > buffer. We should explicitly test this case for integration testing in the > future. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org