Bryan Cutler created SPARK-22534: ------------------------------------ Summary: Add integration test case to explicitly verify optional validity buffer Key: SPARK-22534 URL: https://issues.apache.org/jira/browse/SPARK-22534 Project: Spark Issue Type: Test Components: Tests Affects Versions: 0.8.0 Reporter: Bryan Cutler
When the null count of a Field is 0 the validity buffer is optional in a RecordBatch message. From ARROW-1476, integration tests were failing because of this (see discussion here https://github.com/apache/arrow/pull/1316#issuecomment-344439955). The failure occurred due to chance of the random seed for generating the validity buffer. We should explicitly test this case for integration testing in the future. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org