Gaurangi Saxena created ARROW-9036: -------------------------------------- Summary: Null pointer exception when caching data frames) Key: ARROW-9036 URL: https://issues.apache.org/jira/browse/ARROW-9036 Project: Apache Arrow Issue Type: Bug Components: Java Affects Versions: 0.16.0 Reporter: Gaurangi Saxena
I get a NPE when I try to cache a DataFrame in spark with Arrow as read format. Stack Trace - java.lang.NullPointerExceptionjava.lang.NullPointerException at org.apache.arrow.vector.ipc.ReadChannel.readFully(ReadChannel.java:61) at org.apache.arrow.vector.ipc.message.MessageSerializer.readMessage(MessageSerializer.java:649) at org.apache.arrow.vector.ipc.message.MessageChannelReader.readNext(MessageChannelReader.java:58) at org.apache.arrow.vector.ipc.ArrowStreamReader.loadNextBatch(ArrowStreamReader.java:106) at com.google.cloud.spark.bigquery.ArrowBinaryIterator$ArrowReaderIterator.hasNext(ArrowBinaryIterator.scala:84) -- This message was sent by Atlassian Jira (v8.3.4#803005)