Gaurangi Saxena created ARROW-9036:
--------------------------------------
Summary: Null pointer exception when caching data frames)
Key: ARROW-9036
URL: https://issues.apache.org/jira/browse/ARROW-9036
Project: Apache Arrow
Issue Type: Bug
Components: Java
Affects Versions: 0.16.0
Reporter: Gaurangi Saxena
I get a NPE when I try to cache a DataFrame in spark with Arrow as read format.
Stack Trace -
java.lang.NullPointerExceptionjava.lang.NullPointerException at
org.apache.arrow.vector.ipc.ReadChannel.readFully(ReadChannel.java:61) at
org.apache.arrow.vector.ipc.message.MessageSerializer.readMessage(MessageSerializer.java:649)
at
org.apache.arrow.vector.ipc.message.MessageChannelReader.readNext(MessageChannelReader.java:58)
at
org.apache.arrow.vector.ipc.ArrowStreamReader.loadNextBatch(ArrowStreamReader.java:106)
at
com.google.cloud.spark.bigquery.ArrowBinaryIterator$ArrowReaderIterator.hasNext(ArrowBinaryIterator.scala:84)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)