zuston commented on issue #198: URL: https://github.com/apache/incubator-uniffle/issues/198#issuecomment-1237810477
> For MEMORY_HDFS or MEMORY_LOCALFILE, it's normal to read incomplete index data, so we choose to ignore instead of failing fast. Oh, make sense. > > > We should fail fast when encountering BufferUnderflowException instead of ignoring. > > > > > > What I am curious about is whether this is caused by the fact that the data of the stream is not flushed normally or the stream is closed abnormally. > > Maybe shuffle index is writing.. Firstly, maybe we should reproduce this exception that make reader/writer operate this file at the same time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
