Ajantha Bhat created CARBONDATA-2784:
----------------------------------------
Summary: [SDK writer] Forever blocking wait with more than 20
batch of data, when consumer is dead due to data loading exception
Key: CARBONDATA-2784
URL: https://issues.apache.org/jira/browse/CARBONDATA-2784
Project: CarbonData
Issue Type: Bug
Reporter: Ajantha Bhat
Assignee: Ajantha Bhat
problem:
[SDK writer] Forever blocking wait with more than 21 batch of data, when
consumer is dead due to data loading exception (bad record / out of memory)
root cause:
When the consumer is dead due to data loading exception, writer will be
forcefully closed. but queue.clear() cleared only snapshot of entries (10
batches) and close is set to true after that. In between clear() and close =
true, If more than 10 batches of data is again put into queue. For 11th batch,
queue.put() goes for forever block as consumer is dead.
Solution:
set close = true, before clearing the queue. This will avoid adding more
batches to queue from write().
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
