[ 
https://issues.apache.org/jira/browse/IMPALA-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sahil Takiar resolved IMPALA-8779.
----------------------------------
    Resolution: Won't Fix

Marking this as 'Won't Fix' for now. There does not seem to be a strong need to 
add this in right now, given that there is no other use case for a generic 
{{RowBatch}} queue. The one used in the scan nodes has some unique requirements 
and re-factoring it to use a generic interface does not seem worth it. We can 
re-visit this later if we find a stronger use case for it.

> Add RowBatchQueue interface with an implementation backed by a std::queue
> -------------------------------------------------------------------------
>
>                 Key: IMPALA-8779
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8779
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Backend
>            Reporter: Sahil Takiar
>            Assignee: Sahil Takiar
>            Priority: Major
>
> Add a {{RowBatchQueue}} interface with an implementation backed by a 
> {{std::queue}}. Introducing a generic queue that can buffer {{RowBatch}}-es 
> will help with the implementation of {{BufferedPlanRootSink}}. Rather than 
> tie the {{BufferedPlanRootSink}} to a specific method of queuing row batches, 
> we can use an interface. In future patches, a {{RowBatchQueue}} backed by a 
> {{BufferedTupleStream}} can easily be switched out in 
> {{BufferedPlanRootSink}}.
> We should consider re-factoring the existing {{RowBatchQueue}} to use the new 
> interface. The KRPC receiver does some buffering of {{RowBatch}}-es as well 
> which might benefit from the new RowBatchQueue interface, and some more KRPC 
> buffering might be added inĀ IMPALA-6692.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to