[jira] [Resolved] (IMPALA-8779) Add RowBatchQueue interface with an implementation backed by a std::queue

2019-09-09 Thread Sahil Takiar (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sahil Takiar resolved IMPALA-8779.
--
Resolution: Won't Fix

Marking this as 'Won't Fix' for now. There does not seem to be a strong need to 
add this in right now, given that there is no other use case for a generic 
{{RowBatch}} queue. The one used in the scan nodes has some unique requirements 
and re-factoring it to use a generic interface does not seem worth it. We can 
re-visit this later if we find a stronger use case for it.

> Add RowBatchQueue interface with an implementation backed by a std::queue
> -
>
> Key: IMPALA-8779
> URL: https://issues.apache.org/jira/browse/IMPALA-8779
> Project: IMPALA
>  Issue Type: Sub-task
>  Components: Backend
>Reporter: Sahil Takiar
>Assignee: Sahil Takiar
>Priority: Major
>
> Add a {{RowBatchQueue}} interface with an implementation backed by a 
> {{std::queue}}. Introducing a generic queue that can buffer {{RowBatch}}-es 
> will help with the implementation of {{BufferedPlanRootSink}}. Rather than 
> tie the {{BufferedPlanRootSink}} to a specific method of queuing row batches, 
> we can use an interface. In future patches, a {{RowBatchQueue}} backed by a 
> {{BufferedTupleStream}} can easily be switched out in 
> {{BufferedPlanRootSink}}.
> We should consider re-factoring the existing {{RowBatchQueue}} to use the new 
> interface. The KRPC receiver does some buffering of {{RowBatch}}-es as well 
> which might benefit from the new RowBatchQueue interface, and some more KRPC 
> buffering might be added inĀ IMPALA-6692.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org



[jira] [Resolved] (IMPALA-8779) Add RowBatchQueue interface with an implementation backed by a std::queue

2019-09-09 Thread Sahil Takiar (Jira)


 [ 
https://issues.apache.org/jira/browse/IMPALA-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sahil Takiar resolved IMPALA-8779.
--
Resolution: Won't Fix

Marking this as 'Won't Fix' for now. There does not seem to be a strong need to 
add this in right now, given that there is no other use case for a generic 
{{RowBatch}} queue. The one used in the scan nodes has some unique requirements 
and re-factoring it to use a generic interface does not seem worth it. We can 
re-visit this later if we find a stronger use case for it.

> Add RowBatchQueue interface with an implementation backed by a std::queue
> -
>
> Key: IMPALA-8779
> URL: https://issues.apache.org/jira/browse/IMPALA-8779
> Project: IMPALA
>  Issue Type: Sub-task
>  Components: Backend
>Reporter: Sahil Takiar
>Assignee: Sahil Takiar
>Priority: Major
>
> Add a {{RowBatchQueue}} interface with an implementation backed by a 
> {{std::queue}}. Introducing a generic queue that can buffer {{RowBatch}}-es 
> will help with the implementation of {{BufferedPlanRootSink}}. Rather than 
> tie the {{BufferedPlanRootSink}} to a specific method of queuing row batches, 
> we can use an interface. In future patches, a {{RowBatchQueue}} backed by a 
> {{BufferedTupleStream}} can easily be switched out in 
> {{BufferedPlanRootSink}}.
> We should consider re-factoring the existing {{RowBatchQueue}} to use the new 
> interface. The KRPC receiver does some buffering of {{RowBatch}}-es as well 
> which might benefit from the new RowBatchQueue interface, and some more KRPC 
> buffering might be added inĀ IMPALA-6692.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)