Actually I'd suggest the opposite approach: use Scan if you want a stream.
It can handle almost any number of results (you might want to set
druid.broker.http.maxQueuedBytes to 1000 or so if you are doing large
resultsets; this will likely be the default in the future).
With Scan queries,
You can try using Select query instead of scan. Select provides pagination
and takes more resources compared to scan queries. Scan queries provide
result in stream mode. Here is link for further reading
https://druid.apache.org/docs/latest/querying/scan-query.html
On Wed, Dec 11, 2019 at 2:06 AM
Hi,
We are using axios to make http call to druid via node js application.
Since the data might be huge we are seeing memory issues at the client side
while loading data to a variable. Instead, is there a way to receive data
as stream and process it.
Please share details and example if possible.
