[
https://issues.apache.org/jira/browse/LENS-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sharad Agarwal updated LENS-251:
--------------------------------
Description:
For certain stores that allows streaming ingestion, to make the data available
immediately for querying, we need the notion of streaming update period or some
such.
Describing by example:
- lets say there are two drivers - D1 and D2.
- D1 queries storage S1
- D2 queries storage S2
S1 and S2 are part of the same Cube.
In S1 data is in hourly granularity loaded every hour, while S2 has data being
ingested continuously in streaming fashion and maintains last 5 hours window of
data.
Now based on the query time range we want to select the right driver.
was:For certain stores that allows streaming ingestion, to make the data
available immediately for querying, we need the notion of streaming update
period or some such.
> Support to query streaming data sources
> ---------------------------------------
>
> Key: LENS-251
> URL: https://issues.apache.org/jira/browse/LENS-251
> Project: Apache Lens
> Issue Type: New Feature
> Components: cube
> Reporter: Sharad Agarwal
>
> For certain stores that allows streaming ingestion, to make the data
> available immediately for querying, we need the notion of streaming update
> period or some such.
> Describing by example:
> - lets say there are two drivers - D1 and D2.
> - D1 queries storage S1
> - D2 queries storage S2
> S1 and S2 are part of the same Cube.
> In S1 data is in hourly granularity loaded every hour, while S2 has data
> being ingested continuously in streaming fashion and maintains last 5 hours
> window of data.
> Now based on the query time range we want to select the right driver.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
