On 02/11/2019 04:33, Sijie Guo wrote:
I think it is already implemented. The Pulsar Presto Connector
supports predicate pushdown based on publish time.
Excellent, thank you.
I couldn't get Presto to work in Pulsar's standalone mode (#5370
<https://github.com/apache/pulsar/issues/5370>), but that's just waiting
for a newer version of Presto to be integrated (#5386
<https://github.com/apache/pulsar/pull/5386>)
Alternatively, we can leverage Pulsar's tiered storage mechanism and
implement a schema-aware columnar offloader to offload a row-based
segment into a columnar segment using Parquet or ORC format.
That's one item in our roadmap.
That would be awesome!