[jira] [Commented] (KUDU-1683) Kudu client support for pushing runtime min/max filters
[ https://issues.apache.org/jira/browse/KUDU-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124326#comment-17124326 ] Grant Henke commented on KUDU-1683: --- >From some recent discussions it looks like the ability to add filters after a >scan has started has a significantly reduced impact based on: * In Impala/Parquet we have seen limited cases where it's beneficial to start the scan before filters arrive, and add them later. In the majority of cases it makes sense to wait for them to arrive instead (waiting up to 60s for example) * With IMPALA-9792/KUDU-2437 there will be more smaller scans and we can add the filters to the new scans as when they arrive. > Kudu client support for pushing runtime min/max filters > --- > > Key: KUDU-1683 > URL: https://issues.apache.org/jira/browse/KUDU-1683 > Project: Kudu > Issue Type: New Feature > Components: client, perf >Affects Versions: 1.0.0 >Reporter: Matthew Jacobs >Priority: Major > Labels: impala, roadmap-candidate > > Impala would like to generate runtime min/max filters to be pushed to Kudu, > at least for scan tokens that haven't been opened yet. > https://issues.cloudera.org/browse/IMPALA-4252 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KUDU-1683) Kudu client support for pushing runtime min/max filters
[ https://issues.apache.org/jira/browse/KUDU-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367768#comment-16367768 ] Thomas Tauber-Marshall commented on KUDU-1683: -- AFAIK, the proposal to apply predicates mid-scan hasn't been implemented (at least, Impala doesn't use this functionality currently), so you could maybe file another JIRA for that so that we don't lose the idea, but I don't think that's very important to Impala in the short term so I would say this JIRA can be closed. > Kudu client support for pushing runtime min/max filters > --- > > Key: KUDU-1683 > URL: https://issues.apache.org/jira/browse/KUDU-1683 > Project: Kudu > Issue Type: New Feature > Components: client, perf >Affects Versions: 1.0.0 >Reporter: Matthew Jacobs >Priority: Major > Labels: impala > > Impala would like to generate runtime min/max filters to be pushed to Kudu, > at least for scan tokens that haven't been opened yet. > https://issues.cloudera.org/browse/IMPALA-4252 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KUDU-1683) Kudu client support for pushing runtime min/max filters
[ https://issues.apache.org/jira/browse/KUDU-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367372#comment-16367372 ] Grant Henke commented on KUDU-1683: --- Is this Jira complete? I see [IMPALA-4252|https://issues.cloudera.org/browse/IMPALA-4252] is resolved. cc [~twmarshall] [~tlipcon] > Kudu client support for pushing runtime min/max filters > --- > > Key: KUDU-1683 > URL: https://issues.apache.org/jira/browse/KUDU-1683 > Project: Kudu > Issue Type: New Feature > Components: client, perf >Affects Versions: 1.0.0 >Reporter: Matthew Jacobs >Priority: Major > Labels: impala > > Impala would like to generate runtime min/max filters to be pushed to Kudu, > at least for scan tokens that haven't been opened yet. > https://issues.cloudera.org/browse/IMPALA-4252 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KUDU-1683) Kudu client support for pushing runtime min/max filters
[ https://issues.apache.org/jira/browse/KUDU-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1787#comment-1787 ] Todd Lipcon commented on KUDU-1683: --- With KUDU-1686 (sub-splitting scan tokens) we could also imagine that the typical Impala scan node would have a lot more small scan ranges, and thus "phase 1" above would be pretty effective without having to worry about "phase 2". > Kudu client support for pushing runtime min/max filters > --- > > Key: KUDU-1683 > URL: https://issues.apache.org/jira/browse/KUDU-1683 > Project: Kudu > Issue Type: New Feature > Components: client, perf >Affects Versions: 1.0.0 >Reporter: Matthew Jacobs >Priority: Critical > Labels: impala > > Impala would like to generate runtime min/max filters to be pushed to Kudu, > at least for scan tokens that haven't been opened yet. > https://issues.cloudera.org/browse/IMPALA-4252 -- This message was sent by Atlassian JIRA (v6.3.4#6332)