[
https://issues.apache.org/jira/browse/SPARK-13871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yin Huai updated SPARK-13871:
-----------------------------
Assignee: Sameer Agarwal
> Add support for inferring filters from data constraints
> -------------------------------------------------------
>
> Key: SPARK-13871
> URL: https://issues.apache.org/jira/browse/SPARK-13871
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Sameer Agarwal
> Assignee: Sameer Agarwal
> Priority: Minor
> Fix For: 2.0.0
>
>
> Now that we have an infrastructure for propagating data constraints, we
> should generalize the NullFiltering optimizer rule in catalyst to
> InferFiltersFromConstraints that can automatically infer all relevant filters
> based on an operator's constraints while making sure of 2 things:
> (a) no redundant filters are generated, and
> (b) filters that do not contribute to any further optimizations are not
> generated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
