Grzegorz Kołakowski created FLINK-35080:
-------------------------------------------
Summary: Allow to specify additional pushdown filter in table
properties
Key: FLINK-35080
URL: https://issues.apache.org/jira/browse/FLINK-35080
Project: Flink
Issue Type: New Feature
Components: Connectors / JDBC
Reporter: Grzegorz Kołakowski
Currently, flink-connector-jdbc supports filter pushdown only for basic
operators such as: comparison operators, logical operators, is null, is not
null and like.
In some use-cases more complex filters need to be applied against the data,
which cannot be pushed down by the connector, so a lot of data is fetched by
Flink unnecessarily. For instance, expressions using PostgreSQL's jsonb or
stored procedures needs to be recreated in Flink SQL with built-in functions or
with UDFs. In addition, you not always own the target relational database in
order to create a view which already contains needed predicates.
It would be nice, if it is possible to specify additional pushdown parameter in
table definition, e.g.:
{code:java}
CREATE TABLE test ( ... )
WITH (
...
'extra-pushdown-predicate' = 'some_jsonb_column ? ''xyz'''
);{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
