[jira] [Commented] (FLINK-27417) Flink JDBC SQL Connector：SELECT * FROM table WHERE co > 100; mysql will execute SELECT * FROM table to scan the whole table
[ https://issues.apache.org/jira/browse/FLINK-27417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528505#comment-17528505 ] haojiawei commented on FLINK-27417: --- [~martijnvisser] Looks like FLINK-16024 is the problem, is there any workaround? The amount of data in our original table is relatively large, and we need to filter and query. > Flink JDBC SQL Connector：SELECT * FROM table WHERE co > 100; mysql will > execute SELECT * FROM table to scan the whole table > > > Key: FLINK-27417 > URL: https://issues.apache.org/jira/browse/FLINK-27417 > Project: Flink > Issue Type: Bug > Components: Connectors / JDBC >Affects Versions: 1.14.0 >Reporter: haojiawei >Priority: Major > > Use flink cli to create a mysql mapping table, and execute the query SELECT * > FROM table WHERE co > 100;Mysql will execute SELECT * FROM table to scan the > whole table. > > show mysql execute sql: select * from information_schema.`PROCESSLIST` where > info is not null; > > -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (FLINK-27417) Flink JDBC SQL Connector：SELECT * FROM table WHERE co > 100; mysql will execute SELECT * FROM table to scan the whole table
haojiawei created FLINK-27417: - Summary: Flink JDBC SQL Connector：SELECT * FROM table WHERE co > 100; mysql will execute SELECT * FROM table to scan the whole table Key: FLINK-27417 URL: https://issues.apache.org/jira/browse/FLINK-27417 Project: Flink Issue Type: Bug Components: Connectors / JDBC Affects Versions: 1.14.0 Reporter: haojiawei Use flink cli to create a mysql mapping table, and execute the query SELECT * FROM table WHERE co > 100;Mysql will execute SELECT * FROM table to scan the whole table. show mysql execute sql: select * from information_schema.`PROCESSLIST` where info is not null; -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Commented] (FLINK-27113) Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported
[ https://issues.apache.org/jira/browse/FLINK-27113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17518750#comment-17518750 ] haojiawei commented on FLINK-27113: --- Can I use flink-connector-jdbc_1.15.jar with Flink 1.14 version. > Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = > 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported > > > Key: FLINK-27113 > URL: https://issues.apache.org/jira/browse/FLINK-27113 > Project: Flink > Issue Type: Bug > Components: Connectors / JDBC >Affects Versions: 1.14.0 >Reporter: haojiawei >Priority: Major > > Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = > 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported > Caused by: java.lang.UnsupportedOperationException: Catalog for > 'org.apache.flink.connector.jdbc.dialect.MySQLDialect@28f4f300' is not > supported yet. > at > org.apache.flink.connector.jdbc.catalog.JdbcCatalogUtils.createCatalog(JdbcCatalogUtils.java:52) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.connector.jdbc.catalog.JdbcCatalog.(JdbcCatalog.java:52) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactory.createCatalog(JdbcCatalogFactory.java:77) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.table.factories.FactoryUtil.createCatalog(FactoryUtil.java:287) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.createCatalog(TableEnvironmentImpl.java:1292) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1122) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeOperation$3(LocalExecutor.java:209) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.local.LocalExecutor.executeOperation(LocalExecutor.java:209) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > ... 11 more > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-27113) Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported
[ https://issues.apache.org/jira/browse/FLINK-27113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17518748#comment-17518748 ] haojiawei commented on FLINK-27113: --- I looked at the code and it was true that MySQLDialect was not supported in version 1.14, but I saw code that supported MySQLDialect was incorporated in 1.15. [链接标题|https://github.com/apache/flink/blob/release-1.15.0-rc0/flink-connectors/flink-connector-jdbc/src/main/java/org/apache/flink/connector/jdbc/catalog/JdbcCatalogUtils.java] > Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = > 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported > > > Key: FLINK-27113 > URL: https://issues.apache.org/jira/browse/FLINK-27113 > Project: Flink > Issue Type: Bug > Components: Connectors / JDBC >Affects Versions: 1.14.0 >Reporter: haojiawei >Priority: Major > > Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = > 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported > Caused by: java.lang.UnsupportedOperationException: Catalog for > 'org.apache.flink.connector.jdbc.dialect.MySQLDialect@28f4f300' is not > supported yet. > at > org.apache.flink.connector.jdbc.catalog.JdbcCatalogUtils.createCatalog(JdbcCatalogUtils.java:52) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.connector.jdbc.catalog.JdbcCatalog.(JdbcCatalog.java:52) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactory.createCatalog(JdbcCatalogFactory.java:77) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.table.factories.FactoryUtil.createCatalog(FactoryUtil.java:287) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.createCatalog(TableEnvironmentImpl.java:1292) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1122) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeOperation$3(LocalExecutor.java:209) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.local.LocalExecutor.executeOperation(LocalExecutor.java:209) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > ... 11 more > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-27113) Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported
[ https://issues.apache.org/jira/browse/FLINK-27113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haojiawei updated FLINK-27113: -- Component/s: Connectors / JDBC (was: Table SQL / Client) > Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = > 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported > > > Key: FLINK-27113 > URL: https://issues.apache.org/jira/browse/FLINK-27113 > Project: Flink > Issue Type: Bug > Components: Connectors / JDBC >Affects Versions: 1.14.0 >Reporter: haojiawei >Priority: Major > > Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = > 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported > Caused by: java.lang.UnsupportedOperationException: Catalog for > 'org.apache.flink.connector.jdbc.dialect.MySQLDialect@28f4f300' is not > supported yet. > at > org.apache.flink.connector.jdbc.catalog.JdbcCatalogUtils.createCatalog(JdbcCatalogUtils.java:52) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.connector.jdbc.catalog.JdbcCatalog.(JdbcCatalog.java:52) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactory.createCatalog(JdbcCatalogFactory.java:77) > ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] > at > org.apache.flink.table.factories.FactoryUtil.createCatalog(FactoryUtil.java:287) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.createCatalog(TableEnvironmentImpl.java:1292) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1122) > ~[flink-table_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeOperation$3(LocalExecutor.java:209) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > at > org.apache.flink.table.client.gateway.local.LocalExecutor.executeOperation(LocalExecutor.java:209) > ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] > ... 11 more > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27113) Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported
haojiawei created FLINK-27113: - Summary: Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported Key: FLINK-27113 URL: https://issues.apache.org/jira/browse/FLINK-27113 Project: Flink Issue Type: Bug Components: Table SQL / Client Affects Versions: 1.14.0 Reporter: haojiawei Flink Sql Client CREATE CATALOG 'type'='jdbc', 'base-url' = 'jdbc:mysql://ip:port', ERROR MySQLDialect is not supported Caused by: java.lang.UnsupportedOperationException: Catalog for 'org.apache.flink.connector.jdbc.dialect.MySQLDialect@28f4f300' is not supported yet. at org.apache.flink.connector.jdbc.catalog.JdbcCatalogUtils.createCatalog(JdbcCatalogUtils.java:52) ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] at org.apache.flink.connector.jdbc.catalog.JdbcCatalog.(JdbcCatalog.java:52) ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] at org.apache.flink.connector.jdbc.catalog.factory.JdbcCatalogFactory.createCatalog(JdbcCatalogFactory.java:77) ~[flink-connector-jdbc_2.12-1.14.4.jar:1.14.4] at org.apache.flink.table.factories.FactoryUtil.createCatalog(FactoryUtil.java:287) ~[flink-table_2.12-1.14.0.jar:1.14.0] at org.apache.flink.table.api.internal.TableEnvironmentImpl.createCatalog(TableEnvironmentImpl.java:1292) ~[flink-table_2.12-1.14.0.jar:1.14.0] at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1122) ~[flink-table_2.12-1.14.0.jar:1.14.0] at org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeOperation$3(LocalExecutor.java:209) ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] at org.apache.flink.table.client.gateway.context.ExecutionContext.wrapClassLoader(ExecutionContext.java:88) ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] at org.apache.flink.table.client.gateway.local.LocalExecutor.executeOperation(LocalExecutor.java:209) ~[flink-sql-client_2.12-1.14.0.jar:1.14.0] ... 11 more -- This message was sent by Atlassian Jira (v8.20.1#820001)
