[jira] [Created] (FLINK-35663) Release Testing: FLIP-436: Introduce Catalog-related Syntax
Yubin Li created FLINK-35663:
Summary: Release Testing: FLIP-436: Introduce Catalog-related
Syntax
Key: FLINK-35663
URL: https://issues.apache.org/jira/browse/FLINK-35663
Project: Flink
Issue Type: Sub-task
Components: Table SQL / API
Affects Versions: 1.20.0
Reporter: Yubin Li
This describes how to verify FLINK-34914 FLIP-436: Introduce Catalog-related
Syntax.
The verification steps are as follows.
h3. 1. Start the sql client.
bin/sql-client.sh
h3. 2. Execute the following DDL statements.
{code:java}
create catalog c1 comment 'comment for ''c1''' with
('type'='generic_in_memory', 'default-database'='db1');
create catalog if not exists c1 comment 'new' with
('type'='generic_in_memory');
create catalog if not exists c2 with ('type'='generic_in_memory');
create catalog c2 with ('type'='generic_in_memory', 'default-database'='db2');
{code}
Verify whether only the last statement is supposed to throw an exception and
messages such as `Catalog c2 already exists.`
h3. 3. Execute the following statements.
{code:java}
show catalogs;
show create catalog c1;
describe catalog c1;
desc catalog extended c1;
show create catalog c2;
describe catalog c2;
desc catalog extended c2; {code}
Verify whether they are the same as the given results.
!image-2024-06-16-09-30-16-983.png|width=671,height=788!
h3. 4. Execute the following DDL statements.
{code:java}
alter catalog c1 reset ('default-database');
alter catalog c1 comment '';
alter catalog c2 set ('default-database'='db2');
alter catalog c2 reset ('type');
alter catalog c2 reset ();
alter catalog c2 comment 'hello catalog ''c2''';{code}
Verify whether the forth statement is supposed to throw an exception and
messages such as `ALTER CATALOG RESET does not support changing 'type'`.
Verify whether the fifth statement is supposed to throw an exception and
messages such as `ALTER CATALOG RESET does not support empty key`.
h3. 5. Execute the following statements.
{code:java}
show create catalog c1;
describe catalog c1;
desc catalog extended c1;
show create catalog c2;
describe catalog c2;
desc catalog extended c2; {code}
Verify whether they are the same as the given results.
!image-2024-06-16-09-47-27-956.png|width=679,height=680!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-35597) Fix unstable LocatableSplitAssignerTest#testConcurrentSplitAssignmentForMultipleHosts
Yubin Li created FLINK-35597: Summary: Fix unstable LocatableSplitAssignerTest#testConcurrentSplitAssignmentForMultipleHosts Key: FLINK-35597 URL: https://issues.apache.org/jira/browse/FLINK-35597 Project: Flink Issue Type: Bug Components: Tests Affects Versions: 1.20.0 Reporter: Yubin Li -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35451) Support `ALTER CATALOG COMMENT` syntax
Yubin Li created FLINK-35451: Summary: Support `ALTER CATALOG COMMENT` syntax Key: FLINK-35451 URL: https://issues.apache.org/jira/browse/FLINK-35451 Project: Flink Issue Type: Sub-task Components: Table SQL / API Reporter: Yubin Li Fix For: 1.20.0 Attachments: image-2024-05-26-02-11-30-070.png Set comment in the specified catalog. If the comment is already set in the catalog, override the old value with the new one. !image-2024-05-26-02-11-30-070.png|width=575,height=415! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-35164) Support `ALTER CATALOG RESET` syntax
Yubin Li created FLINK-35164: Summary: Support `ALTER CATALOG RESET` syntax Key: FLINK-35164 URL: https://issues.apache.org/jira/browse/FLINK-35164 Project: Flink Issue Type: Sub-task Components: Table SQL / API Reporter: Yubin Li Attachments: image-2024-04-18-23-26-59-854.png h3. ALTER CATALOG catalog_name RESET (key1, key2, ...) Reset one or more properties to its default value in the specified catalog. !image-2024-04-18-23-26-59-854.png|width=781,height=527! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34918) Introduce the support of catalog for comments
Yubin Li created FLINK-34918: Summary: Introduce the support of catalog for comments Key: FLINK-34918 URL: https://issues.apache.org/jira/browse/FLINK-34918 Project: Flink Issue Type: Sub-task Components: Table SQL / API Affects Versions: 1.20.0 Reporter: Yubin Li We propose to introduce `getComment()` method in `CatalogDescriptor`, and the reasons are as follows. 1. For the sake of design consistency, follow the design of FLIP-295 [1] which introduced `CatalogStore` component, `CatalogDescriptor` includes names and attributes, both of which are used to describe the catalog, and `comment` can be added smoothly. 2. Extending the existing class rather than add new method to the existing interface, Especially, the `Catalog` interface, as a core interface, is used by a series of important components such as `CatalogFactory`, `CatalogManager` and `FactoryUtil`, and is implemented by a large number of connectors such as JDBC, Paimon, and Hive. Adding methods to it will greatly increase the implementation complexity, and more importantly, increase the cost of iteration, maintenance, and verification. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34917) Support enhanced `CREATE CATALOG` syntax
Yubin Li created FLINK-34917:
Summary: Support enhanced `CREATE CATALOG` syntax
Key: FLINK-34917
URL: https://issues.apache.org/jira/browse/FLINK-34917
Project: Flink
Issue Type: Sub-task
Components: Table SQL / API
Affects Versions: 1.20.0
Reporter: Yubin Li
Attachments: image-2024-03-22-18-31-59-632.png
{{IF NOT EXISTS}} clause: If the catalog already exists, nothing happens.
{{COMMENT}} clause: An optional string literal. The description for the catalog.
NOTICE: we just need to introduce the '[IF NOT EXISTS]' and '[COMMENT]' clause
to the 'create catalog' statement.
!image-2024-03-22-18-31-59-632.png|width=795,height=87!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-34916) Support `ALTER CATALOG` syntax
Yubin Li created FLINK-34916: Summary: Support `ALTER CATALOG` syntax Key: FLINK-34916 URL: https://issues.apache.org/jira/browse/FLINK-34916 Project: Flink Issue Type: Sub-task Components: Table SQL / API Affects Versions: 1.20.0 Reporter: Yubin Li Attachments: image-2024-03-22-18-30-33-182.png Set one or more properties in the specified catalog. If a particular property is already set in the catalog, override the old value with the new one. !image-2024-03-22-18-30-33-182.png|width=736,height=583! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-34915) Introduce `DESCRIBE CATALOG` syntax
Yubin Li created FLINK-34915:
Summary: Introduce `DESCRIBE CATALOG` syntax
Key: FLINK-34915
URL: https://issues.apache.org/jira/browse/FLINK-34915
Project: Flink
Issue Type: Sub-task
Components: Table SQL / API
Affects Versions: 1.20.0
Reporter: Yubin Li
Describe the metadata of an existing catalog. The metadata information includes
the catalog’s name, type, and comment. If the optional {{EXTENDED}} option is
specified, catalog properties are also returned.
NOTICE: The parser part of this syntax has been implemented in FLIP-69 , and it
is not actually available. we can complete the syntax in this FLIP.
{{Flink SQL> describe catalog cat2;}}
{{+--+---+}}
{{| catalog_description_item | catalog_description_value |}}
{{+--+---+}}
{{| Name | cat2 |}}
{{| Type | generic_in_memory |}}
{{| Comment | |}}
{{+--+---+}}
{{3 rows }}{{in}} {{set}}
{{Flink SQL> describe catalog extended cat2;}}
{{+--+-+}}
{{| catalog_description_item | catalog_description_value
|}}
{{+--+-+}}
{{| Name | cat2
|}}
{{| Type | generic_in_memory
|}}
{{| Comment |
|}}
{{{}| Properties | (default-database,db),
({}}}{{{}type{}}}{{{},generic_in_memory) |{}}}
{{+--+-+}}
{{4 rows }}{{in}} {{set}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-34914) FLIP-436: Introduce Catalog-related Syntax
Yubin Li created FLINK-34914: Summary: FLIP-436: Introduce Catalog-related Syntax Key: FLINK-34914 URL: https://issues.apache.org/jira/browse/FLINK-34914 Project: Flink Issue Type: New Feature Components: Table SQL / API Affects Versions: 1.20.0 Reporter: Yubin Li Umbrella issue for: https://cwiki.apache.org/confluence/display/FLINK/FLIP-436%3A+Introduce+Catalog-related+Syntax -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33927) Cleanup usage of deprecated ExecutionConfigOptions#(TABLE_EXEC_SHUFFLE_MODE, TABLE_EXEC_LEGACY_TRANSFORMATION_UIDS)
Yubin Li created FLINK-33927: Summary: Cleanup usage of deprecated ExecutionConfigOptions#(TABLE_EXEC_SHUFFLE_MODE, TABLE_EXEC_LEGACY_TRANSFORMATION_UIDS) Key: FLINK-33927 URL: https://issues.apache.org/jira/browse/FLINK-33927 Project: Flink Issue Type: Sub-task Components: Table SQL / Planner Affects Versions: 1.19.0 Reporter: Yubin Li |org.apache.flink.table.api.config.ExecutionConfigOptions#TABLE_EXEC_SHUFFLE_MODE|Use ExecutionOptions#BATCH_SHUFFLE_MODE instead| |org.apache.flink.table.api.config.ExecutionConfigOptions#TABLE_EXEC_LEGACY_TRANSFORMATION_UIDS|Use #TABLE_EXEC_UID_GENERATION instead| -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33921) Cleanup usage of deprecated IdleStateRetentionTime related method in org.apache.flink.table.api.TableConfig
Yubin Li created FLINK-33921: Summary: Cleanup usage of deprecated IdleStateRetentionTime related method in org.apache.flink.table.api.TableConfig Key: FLINK-33921 URL: https://issues.apache.org/jira/browse/FLINK-33921 Project: Flink Issue Type: Improvement Components: Table SQL / Planner Affects Versions: 1.19.0 Reporter: Yubin Li getMinIdleStateRetentionTime() getMinIdleStateRetentionTime() -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33780) Support to store default catalog in CatalogStore
Yubin Li created FLINK-33780: Summary: Support to store default catalog in CatalogStore Key: FLINK-33780 URL: https://issues.apache.org/jira/browse/FLINK-33780 Project: Flink Issue Type: Sub-task Components: Table SQL / API Affects Versions: 1.19.0 Reporter: Yubin Li Flink initially creates a default catalog which is included in the `Map catalogs`, but is not stored in the CatalogStore. After conducting thorough investigation, I've determined that the necessary modification can be made within the `CatalogManager`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33638) Support variable-length data generation for variable-length data types
Yubin Li created FLINK-33638: Summary: Support variable-length data generation for variable-length data types Key: FLINK-33638 URL: https://issues.apache.org/jira/browse/FLINK-33638 Project: Flink Issue Type: Improvement Components: Connectors / Common Affects Versions: 1.19.0 Reporter: Yubin Li Currently, for variable-length data types (varchar, varbinary, string, bytes), datagen connector always generates max-length data, we can extending datagen to generate variable length values(using a new option to enable it, e.g.,'fields.f0.var-len'='true'). the topic has been discussed in the mail thread [https://lists.apache.org/thread/kp6popo4cnhl6vx31sdn6mlscpzj9tgc] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33571) Bump json-path from 2.7.0 to 2.8.0
Yubin Li created FLINK-33571: Summary: Bump json-path from 2.7.0 to 2.8.0 Key: FLINK-33571 URL: https://issues.apache.org/jira/browse/FLINK-33571 Project: Flink Issue Type: Bug Affects Versions: 1.19.0 Reporter: Yubin Li json-path has critical bugs in 2.7.0 used in flink project, see [https://github.com/json-path/JsonPath/issues/906.] the current version is vulnerable to Denial of Service (DoS) due to a StackOverflowError when parsing a deeply nested JSON array or object, and the issue has been fixed in 2.8.0. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33492) Fix unavailable links in connector download page
Yubin Li created FLINK-33492: Summary: Fix unavailable links in connector download page Key: FLINK-33492 URL: https://issues.apache.org/jira/browse/FLINK-33492 Project: Flink Issue Type: Bug Components: Documentation Affects Versions: 1.19.0 Reporter: Yubin Li there are several unavailable connector download links (hbase, kafka, etc) https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/connectors/table/downloads/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-33379) Bump flink version on flink-connectors-elasticsearch
Yubin Li created FLINK-33379: Summary: Bump flink version on flink-connectors-elasticsearch Key: FLINK-33379 URL: https://issues.apache.org/jira/browse/FLINK-33379 Project: Flink Issue Type: Improvement Reporter: Yubin Li As Flink 1.18 released, bump the flink version in es connector . -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-32993) Datagen connector produce unexpected Char type data
Yubin Li created FLINK-32993: Summary: Datagen connector produce unexpected Char type data Key: FLINK-32993 URL: https://issues.apache.org/jira/browse/FLINK-32993 Project: Flink Issue Type: Improvement Components: Connectors / Common Affects Versions: 1.19.0 Reporter: Yubin Li Attachments: image-2023-08-30-11-47-05-887.png, image-2023-08-30-11-47-43-719.png create table as follows: !image-2023-08-30-11-47-43-719.png! results: !image-2023-08-30-11-47-05-887.png! I have found that Char type data length is 100, which same as String type, it is caused by the two types use the same data generation logic, and we could correct it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-30435) `SHOW CREATE TABLE` shows column comment
Yubin Li created FLINK-30435: Summary: `SHOW CREATE TABLE` shows column comment Key: FLINK-30435 URL: https://issues.apache.org/jira/browse/FLINK-30435 Project: Flink Issue Type: Improvement Reporter: Yubin Li After a table with column comments created, we would find that the results generated by `show create table` statement lose column comments. As created table has been migrated to new schema framework in https://issues.apache.org/jira/browse/FLINK-29679, It is easy to take it done. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-29929) Correct conversions from ResolvedSchema to TableSchema
Yubin Li created FLINK-29929: Summary: Correct conversions from ResolvedSchema to TableSchema Key: FLINK-29929 URL: https://issues.apache.org/jira/browse/FLINK-29929 Project: Flink Issue Type: Bug Reporter: Yubin Li Attachments: image-2022-11-08-19-32-05-894.png In the new schema framework, DataType in Column indicate wether the column is a time attribute and the old api not, we can see that ```DefaultSchemaResolver.resolve()``` include above logic. but in TableSchema.fromResolvedSchema(), we can't see the time attribute removal logic, thus cause a wrong legacy Timestamp DataType. !image-2022-11-08-19-32-05-894.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-29829) align explain results in different platforms
Yubin Li created FLINK-29829:
Summary: align explain results in different platforms
Key: FLINK-29829
URL: https://issues.apache.org/jira/browse/FLINK-29829
Project: Flink
Issue Type: Bug
Components: Table SQL / Planner
Reporter: Yubin Li
Delete last line separator during explain results generation in design, but in
fact, just delete the last character, it will result in results in the output
in Windows has one more line than Linux.
{code:java}
//Windows
LegacySink(name=[`default_catalog`.`default_database`.`appendSink2`],
fields=[a, b])
+- GroupWindowAggregate(groupBy=[id1], window=[SlidingGroupWindow('w$, rowtime,
6000, 12000)], select=[id1, LISTAGG(text, $f3) AS EXPR$1])
+- Exchange(distribution=[hash[id1]])
+- Calc(select=[id1, rowtime, text, '*' AS $f3])
+- Reused(reference_id=[1])
{code}
{code:java}
//linux
LegacySink(name=[`default_catalog`.`default_database`.`appendSink2`],
fields=[a, b])
+- GroupWindowAggregate(groupBy=[id1], window=[SlidingGroupWindow('w$, rowtime,
6000, 12000)], select=[id1, LISTAGG(text, $f3) AS EXPR$1])
+- Exchange(distribution=[hash[id1]])
+- Calc(select=[id1, rowtime, text, '*' AS $f3])
+- Reused(reference_id=[1])
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (FLINK-29787) fix ci METHOD_NEW_DEFAULT issue
Yubin Li created FLINK-29787: Summary: fix ci METHOD_NEW_DEFAULT issue Key: FLINK-29787 URL: https://issues.apache.org/jira/browse/FLINK-29787 Project: Flink Issue Type: Bug Components: Build System / CI Reporter: Yubin Li `org.apache.flink.api.connector.source.SourceReader` declared a new default function `pauseOrResumeSplits()`, japicmp plugin failed during ci running, we should configure the plugin to make it compatible. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-29679) DESCRIBE statement shows comment
Yubin Li created FLINK-29679: Summary: DESCRIBE statement shows comment Key: FLINK-29679 URL: https://issues.apache.org/jira/browse/FLINK-29679 Project: Flink Issue Type: New Feature Components: Table SQL / API Affects Versions: 1.17.0 Reporter: Yubin Li comment is very helpful to make table schema user-friendly, many data analysers rely on such message to write sql adaptive to corresponding business logics. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-29042) Support lookup join for es connector
Yubin Li created FLINK-29042: Summary: Support lookup join for es connector Key: FLINK-29042 URL: https://issues.apache.org/jira/browse/FLINK-29042 Project: Flink Issue Type: New Feature Components: Connectors / ElasticSearch Affects Versions: 1.16.0 Reporter: Yubin Li Now es connector could only be used as a sink, but in many business scenarios, we treat es as a index database, we should support to make it lookupable in flink. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (FLINK-27207) Support built-in parquet format
Yubin Li created FLINK-27207: Summary: Support built-in parquet format Key: FLINK-27207 URL: https://issues.apache.org/jira/browse/FLINK-27207 Project: Flink Issue Type: Sub-task Components: Table Store Affects Versions: table-store-0.2.0 Reporter: Yubin Li wrap parquet format provided by Flink, make it more appropriate with flink-table-store -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27172) Support bulk based format provided by Flink
Yubin Li created FLINK-27172: Summary: Support bulk based format provided by Flink Key: FLINK-27172 URL: https://issues.apache.org/jira/browse/FLINK-27172 Project: Flink Issue Type: Sub-task Components: Table Store Reporter: Yubin Li -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-27100) Support parquet format in FileStore
Yubin Li created FLINK-27100: Summary: Support parquet format in FileStore Key: FLINK-27100 URL: https://issues.apache.org/jira/browse/FLINK-27100 Project: Flink Issue Type: New Feature Components: Table Store Reporter: Yubin Li Apache Parquet is a very popular columnar file format, used in many data analysis engines like Hive/Impala/Spark/Flink. we could use simple command lines like parquet-tools to view metadata and data easily instead of using complex java code. now flink-table-store only support ORC, but there are massive business data stored as parquet format, developers/analysisers are very familliar with it, maybe it's a good addition to make Parquet usable. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-26677) Make flink-connector-base dependency consistent
Yubin Li created FLINK-26677: Summary: Make flink-connector-base dependency consistent Key: FLINK-26677 URL: https://issues.apache.org/jira/browse/FLINK-26677 Project: Flink Issue Type: Bug Components: Table Store Reporter: Yubin Li Fix For: table-store-0.1.0 as https://issues.apache.org/jira/browse/FLINK-25927 has been merged into flink master branch and 1.15 branch, the flink-connector-base modules has been shaded into many connectors modules, the main change in `pom.xml` as follow: ``` org.apache.flink.connector.base org.apache.flink.connector.files.shaded.org.apache.flink.connector.base ``` now the building of table-store project has been failed caused by above, it should to be updated right now. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25631) Support enhanced `show tables` statement
Yubin Li created FLINK-25631: Summary: Support enhanced `show tables` statement Key: FLINK-25631 URL: https://issues.apache.org/jira/browse/FLINK-25631 Project: Flink Issue Type: New Feature Components: Table SQL / API Affects Versions: 1.14.4 Reporter: Yubin Li Enhanced `show tables` statement like ` show tables from db1 like 't%' ` has been supported broadly in many popular data process engine like presto/trino/spark [https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-tables.html] I have investigated the syntax of engines as mentioned above. We could use such statement to easily show the tables of specified databases without switching db frequently, alse we could use regexp pattern to find focused tables quickly from plenty of tables. besides, the new statement is compatible completely with the old one, users could use `show tables` as before. h3. SHOW TABLES [ ( FROM | IN ) [catalog_name.]database_name ] [ [NOT] LIKE regex_pattern ] -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25563) Support sink parallelism configuration to Elasticsearch connector
Yubin Li created FLINK-25563: Summary: Support sink parallelism configuration to Elasticsearch connector Key: FLINK-25563 URL: https://issues.apache.org/jira/browse/FLINK-25563 Project: Flink Issue Type: Bug Components: Connectors / ElasticSearch Reporter: Yubin Li improve write efficiency, reduce back pressure -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-25369) CatalogManager provide wrong tables or views in given catalog database name
Yubin Li created FLINK-25369:
Summary: CatalogManager provide wrong tables or views in given
catalog database name
Key: FLINK-25369
URL: https://issues.apache.org/jira/browse/FLINK-25369
Project: Flink
Issue Type: Bug
Components: Table SQL / API
Affects Versions: 1.14.2
Reporter: Yubin Li
table context like this:
{code:java}
//catalog c1, database d1
t1
//current catalog c2, current database d2
t2{code}
CatalogManager.listTables(c1, d1) should return t1, in fact return t2
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Created] (FLINK-24939) Support 'SHOW CREATE CATALOG' syntax
Yubin Li created FLINK-24939: Summary: Support 'SHOW CREATE CATALOG' syntax Key: FLINK-24939 URL: https://issues.apache.org/jira/browse/FLINK-24939 Project: Flink Issue Type: Improvement Affects Versions: 1.14.0 Reporter: Yubin Li SHOW CREATE CATALOG ; `Catalog` is playing a more import role in flink, it would be greate to get existing catalogdetail information -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (FLINK-24730) Support prompt in SqlCli
Yubin Li created FLINK-24730: Summary: Support prompt in SqlCli Key: FLINK-24730 URL: https://issues.apache.org/jira/browse/FLINK-24730 Project: Flink Issue Type: Improvement Components: Table SQL / Client Affects Versions: 1.15.0 Reporter: Yubin Li prompt is a very popular function in cli of traditional database like mysql, help users to notice session context like current db/catalog/time, avoid calling wrong commands in an unexpected session for example, \c current catalog, \d current db, \t current time FLINK SQL> set prompt = set prompt=\c~\d~\t; catalog1~db1~2021-11-12 16:00:00> show current catalog; -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-24585) Print the change in the size of the compacted files
Yubin Li created FLINK-24585:
Summary: Print the change in the size of the compacted files
Key: FLINK-24585
URL: https://issues.apache.org/jira/browse/FLINK-24585
Project: Flink
Issue Type: Improvement
Components: Connectors / FileSystem
Affects Versions: 1.15.0
Reporter: Yubin Li
{code:java}
LOG.info(
"Compaction time cost is '{}S', target file is '{}', input files are
'{}'",
costSeconds,
target,
paths);
{code}
only print the file name and time cost in compacting, maybe we need to print
the size change.
we have a demand in this, and have implemented it, please assign this to me,
thanks
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-23661) Fix protobuf plugin proxy issue
Yubin Li created FLINK-23661: Summary: Fix protobuf plugin proxy issue Key: FLINK-23661 URL: https://issues.apache.org/jira/browse/FLINK-23661 Project: Flink Issue Type: Improvement Components: API / Python Affects Versions: 1.14.0 Reporter: Yubin Li [ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (default) on project flink-python_2.11: Error extracting protoc for version 3.17.3: Unsupp orted platform: protoc-3.17.3-windows-x86_64.exe -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.11.4:run (default) on project flink-python_2.11: Er ror extracting protoc for version 3.17.3 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23656) flink-sql-parser compile failed
Yubin Li created FLINK-23656: Summary: flink-sql-parser compile failed Key: FLINK-23656 URL: https://issues.apache.org/jira/browse/FLINK-23656 Project: Flink Issue Type: Bug Components: Table SQL / Runtime Affects Versions: 1.14.0 Reporter: Yubin Li ParserResource import org.apache.flink.sql.parser.impl.ParseException; compile error as follow: Cannot resolve symbol 'impl' Cannot resolve symbol 'ParseException' -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23442) FileSystemFactory refactor in flink-table-runtime
Yubin Li created FLINK-23442: Summary: FileSystemFactory refactor in flink-table-runtime Key: FLINK-23442 URL: https://issues.apache.org/jira/browse/FLINK-23442 Project: Flink Issue Type: Improvement Components: FileSystems, Table SQL / Runtime Affects Versions: 1.14.0 Reporter: Yubin Li FileSystemFactory interface has different definitons in the follow modules: flink-table-runtime flink-core once FileSystem.initialize() invoked, only the classes implelement FileSystemFactory of flink-core can be loaded, and we can implement PluginFileSystemFactory to wrap the classes as mentioned before, but we can`t do the same refactor in flink-table-runtime -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-18043) Translate "Scala API Extensions" page of "DataStream API" into Chinese
Yubin Li created FLINK-18043:
Summary: Translate "Scala API Extensions" page of "DataStream API"
into Chinese
Key: FLINK-18043
URL: https://issues.apache.org/jira/browse/FLINK-18043
Project: Flink
Issue Type: Task
Components: chinese-translation, Documentation
Reporter: Yubin Li
Fix For: 1.12.0
The page url is
[https://ci.apache.org/projects/flink/flink-docs-master/zh/dev/scala_api_extensions.html]
The markdown file is located in {{flink/docs/dev/scala_api_extensions.zh.md}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-18007) Translate "Joins in Continuous Queries" page of "Streaming Concepts" into Chinese
Yubin Li created FLINK-18007:
Summary: Translate "Joins in Continuous Queries" page of
"Streaming Concepts" into Chinese
Key: FLINK-18007
URL: https://issues.apache.org/jira/browse/FLINK-18007
Project: Flink
Issue Type: Task
Components: chinese-translation, Documentation
Reporter: Yubin Li
Fix For: 1.11.0
The page url is
[https://ci.apache.org/projects/flink/flink-docs-release-1.10/zh/dev/table/streaming/joins.html]
The markdown file is located in {{flink/docs/dev/table/streaming/joins.zh.md}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-17999) Translate "Query Configuration" page of "Streaming Concepts" into Chinese
Yubin Li created FLINK-17999:
Summary: Translate "Query Configuration" page of "Streaming
Concepts" into Chinese
Key: FLINK-17999
URL: https://issues.apache.org/jira/browse/FLINK-17999
Project: Flink
Issue Type: Task
Components: chinese-translation, Documentation
Reporter: Yubin Li
Fix For: 1.11.0
The page url is
[https://ci.apache.org/projects/flink/flink-docs-release-1.10/zh/dev/table/streaming/query_configuration.html]
The markdown file is located in
{{flink/docs/dev/table/streaming/query_configuration.zh.md}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
