[jira] [Created] (FLINK-31695) Calling `bin/flink stop` when flink-shaded-hadoop-2-uber-2.8.3-10.0.jar is in lib directory thwos NoSuchMethodError

2023-04-03 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31695: --- Summary: Calling `bin/flink stop` when flink-shaded-hadoop-2-uber-2.8.3-10.0.jar is in lib directory thwos NoSuchMethodError Key: FLINK-31695 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-31659) java.lang.ClassNotFoundException: org.apache.flink.table.planner.delegation.DialectFactory when bundled Hive connector jar is in classpath

2023-03-29 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31659: --- Summary: java.lang.ClassNotFoundException: org.apache.flink.table.planner.delegation.DialectFactory when bundled Hive connector jar is in classpath Key: FLINK-31659 URL: https

[jira] [Created] (FLINK-31558) Support updating schema type with restrictions in CDC sink of Table Store

2023-03-22 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31558: --- Summary: Support updating schema type with restrictions in CDC sink of Table Store Key: FLINK-31558 URL: https://issues.apache.org/jira/browse/FLINK-31558 Project

[jira] [Created] (FLINK-31436) Remove schemaId from constructor of Snapshot and ManifestFile in Table Store

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31436: --- Summary: Remove schemaId from constructor of Snapshot and ManifestFile in Table Store Key: FLINK-31436 URL: https://issues.apache.org/jira/browse/FLINK-31436 Project

[jira] [Created] (FLINK-31435) Introduce event parser for MySql Debezium JSON format in Table Store

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31435: --- Summary: Introduce event parser for MySql Debezium JSON format in Table Store Key: FLINK-31435 URL: https://issues.apache.org/jira/browse/FLINK-31435 Project: Flink

[jira] [Created] (FLINK-31434) Introduce CDC sink for Table Store

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31434: --- Summary: Introduce CDC sink for Table Store Key: FLINK-31434 URL: https://issues.apache.org/jira/browse/FLINK-31434 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31433) Make SchemaChange serializable

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31433: --- Summary: Make SchemaChange serializable Key: FLINK-31433 URL: https://issues.apache.org/jira/browse/FLINK-31433 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31432) Introduce a special StoreWriteOperator to deal with schema changes

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31432: --- Summary: Introduce a special StoreWriteOperator to deal with schema changes Key: FLINK-31432 URL: https://issues.apache.org/jira/browse/FLINK-31432 Project: Flink

[jira] [Created] (FLINK-31431) Support copying a FileStoreTable with latest schema

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31431: --- Summary: Support copying a FileStoreTable with latest schema Key: FLINK-31431 URL: https://issues.apache.org/jira/browse/FLINK-31431 Project: Flink Issue Type

[jira] [Created] (FLINK-31430) Support migrating states between different instances of TableWriteImpl and AbstractFileStoreWrite

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31430: --- Summary: Support migrating states between different instances of TableWriteImpl and AbstractFileStoreWrite Key: FLINK-31430 URL: https://issues.apache.org/jira/browse/FLINK-31430

[jira] [Created] (FLINK-31429) Support CTAS(create table as) streaming job with schema changes in table store

2023-03-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31429: --- Summary: Support CTAS(create table as) streaming job with schema changes in table store Key: FLINK-31429 URL: https://issues.apache.org/jira/browse/FLINK-31429 Project

[jira] [Created] (FLINK-30861) Table Store Hive Catalog throws java.lang.ClassNotFoundException: org.apache.hadoop.hive.common.ValidWriteIdList under certain environment

2023-01-31 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30861: --- Summary: Table Store Hive Catalog throws java.lang.ClassNotFoundException: org.apache.hadoop.hive.common.ValidWriteIdList under certain environment Key: FLINK-30861 URL: https

[jira] [Created] (FLINK-30646) Table Store Hive catalog throws ClassNotFoundException when custom hive-site.xml is presented

2023-01-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30646: --- Summary: Table Store Hive catalog throws ClassNotFoundException when custom hive-site.xml is presented Key: FLINK-30646 URL: https://issues.apache.org/jira/browse/FLINK-30646

[jira] [Created] (FLINK-30620) Table Store Hive catalog supports specifying custom Hive metastore client

2023-01-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30620: --- Summary: Table Store Hive catalog supports specifying custom Hive metastore client Key: FLINK-30620 URL: https://issues.apache.org/jira/browse/FLINK-30620 Project

[jira] [Created] (FLINK-30589) Snapshot expiration should be skipped in Table Store dedicated writer jobs

2023-01-06 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30589: --- Summary: Snapshot expiration should be skipped in Table Store dedicated writer jobs Key: FLINK-30589 URL: https://issues.apache.org/jira/browse/FLINK-30589 Project

[jira] [Created] (FLINK-30573) Table Store dedicated compact job may skip some records when checkpoint interval is long

2023-01-05 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30573: --- Summary: Table Store dedicated compact job may skip some records when checkpoint interval is long Key: FLINK-30573 URL: https://issues.apache.org/jira/browse/FLINK-30573

[jira] [Created] (FLINK-30506) Add documentation for writing Table Store with Spark3

2022-12-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30506: --- Summary: Add documentation for writing Table Store with Spark3 Key: FLINK-30506 URL: https://issues.apache.org/jira/browse/FLINK-30506 Project: Flink Issue

[jira] [Created] (FLINK-30504) Fix UnsupportedFileSystemSchemeException when writing Table Store on OSS with other engines

2022-12-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30504: --- Summary: Fix UnsupportedFileSystemSchemeException when writing Table Store on OSS with other engines Key: FLINK-30504 URL: https://issues.apache.org/jira/browse/FLINK-30504

[jira] [Created] (FLINK-30458) Refactor Table Store Documentation

2022-12-20 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30458: --- Summary: Refactor Table Store Documentation Key: FLINK-30458 URL: https://issues.apache.org/jira/browse/FLINK-30458 Project: Flink Issue Type: Improvement

Re: [DISCUSSION] Scan mode in Table Store for Flink Stream and Batch job

2022-12-14 Thread Caizhi Weng
ch as "full" in scan.mode looks nice. In this way, the > definition will be clearer, and the read mode will be unified through > scan.mode. Thanks > > > Best, > Shammon > > > On Mon, Dec 12, 2022 at 2:49 PM Caizhi Weng wrote: > >> Thanks Shammon for

[jira] [Created] (FLINK-30410) Rename 'full' to 'latest-full' and 'compacted' to 'compacted-full' for scan.mode in Table Store

2022-12-14 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30410: --- Summary: Rename 'full' to 'latest-full' and 'compacted' to 'compacted-full' for scan.mode in Table Store Key: FLINK-30410 URL: https://i

Re: [DISCUSSION] Scan mode in Table Store for Flink Stream and Batch job

2022-12-11 Thread Caizhi Weng
Thanks Shammon for bringing up the discussion. My opinion is to combine everything into scan.mode so that we don't have orthogonal options. You first mention that there are two disadvantages for this solution. *1. The behaviors of some StartupModes in Stream and Batch jobs are inconsistent* This

[jira] [Created] (FLINK-30294) Change table property key 'log.scan' to 'startup.mode' and add a default startup mode in Table Store

2022-12-04 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30294: --- Summary: Change table property key 'log.scan' to 'startup.mode' and add a default startup mode in Table Store Key: FLINK-30294 URL: https://issues.apache.o

[jira] [Created] (FLINK-30212) Introduce a TableStoreCompactJob class for users to submit compact jobs in Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30212: --- Summary: Introduce a TableStoreCompactJob class for users to submit compact jobs in Table Store Key: FLINK-30212 URL: https://issues.apache.org/jira/browse/FLINK-30212

[jira] [Created] (FLINK-30211) Introduce CompactStoreSink for compact jobs in Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30211: --- Summary: Introduce CompactStoreSink for compact jobs in Table Store Key: FLINK-30211 URL: https://issues.apache.org/jira/browse/FLINK-30211 Project: Flink

[jira] [Created] (FLINK-30210) Refactor StoreCompactOperator to accept records containing partitions and buckets in Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30210: --- Summary: Refactor StoreCompactOperator to accept records containing partitions and buckets in Table Store Key: FLINK-30210 URL: https://issues.apache.org/jira/browse/FLINK-30210

[jira] [Created] (FLINK-30209) Introduce CompactFileStoreSource for compact jobs of Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30209: --- Summary: Introduce CompactFileStoreSource for compact jobs of Table Store Key: FLINK-30209 URL: https://issues.apache.org/jira/browse/FLINK-30209 Project: Flink

[jira] [Created] (FLINK-30207) Move split initialization and discovery logic fully into SnapshotEnumerator in Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30207: --- Summary: Move split initialization and discovery logic fully into SnapshotEnumerator in Table Store Key: FLINK-30207 URL: https://issues.apache.org/jira/browse/FLINK-30207

[jira] [Created] (FLINK-30206) Allow FileStoreScan to read incremental changes from OVERWRITE snapshot in Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30206: --- Summary: Allow FileStoreScan to read incremental changes from OVERWRITE snapshot in Table Store Key: FLINK-30206 URL: https://issues.apache.org/jira/browse/FLINK-30206

[jira] [Created] (FLINK-30205) Modify compact interface for TableWrite and FileStoreWrite to support normal compaction in Table Store

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30205: --- Summary: Modify compact interface for TableWrite and FileStoreWrite to support normal compaction in Table Store Key: FLINK-30205 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-30204) Table Store support separated compact jobs

2022-11-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30204: --- Summary: Table Store support separated compact jobs Key: FLINK-30204 URL: https://issues.apache.org/jira/browse/FLINK-30204 Project: Flink Issue Type: New

[jira] [Created] (FLINK-30143) Table Store fails when temporary directory is a symlink

2022-11-22 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-30143: --- Summary: Table Store fails when temporary directory is a symlink Key: FLINK-30143 URL: https://issues.apache.org/jira/browse/FLINK-30143 Project: Flink Issue

[jira] [Created] (FLINK-29968) Update streaming query document for Table Store to include full compaction changelog producer

2022-11-09 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29968: --- Summary: Update streaming query document for Table Store to include full compaction changelog producer Key: FLINK-29968 URL: https://issues.apache.org/jira/browse/FLINK-29968

Re: Questions about Flink Table Store

2022-11-09 Thread Caizhi Weng
Hi Alexander! Thanks for your interest in Flink Table Store and I'm glad to share my thoughts with you. Given that there is always a single writer to a stream, in what situations > can concurrent writes ever happen to Flink Table Store? I'm not the author of FLIP so I'm not sure what "writer" r

[jira] [Created] (FLINK-29943) Bump Table Store 0.2 Flink version to 1.15.2

2022-11-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29943: --- Summary: Bump Table Store 0.2 Flink version to 1.15.2 Key: FLINK-29943 URL: https://issues.apache.org/jira/browse/FLINK-29943 Project: Flink Issue Type

[jira] [Created] (FLINK-29916) Levels in Table Store may mistakenly ignore level 0 files when two files have the same sequence number

2022-11-07 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29916: --- Summary: Levels in Table Store may mistakenly ignore level 0 files when two files have the same sequence number Key: FLINK-29916 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-29876) Explicitly throw exception from Table Store sink when unaligned checkpoint is enabled

2022-11-03 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29876: --- Summary: Explicitly throw exception from Table Store sink when unaligned checkpoint is enabled Key: FLINK-29876 URL: https://issues.apache.org/jira/browse/FLINK-29876

[jira] [Created] (FLINK-29842) Change commitIdentifier in Table Store snapshot to long value

2022-11-01 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29842: --- Summary: Change commitIdentifier in Table Store snapshot to long value Key: FLINK-29842 URL: https://issues.apache.org/jira/browse/FLINK-29842 Project: Flink

[jira] [Created] (FLINK-29840) Old record may overwrite new record in Table Store when snapshot committing is slow

2022-11-01 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29840: --- Summary: Old record may overwrite new record in Table Store when snapshot committing is slow Key: FLINK-29840 URL: https://issues.apache.org/jira/browse/FLINK-29840

[jira] [Created] (FLINK-29805) Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow

2022-10-31 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29805: --- Summary: Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow Key: FLINK-29805 URL: https://issues.apach

[jira] [Created] (FLINK-29792) FileStoreCommitTest is unstable and may stuck

2022-10-28 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29792: --- Summary: FileStoreCommitTest is unstable and may stuck Key: FLINK-29792 URL: https://issues.apache.org/jira/browse/FLINK-29792 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29773) PreAggregationITCase.LastValueAggregation and PreAggregationITCase.LastNonNullValueAggregation are unstable

2022-10-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29773: --- Summary: PreAggregationITCase.LastValueAggregation and PreAggregationITCase.LastNonNullValueAggregation are unstable Key: FLINK-29773 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-29752) Modify Flink Table Store connector to trigger full compaction constantly when full changelog is needed

2022-10-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29752: --- Summary: Modify Flink Table Store connector to trigger full compaction constantly when full changelog is needed Key: FLINK-29752 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-29714) Merge TableWrite and TableCompact into one interface

2022-10-21 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29714: --- Summary: Merge TableWrite and TableCompact into one interface Key: FLINK-29714 URL: https://issues.apache.org/jira/browse/FLINK-29714 Project: Flink Issue

[jira] [Created] (FLINK-29698) Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link

2022-10-19 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29698: --- Summary: Job Manager fails with FileAlreadyExistsException if java.io.tmpdir points to a symbolic link Key: FLINK-29698 URL: https://issues.apache.org/jira/browse/FLINK-29698

[jira] [Created] (FLINK-29612) Extract changelog files out of DataFileMeta#extraFiles

2022-10-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29612: --- Summary: Extract changelog files out of DataFileMeta#extraFiles Key: FLINK-29612 URL: https://issues.apache.org/jira/browse/FLINK-29612 Project: Flink Issue

[jira] [Created] (FLINK-29297) Group Table Store file writers into SingleFileWriter and RollingFileWriter

2022-09-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29297: --- Summary: Group Table Store file writers into SingleFileWriter and RollingFileWriter Key: FLINK-29297 URL: https://issues.apache.org/jira/browse/FLINK-29297 Project

[jira] [Created] (FLINK-29294) Introduce a CompactTask for full compaction

2022-09-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29294: --- Summary: Introduce a CompactTask for full compaction Key: FLINK-29294 URL: https://issues.apache.org/jira/browse/FLINK-29294 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-29293) Introduce a MergeFunction for full compaction

2022-09-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29293: --- Summary: Introduce a MergeFunction for full compaction Key: FLINK-29293 URL: https://issues.apache.org/jira/browse/FLINK-29293 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-29292) Change MergeFunction to produce not only KeyValues

2022-09-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29292: --- Summary: Change MergeFunction to produce not only KeyValues Key: FLINK-29292 URL: https://issues.apache.org/jira/browse/FLINK-29292 Project: Flink Issue Type

[jira] [Created] (FLINK-29291) Change DataFileWriter into a factory to create writers

2022-09-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29291: --- Summary: Change DataFileWriter into a factory to create writers Key: FLINK-29291 URL: https://issues.apache.org/jira/browse/FLINK-29291 Project: Flink Issue

[jira] [Created] (FLINK-29290) Produce changelog during full compaction in Table Store

2022-09-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29290: --- Summary: Produce changelog during full compaction in Table Store Key: FLINK-29290 URL: https://issues.apache.org/jira/browse/FLINK-29290 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink Committer - Caizhi Weng

2022-09-10 Thread Caizhi Weng
57写道: > > > > > > > > > Congrats Chaizhi! > > > > > > > > > > Best, > > > > > Kurt > > > > > > > > > > > > > > > On Fri, Sep 9, 2022 at 2:44 PM yuxia > > > > wrot

[jira] [Created] (FLINK-29142) round(float, int) fails to compile in Flink 1.14

2022-08-30 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29142: --- Summary: round(float, int) fails to compile in Flink 1.14 Key: FLINK-29142 URL: https://issues.apache.org/jira/browse/FLINK-29142 Project: Flink Issue Type

Re: [VOTE] Apache Flink Table Store 0.2.0, release candidate #2

2022-08-24 Thread Caizhi Weng
Hi all! -1 for this release candidate as Hive catalog and Hive connector fail to support Hive CDH. See https://issues.apache.org/jira/browse/FLINK-29071 for more detail. Yu Li 于2022年8月23日周二 17:31写道: > +1 (binding) > > - Checked release notes: *Action Required* > - Minor: there're still 25 op

[jira] [Created] (FLINK-29071) Fix Table Store Hive CDH support

2022-08-22 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29071: --- Summary: Fix Table Store Hive CDH support Key: FLINK-29071 URL: https://issues.apache.org/jira/browse/FLINK-29071 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28967) Fix Hive multi-version support for Table Store

2022-08-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28967: --- Summary: Fix Hive multi-version support for Table Store Key: FLINK-28967 URL: https://issues.apache.org/jira/browse/FLINK-28967 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28760) Hive table store support can't be fully enabled by ADD JAR statement

2022-07-31 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28760: --- Summary: Hive table store support can't be fully enabled by ADD JAR statement Key: FLINK-28760 URL: https://issues.apache.org/jira/browse/FLINK-28760 Project:

[jira] [Created] (FLINK-28730) Add Tez execution engine test for Table Store Hive connector

2022-07-28 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28730: --- Summary: Add Tez execution engine test for Table Store Hive connector Key: FLINK-28730 URL: https://issues.apache.org/jira/browse/FLINK-28730 Project: Flink

[jira] [Created] (FLINK-28717) Table Store Hive connector will throw exception if primary key fields are not selected

2022-07-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28717: --- Summary: Table Store Hive connector will throw exception if primary key fields are not selected Key: FLINK-28717 URL: https://issues.apache.org/jira/browse/FLINK-28717

[jira] [Created] (FLINK-28700) Table store sink fails to commit for Flink 1.14 batch job

2022-07-26 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28700: --- Summary: Table store sink fails to commit for Flink 1.14 batch job Key: FLINK-28700 URL: https://issues.apache.org/jira/browse/FLINK-28700 Project: Flink

[jira] [Created] (FLINK-28662) Compaction may block job cancelling

2022-07-24 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28662: --- Summary: Compaction may block job cancelling Key: FLINK-28662 URL: https://issues.apache.org/jira/browse/FLINK-28662 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-28605) Throw exception intentionally when new snapshots are committed during restore

2022-07-19 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28605: --- Summary: Throw exception intentionally when new snapshots are committed during restore Key: FLINK-28605 URL: https://issues.apache.org/jira/browse/FLINK-28605 Project

[jira] [Created] (FLINK-28582) LSM tree structure may be incorrect when multiple jobs are committing into the same bucket

2022-07-18 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28582: --- Summary: LSM tree structure may be incorrect when multiple jobs are committing into the same bucket Key: FLINK-28582 URL: https://issues.apache.org/jira/browse/FLINK-28582

[jira] [Created] (FLINK-28190) NullPointerException is thrown if the intermediate result of nesting UDFs is used

2022-06-21 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28190: --- Summary: NullPointerException is thrown if the intermediate result of nesting UDFs is used Key: FLINK-28190 URL: https://issues.apache.org/jira/browse/FLINK-28190

[jira] [Created] (FLINK-28079) Check Hive DDL against table store schema when creating table

2022-06-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28079: --- Summary: Check Hive DDL against table store schema when creating table Key: FLINK-28079 URL: https://issues.apache.org/jira/browse/FLINK-28079 Project: Flink

[jira] [Created] (FLINK-28020) Refactor Flink connector for table store with FileStoreTable

2022-06-13 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28020: --- Summary: Refactor Flink connector for table store with FileStoreTable Key: FLINK-28020 URL: https://issues.apache.org/jira/browse/FLINK-28020 Project: Flink

[jira] [Created] (FLINK-28014) Extract snapshot related methods to SnapshotManager

2022-06-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28014: --- Summary: Extract snapshot related methods to SnapshotManager Key: FLINK-28014 URL: https://issues.apache.org/jira/browse/FLINK-28014 Project: Flink Issue Type

[jira] [Created] (FLINK-27973) Introduce TableWrite and TableCommit as an abstraction layer above FileStore for writing RowData

2022-06-09 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27973: --- Summary: Introduce TableWrite and TableCommit as an abstraction layer above FileStore for writing RowData Key: FLINK-27973 URL: https://issues.apache.org/jira/browse/FLINK-27973

[jira] [Created] (FLINK-27957) Extract AppendOnlyFileStore out of KeyValueFileStore

2022-06-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27957: --- Summary: Extract AppendOnlyFileStore out of KeyValueFileStore Key: FLINK-27957 URL: https://issues.apache.org/jira/browse/FLINK-27957 Project: Flink Issue

[jira] [Created] (FLINK-27875) Introduce TableScan and TableRead as an abstraction layer above FileStore for reading RowData

2022-06-01 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27875: --- Summary: Introduce TableScan and TableRead as an abstraction layer above FileStore for reading RowData Key: FLINK-27875 URL: https://issues.apache.org/jira/browse/FLINK-27875

[jira] [Created] (FLINK-27863) Refactor RecordReader and RecordIterator in table store into generic types

2022-06-01 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27863: --- Summary: Refactor RecordReader and RecordIterator in table store into generic types Key: FLINK-27863 URL: https://issues.apache.org/jira/browse/FLINK-27863 Project

[jira] [Created] (FLINK-27835) Introduce LeafPredicate interface and children method in Predicate

2022-05-30 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27835: --- Summary: Introduce LeafPredicate interface and children method in Predicate Key: FLINK-27835 URL: https://issues.apache.org/jira/browse/FLINK-27835 Project: Flink

[jira] [Created] (FLINK-27814) Add an abstraction layer for connectors to read and write row data instead of key-values

2022-05-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27814: --- Summary: Add an abstraction layer for connectors to read and write row data instead of key-values Key: FLINK-27814 URL: https://issues.apache.org/jira/browse/FLINK-27814

[jira] [Created] (FLINK-27739) Add benchmark module for table store

2022-05-23 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27739: --- Summary: Add benchmark module for table store Key: FLINK-27739 URL: https://issues.apache.org/jira/browse/FLINK-27739 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27629) Table Store throws NullPointerException when pushing down NotEqual predicate to a column consisting of nulls

2022-05-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27629: --- Summary: Table Store throws NullPointerException when pushing down NotEqual predicate to a column consisting of nulls Key: FLINK-27629 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-27628) Table Store records and fetches incorrect results with NaN

2022-05-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27628: --- Summary: Table Store records and fetches incorrect results with NaN Key: FLINK-27628 URL: https://issues.apache.org/jira/browse/FLINK-27628 Project: Flink

[jira] [Created] (FLINK-27627) Incorrect result when order by (string, double) pair with NaN values

2022-05-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27627: --- Summary: Incorrect result when order by (string, double) pair with NaN values Key: FLINK-27627 URL: https://issues.apache.org/jira/browse/FLINK-27627 Project: Flink

[jira] [Created] (FLINK-27589) Fix incorrect implementation of TableStoreDateObjectInspector

2022-05-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27589: --- Summary: Fix incorrect implementation of TableStoreDateObjectInspector Key: FLINK-27589 URL: https://issues.apache.org/jira/browse/FLINK-27589 Project: Flink

[jira] [Created] (FLINK-27580) Implement filter pushdown for TableStoreHiveStorageHandler

2022-05-12 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27580: --- Summary: Implement filter pushdown for TableStoreHiveStorageHandler Key: FLINK-27580 URL: https://issues.apache.org/jira/browse/FLINK-27580 Project: Flink

[jira] [Created] (FLINK-27562) Creating HDFS table in SQL client throws UnsupportedFileSystemSchemeException even if hadoop jar is added through --jar argument

2022-05-10 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27562: --- Summary: Creating HDFS table in SQL client throws UnsupportedFileSystemSchemeException even if hadoop jar is added through --jar argument Key: FLINK-27562 URL: https

Re: [DISCUSS] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-09 Thread Caizhi Weng
Hi all! +1 for this FLIP. By adding schema information into data files we can not only support schema evolution, which is a very useful feature for data storages, but also make it easier for table store to integrate with other systems. For example timestamp type in Hive does not support precision

[jira] [Created] (FLINK-27542) Add end to end tests for Hive to read external table store files

2022-05-07 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27542: --- Summary: Add end to end tests for Hive to read external table store files Key: FLINK-27542 URL: https://issues.apache.org/jira/browse/FLINK-27542 Project: Flink

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

2022-04-29 Thread Caizhi Weng
Hi all! +1 for the release (non-binding). I've tested the jar with a standalone cluster and SQL client. - Compiled the sources; - Run through quick start guide; - Test all supported data types; - Check that table store jar has no conflict with orc / avro format and kafka connector;

[jira] [Created] (FLINK-27439) Fix ClassNotFoundException when using array type in table store

2022-04-28 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27439: --- Summary: Fix ClassNotFoundException when using array type in table store Key: FLINK-27439 URL: https://issues.apache.org/jira/browse/FLINK-27439 Project: Flink

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #1

2022-04-27 Thread Caizhi Weng
Hi all! -1 for this release. Currently we cannot write array and map types into table store due to this commit . Run the following SQL in SQL client and an exception will be thrown: create table if not ex

[jira] [Created] (FLINK-27408) Package Flink runtime dependencies into associated table store modules instead of flink-table-store-dist

2022-04-25 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27408: --- Summary: Package Flink runtime dependencies into associated table store modules instead of flink-table-store-dist Key: FLINK-27408 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-27286) Fix table store connector throws ClassNotFoundException: org.apache.flink.table.store.shaded.org.apache.flink.connector.file.table.RowDataPartitionComputer

2022-04-18 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27286: --- Summary: Fix table store connector throws ClassNotFoundException: org.apache.flink.table.store.shaded.org.apache.flink.connector.file.table.RowDataPartitionComputer Key: FLINK-27286

[jira] [Created] (FLINK-27283) Add end to end tests for table store

2022-04-18 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27283: --- Summary: Add end to end tests for table store Key: FLINK-27283 URL: https://issues.apache.org/jira/browse/FLINK-27283 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-27139) FileStoreCommitImpl#filterCommitted should exit when faced with expired files

2022-04-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27139: --- Summary: FileStoreCommitImpl#filterCommitted should exit when faced with expired files Key: FLINK-27139 URL: https://issues.apache.org/jira/browse/FLINK-27139 Project

[jira] [Created] (FLINK-27136) Disable rolling file when writing level 0 sst files

2022-04-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27136: --- Summary: Disable rolling file when writing level 0 sst files Key: FLINK-27136 URL: https://issues.apache.org/jira/browse/FLINK-27136 Project: Flink Issue Type

[jira] [Created] (FLINK-27135) Rename 'file.path' table option in table store to 'path'

2022-04-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27135: --- Summary: Rename 'file.path' table option in table store to 'path' Key: FLINK-27135 URL: https://issues.apache.org/jira/browse/FLINK-27135 Project: F

[jira] [Created] (FLINK-27089) Calling TRY_CAST with an invalid value throws IndexOutOfBounds Exception.

2022-04-06 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27089: --- Summary: Calling TRY_CAST with an invalid value throws IndexOutOfBounds Exception. Key: FLINK-27089 URL: https://issues.apache.org/jira/browse/FLINK-27089 Project

[jira] [Created] (FLINK-27085) Introduce snapshot.num-retained.min option

2022-04-06 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27085: --- Summary: Introduce snapshot.num-retained.min option Key: FLINK-27085 URL: https://issues.apache.org/jira/browse/FLINK-27085 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-27070) Reuse FileFormat instead of DecodingFormat/EncodingFormat to ensure thread safety.

2022-04-05 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27070: --- Summary: Reuse FileFormat instead of DecodingFormat/EncodingFormat to ensure thread safety. Key: FLINK-27070 URL: https://issues.apache.org/jira/browse/FLINK-27070

[jira] [Created] (FLINK-27004) Use '.' instead of 'file..' in table properties of managed table

2022-04-02 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27004: --- Summary: Use '.' instead of 'file..' in table properties of managed table Key: FLINK-27004 URL: https://issues.apache.org/jira/browse/FLINK-27004

[jira] [Created] (FLINK-26703) Introduce flink-table-store-dist module for packaging

2022-03-17 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-26703: --- Summary: Introduce flink-table-store-dist module for packaging Key: FLINK-26703 URL: https://issues.apache.org/jira/browse/FLINK-26703 Project: Flink Issue

[jira] [Created] (FLINK-26648) Ban dependencies on flink-table-planner and depend on flink-table-planner-loader instead

2022-03-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-26648: --- Summary: Ban dependencies on flink-table-planner and depend on flink-table-planner-loader instead Key: FLINK-26648 URL: https://issues.apache.org/jira/browse/FLINK-26648

[jira] [Created] (FLINK-26544) Apply key & value filter in FileStoreScanImpl

2022-03-08 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-26544: --- Summary: Apply key & value filter in FileStoreScanImpl Key: FLINK-26544 URL: https://issues.apache.org/jira/browse/FLINK-26544 Project: Flink Issue Type:

[jira] [Created] (FLINK-26526) Record hasNull and allNull instead of nullCount in fieldStats

2022-03-07 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-26526: --- Summary: Record hasNull and allNull instead of nullCount in fieldStats Key: FLINK-26526 URL: https://issues.apache.org/jira/browse/FLINK-26526 Project: Flink

  1   2   3   >