Re: [I] Towards Flink CDC 3.0 [flink-cdc]

2024-05-21 Thread via GitHub
shreelatak commented on issue #2600: URL: https://github.com/apache/flink-cdc/issues/2600#issuecomment-2121958079 Do you support Kafka as a data sink? https://nightlies.apache.org/flink/flink-cdc-docs-master/docs/connectors/kafka/#pipeline-connector-options per this, I see Kafka sink, bu

Re: [I] Towards Flink CDC 3.0 [flink-cdc]

2024-05-21 Thread via GitHub
yuxiqian commented on issue #2600: URL: https://github.com/apache/flink-cdc/issues/2600#issuecomment-2122019219 Hi @shreelatak, Kafka pipeline connector is supported in Flink CDC 3.1. However, it's a breaking update and package names like `com.ververica.cdc` have been renamed to `org.apache

Re: [I] Towards Flink CDC 3.0 [flink-cdc]

2024-05-21 Thread via GitHub
shreelatak commented on issue #2600: URL: https://github.com/apache/flink-cdc/issues/2600#issuecomment-2122125768 Hello @yuxiqian , thank you so much for the revert! Do you know which supporting mysql-cdc connector I can find for Flink CDC version 3.1 I can find, and where? My ya

(flink) branch master updated: [FLINK-35130][runtime] Simplify AvailabilityNotifierImpl to support speculative scheduler and improve performance

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 46aaea80830 [FLINK-35130][runtime] Simplify Av

Re: [I] Towards Flink CDC 3.0 [flink-cdc]

2024-05-21 Thread via GitHub
yuxiqian commented on issue #2600: URL: https://github.com/apache/flink-cdc/issues/2600#issuecomment-2122167426 Connectors are now released under Group ID `org.apache.flink`. Here are all available connector jars: https://central.sonatype.com/search?q=g:org.apache.flink%20cdc&smo=true --

Re: [I] Exception in thread "main" java.lang.NoSuchMethodError: 'void org.apache.flink.streaming.runtime.operators.sink.CommitterOperatorFactory.(org.apache.flink.api.connector.sink2.TwoPhaseCom

2024-05-21 Thread via GitHub
shreelatak commented on issue #3327: URL: https://github.com/apache/flink-cdc/issues/3327#issuecomment-2122188599 I have the same issue. What pipeline are you building? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

(flink) branch master updated: [hotfix] [streaming] Correct copying StreamPartitioner in rescale case

2024-05-21 Thread pnowojski
This is an automated email from the ASF dual-hosted git repository. pnowojski pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 11bd030aca8 [hotfix] [streaming] Correct copyi

Re: [I] Exception in thread "main" java.lang.NoSuchMethodError: 'void org.apache.flink.streaming.runtime.operators.sink.CommitterOperatorFactory.(org.apache.flink.api.connector.sink2.TwoPhaseCom

2024-05-21 Thread via GitHub
leonardBang closed issue #3327: Exception in thread "main" java.lang.NoSuchMethodError: 'void org.apache.flink.streaming.runtime.operators.sink.CommitterOperatorFactory.(org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink, boolean, boolean)' URL: https://github.com/apache/flink-cdc/iss

(flink) branch master updated: [hotfix][state] Create new copy for each SerializedCompositeKeyBuilder in ForStStateBackend (#24816)

2024-05-21 Thread hangxiang
This is an automated email from the ASF dual-hosted git repository. hangxiang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 5a2c1e07194 [hotfix][state] Create new copy fo

(flink) branch master updated (5a2c1e07194 -> 8b73ca955bc)

2024-05-21 Thread hong
This is an automated email from the ASF dual-hosted git repository. hong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 5a2c1e07194 [hotfix][state] Create new copy for each SerializedCompositeKeyBuilder in ForStStateBackend (#24816) ad

(flink) branch release-1.19 updated: [FLINK-35383][docs] Update compatibility matrix for 1.19 release

2024-05-21 Thread hong
This is an automated email from the ASF dual-hosted git repository. hong pushed a commit to branch release-1.19 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.19 by this push: new c4af0c388d0 [FLINK-35383][docs] Update

(flink) branch master updated (8b73ca955bc -> c1baf07d760)

2024-05-21 Thread fanrui
This is an automated email from the ASF dual-hosted git repository. fanrui pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 8b73ca955bc [FLINK-35383][docs] Update compatibility matrix for 1.19 release new 46db9264160 Revert "[FLINK-34954

(flink) 01/02: Revert "[FLINK-34954][core] Kryo Input bug fix"

2024-05-21 Thread fanrui
This is an automated email from the ASF dual-hosted git repository. fanrui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 46db92641602313c4f5c1390807222c344880e2d Author: Rui Fan <1996fan...@gmail.com> AuthorDate: Tue Apr 23 14:09:27 2024 +0800

(flink) 02/02: [FLINK-35215][core] Fix the bug when Kryo serialize length is 0

2024-05-21 Thread fanrui
This is an automated email from the ASF dual-hosted git repository. fanrui pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit c1baf07d7601a683f42997dc35dfaef4e41bc928 Author: Rui Fan <1996fan...@gmail.com> AuthorDate: Tue Apr 23 14:21:18 2024 +0800

Re: [I] Exception in thread "main" java.lang.NoSuchMethodError: 'void org.apache.flink.streaming.runtime.operators.sink.CommitterOperatorFactory.(org.apache.flink.api.connector.sink2.TwoPhaseCom

2024-05-21 Thread via GitHub
yuxiqian commented on issue #3327: URL: https://github.com/apache/flink-cdc/issues/3327#issuecomment-2123737082 Tracked in FLINK-35415. For new feature requests / bug reports, please open a ticket in [Flink JIRA Kanban](https://issues.apache.org/jira/projects/FLINK/summary). -- This is a

(flink) branch master updated (c1baf07d760 -> e502d2371ff)

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from c1baf07d760 [FLINK-35215][core] Fix the bug when Kryo serialize length is 0 new 4d7aebaed1d [hotfix] Temporari

(flink) 07/11: [FLINK-34549][API] Implement TaskInfo and expose it via RuntimeContext

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 0bc2041b23233eff9622753a0d4cfa3b03816421 Author: Weijie Guo AuthorDate: Tue Apr 9 11:47:35 2024 +0800 [FLINK-3454

(flink) 03/11: [FLINK-34549][API] Introduces and implements ProcessConfigurable

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 6691dc60019f25fe40babfdf82c1374842a65fe4 Author: Weijie Guo AuthorDate: Mon Apr 8 12:26:25 2024 +0800 [FLINK-3454

(flink) 06/11: [FLINK-34549][API] Implement JobInfo and expose it via RuntimeContext

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit ef7f1d03d790f329cf5da38bb3868810a8f0d97b Author: Weijie Guo AuthorDate: Mon Apr 8 17:25:39 2024 +0800 [FLINK-3454

(flink) 02/11: [FLINK-34549][API] Introduce SlotSharingGroup for v2 and move MemorySize to flink-core-api

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 1d73510bc2e30d5352a8cbbafd7939197a32cedb Author: Weijie Guo AuthorDate: Tue Apr 16 14:42:48 2024 +0800 [FLINK-345

(flink) 01/11: [hotfix] Temporarily revert the change that makes the v2 operator inherit from the async operator

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 4d7aebaed1d4ca693eefa49ecb3bef87e87d0b5c Author: Weijie Guo AuthorDate: Wed May 15 16:59:27 2024 +0800 [hotfix] T

(flink) 05/11: [FLINK-34549][API] Split partition-wise context from RuntimeContext

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 2b0e30329559c61caccb3591c7b5a535f311f823 Author: Weijie Guo AuthorDate: Tue Apr 16 18:03:18 2024 +0800 [FLINK-345

(flink) 04/11: [FLINK-34549][API] Introduce related components for runtime context

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit c17440cbfa0e8e9f3c794296cedaae043491f6cd Author: Weijie Guo AuthorDate: Mon Apr 8 17:19:21 2024 +0800 [FLINK-3454

(flink) 08/11: [FLINK-34549][API] Implement StateManager and expose it via PartitionedContext

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit c431efefdb0341abb118e45480d94caea2f44263 Author: Weijie Guo AuthorDate: Tue Apr 9 11:58:51 2024 +0800 [FLINK-3454

(flink) 10/11: [FLINK-34549][API] Expose MetricGroup via RuntimeContext

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit ff93e2aaa0e958a974839a317db09a3a4bb7197e Author: Weijie Guo AuthorDate: Tue Apr 9 18:09:03 2024 +0800 [FLINK-3454

(flink) 09/11: [FLINK-34549][API] Implement ProcessingTimeManager and expose it via PartitionedContext

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 545a0053ff2f0c467d405c3387e1a22b8723f6a4 Author: Weijie Guo AuthorDate: Tue Apr 9 17:56:11 2024 +0800 [FLINK-3454

(flink) 11/11: [FLINK-34549][API] Implement applyToAllPartitions for non-partitioned context

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit e502d2371ffea52ebfa6b8a1b9d2b4a23bc9bbaa Author: Weijie Guo AuthorDate: Wed Apr 17 17:57:25 2024 +0800 [FLINK-345

(flink-connector-elasticsearch) branch main updated: [FLINK-35287] Builder builds NetworkConfig for Elasticsearch connector 8

2024-05-21 Thread guoweijie
This is an automated email from the ASF dual-hosted git repository. guoweijie pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/main by this push: new 0b6d9f8 [FLINK-35287] Bu

(flink-connector-elasticsearch) branch dependabot/maven/flink-connector-elasticsearch-base/org.elasticsearch-elasticsearch-7.17.19 deleted (was 64a24ed)

2024-05-21 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/flink-connector-elasticsearch-base/org.elasticsearch-elasticsearch-7.17.19 in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git was 64a2

[I] Information that has disappeared from github appears on the web page. [flink-cdc]

2024-05-21 Thread via GitHub
911432 opened a new issue, #3345: URL: https://github.com/apache/flink-cdc/issues/3345 ### Please don't check the box below - [X] I'm aware that bugs and new features should be reported on Apache Jira or Flink mailing list instead of here ### Again, please don't check the box b

Re: [I] Information that has disappeared from github appears on the web page. [flink-cdc]

2024-05-21 Thread via GitHub
911432 commented on issue #3345: URL: https://github.com/apache/flink-cdc/issues/3345#issuecomment-2123881505 Information that has disappeared from github appears on the web page. [2024-05-22_page.webm](https://github.com/apache/flink-cdc/assets/30204381/659fce96-933d-429b-baf7-68d4867c03

[I] DataStreamSource oracle ID [flink-cdc]

2024-05-21 Thread via GitHub
zxzzhange opened a new issue, #3346: URL: https://github.com/apache/flink-cdc/issues/3346 ### Please don't check the box below - [X] I'm aware that bugs and new features should be reported on Apache Jira or Flink mailing list instead of here ### Again, please don't check the bo

Re: [I] DataStreamSource oracle ID [flink-cdc]

2024-05-21 Thread via GitHub
zxzzhange commented on issue #3346: URL: https://github.com/apache/flink-cdc/issues/3346#issuecomment-2123895559 ![WechatIMG180](https://github.com/apache/flink-cdc/assets/12606322/1393e68b-0468-413a-bc53-cd7fbd7b9985) OracleToMysqlSink.java: value: {"before":null,"afte