+1 from the developer of flink-connector-pulsar
I just want to add the comments here for the newly introduced breaking
changes in 4.0.0
Breaking Changes
Some classes and interfaces which are annotated with @PublicEvolving
have been changed in this release. And this may affect the end-users.
.apache.org/thread/d6nd7xx11fd67z5h56sv0tlo5pvlm94o
>
> Do let me know if that's a good one, or if this should be cancelled.
>
> Best regards,
>
> Martijn
>
> On Thu, Apr 13, 2023 at 4:23 PM Yufan Sheng wrote:
>
> > Hello all,
> >
> > I would like to discuss the rel
Hello all,
I would like to discuss the release of Pulsar Connectors v4.0.0.
A lot of new features and bug fixes have been added to
flink-connector-pulsar 4.0.0 release. It also introduces some break
changes in this release.
Improvements
[FLINK-28083] PulsarSource works with object-reusing
Yufan Sheng created FLINK-31427:
---
Summary: Pulsar Catalog support with Schema translation
Key: FLINK-31427
URL: https://issues.apache.org/jira/browse/FLINK-31427
Project: Flink
Issue Type: Sub
Yufan Sheng created FLINK-31107:
---
Summary: Can't subscribe the non-persistent topics by using regex
in Pulsar 2.11.0
Key: FLINK-31107
URL: https://issues.apache.org/jira/browse/FLINK-31107
Project
Yufan Sheng created FLINK-31101:
---
Summary: Replace all the JUnit 5 assertions to AssertJ
Key: FLINK-31101
URL: https://issues.apache.org/jira/browse/FLINK-31101
Project: Flink
Issue Type
Yufan Sheng created FLINK-31100:
---
Summary: Support the short topic pattern subscriber on default
tenant and namespace
Key: FLINK-31100
URL: https://issues.apache.org/jira/browse/FLINK-31100
Project
Yufan Sheng created FLINK-30689:
---
Summary: Use auto produce bytes schema in Pulsar sink
Key: FLINK-30689
URL: https://issues.apache.org/jira/browse/FLINK-30689
Project: Flink
Issue Type
Yufan Sheng created FLINK-30657:
---
Summary: Disable Shared and Key_Shared related tests in Pulsar
connector
Key: FLINK-30657
URL: https://issues.apache.org/jira/browse/FLINK-30657
Project: Flink
Yufan Sheng created FLINK-30622:
---
Summary: Support auto consume schema in Pulsar source
Key: FLINK-30622
URL: https://issues.apache.org/jira/browse/FLINK-30622
Project: Flink
Issue Type: New
Yufan Sheng created FLINK-30606:
---
Summary: Bump Pulsar to 2.11.0
Key: FLINK-30606
URL: https://issues.apache.org/jira/browse/FLINK-30606
Project: Flink
Issue Type: Improvement
Yufan Sheng created FLINK-30552:
---
Summary: Pulsar connector shouldn't assert the BatchMessageId size.
Key: FLINK-30552
URL: https://issues.apache.org/jira/browse/FLINK-30552
Project: Flink
+1. And I can see that the pending issue FLINK-30430 is in the 3.0
release. Since the first 3.0 release only externalize the
flink-connector-pulsar, we can remove the FLINK-30430 from the 3.0.0
and add it back after 3.0.0 getting released.
On Thu, Dec 15, 2022 at 11:41 PM Martijn Visser
wrote:
>
Yufan Sheng created FLINK-30430:
---
Summary: Remove the useless dependencies in
flink-connector-pulsar's dependencyManagement
Key: FLINK-30430
URL: https://issues.apache.org/jira/browse/FLINK-30430
Yufan Sheng created FLINK-30413:
---
Summary: Drop Share and Key_Shared subscription support in Pulsar
connector
Key: FLINK-30413
URL: https://issues.apache.org/jira/browse/FLINK-30413
Project: Flink
Yufan Sheng created FLINK-29709:
---
Summary: Bump Pulsar to 2.10.2
Key: FLINK-29709
URL: https://issues.apache.org/jira/browse/FLINK-29709
Project: Flink
Issue Type: Technical Debt
Yufan Sheng created FLINK-29580:
---
Summary: pulsar.consumer.autoUpdatePartitionsIntervalSeconds
doesn't works and should be removed
Key: FLINK-29580
URL: https://issues.apache.org/jira/browse/FLINK-29580
Yufan Sheng created FLINK-29433:
---
Summary: Support Auth through the builder pattern in Pulsar
connector
Key: FLINK-29433
URL: https://issues.apache.org/jira/browse/FLINK-29433
Project: Flink
Yufan Sheng created FLINK-29381:
---
Summary: Key_Shared subscription isn't works in the latest Pulsar
connector
Key: FLINK-29381
URL: https://issues.apache.org/jira/browse/FLINK-29381
Project: Flink
Yufan Sheng created FLINK-28960:
---
Summary: java.lang.NoClassDefFoundError:
javax/xml/bind/annotation/XmlElement
Key: FLINK-28960
URL: https://issues.apache.org/jira/browse/FLINK-28960
Project: Flink
Yufan Sheng created FLINK-28959:
---
Summary: 504 gateway timeout when consume large number of topics
using TopicPatten
Key: FLINK-28959
URL: https://issues.apache.org/jira/browse/FLINK-28959
Project
Yufan Sheng created FLINK-28934:
---
Summary: Pulsar Source put all the splits to only one parallelism
when using Exclusive subscription
Key: FLINK-28934
URL: https://issues.apache.org/jira/browse/FLINK-28934
Yufan Sheng created FLINK-28506:
---
Summary: Pulsar sink don't support zero timestamp which may be
provided by flink
Key: FLINK-28506
URL: https://issues.apache.org/jira/browse/FLINK-28506
Project: Flink
Yufan Sheng created FLINK-28505:
---
Summary: Pulsar sink doesn't support topic auto creation
Key: FLINK-28505
URL: https://issues.apache.org/jira/browse/FLINK-28505
Project: Flink
Issue Type
Yufan Sheng created FLINK-28351:
---
Summary: Pulsar Sink should support dynamic generated topic from
record
Key: FLINK-28351
URL: https://issues.apache.org/jira/browse/FLINK-28351
Project: Flink
Yufan Sheng created FLINK-28085:
---
Summary: Close all the pending Pulsar transactions when flink
shutdown the pipeline.
Key: FLINK-28085
URL: https://issues.apache.org/jira/browse/FLINK-28085
Project
Yufan Sheng created FLINK-28084:
---
Summary: Pulsar unordered reader should disable retry and delete
reconsume logic.
Key: FLINK-28084
URL: https://issues.apache.org/jira/browse/FLINK-28084
Project
Yufan Sheng created FLINK-28083:
---
Summary: PulsarSource cannot work with object-reusing
DeserializationSchema.
Key: FLINK-28083
URL: https://issues.apache.org/jira/browse/FLINK-28083
Project: Flink
Yufan Sheng created FLINK-28082:
---
Summary: Support end to end encryption on Pulsar connector.
Key: FLINK-28082
URL: https://issues.apache.org/jira/browse/FLINK-28082
Project: Flink
Issue Type
Yufan Sheng created FLINK-27400:
---
Summary: Pulsar connector subscribed the system topic when using
the regex
Key: FLINK-27400
URL: https://issues.apache.org/jira/browse/FLINK-27400
Project: Flink
Yufan Sheng created FLINK-27399:
---
Summary: Pulsar connector didn't set start consuming position
correctly
Key: FLINK-27399
URL: https://issues.apache.org/jira/browse/FLINK-27399
Project: Flink
Yufan Sheng created FLINK-27199:
---
Summary: Bump Pulsar to 2.10.0 for increasing the test stability
Key: FLINK-27199
URL: https://issues.apache.org/jira/browse/FLINK-27199
Project: Flink
Issue
Yufan Sheng created FLINK-26931:
---
Summary: Pulsar sink's producer name should be unique
Key: FLINK-26931
URL: https://issues.apache.org/jira/browse/FLINK-26931
Project: Flink
Issue Type: Bug
Yufan Sheng created FLINK-26182:
---
Summary: E2E test for PulsarSink on new Flink sink testing tools
Key: FLINK-26182
URL: https://issues.apache.org/jira/browse/FLINK-26182
Project: Flink
Issue
Yufan Sheng created FLINK-26038:
---
Summary: Support delay message on Pulsar sink
Key: FLINK-26038
URL: https://issues.apache.org/jira/browse/FLINK-26038
Project: Flink
Issue Type: Sub-task
Yufan Sheng created FLINK-26028:
---
Summary: Write documentation for new PulsarSink
Key: FLINK-26028
URL: https://issues.apache.org/jira/browse/FLINK-26028
Project: Flink
Issue Type: Sub-task
Yufan Sheng created FLINK-26026:
---
Summary: Test FLIP-191 PulsarSink
Key: FLINK-26026
URL: https://issues.apache.org/jira/browse/FLINK-26026
Project: Flink
Issue Type: Sub-task
Yufan Sheng created FLINK-26027:
---
Summary: Add FLIP-33 metrics to new PulsarSink
Key: FLINK-26027
URL: https://issues.apache.org/jira/browse/FLINK-26027
Project: Flink
Issue Type: Sub-task
Yufan Sheng created FLINK-26025:
---
Summary: Replace MockPulsar with new Pulsar test tools based on
PulsarStandalone
Key: FLINK-26025
URL: https://issues.apache.org/jira/browse/FLINK-26025
Project: Flink
Yufan Sheng created FLINK-26024:
---
Summary: Create a PulsarSerializationSchema for better records
serialization
Key: FLINK-26024
URL: https://issues.apache.org/jira/browse/FLINK-26024
Project: Flink
Yufan Sheng created FLINK-26023:
---
Summary: Create a Pulsar sink config model for matching
ProducerConfigurationData
Key: FLINK-26023
URL: https://issues.apache.org/jira/browse/FLINK-26023
Project
Yufan Sheng created FLINK-26022:
---
Summary: Implement at-least-once and exactly-once Pulsar Sink
Key: FLINK-26022
URL: https://issues.apache.org/jira/browse/FLINK-26022
Project: Flink
Issue
Yufan Sheng created FLINK-26021:
---
Summary: Pulsar topic deduplicated in both sink and source
connector
Key: FLINK-26021
URL: https://issues.apache.org/jira/browse/FLINK-26021
Project: Flink
Yufan Sheng created FLINK-26020:
---
Summary: Unified Pulsar Connector config model
Key: FLINK-26020
URL: https://issues.apache.org/jira/browse/FLINK-26020
Project: Flink
Issue Type: Sub-task
Yufan Sheng created FLINK-24302:
---
Summary: Direct buffer memory leak on Pulsar connector with Java 11
Key: FLINK-24302
URL: https://issues.apache.org/jira/browse/FLINK-24302
Project: Flink
Yufan Sheng created FLINK-24283:
---
Summary: Pulsar connector won't use given hash ranges in
Key_Shared mode
Key: FLINK-24283
URL: https://issues.apache.org/jira/browse/FLINK-24283
Project: Flink
Yufan Sheng created FLINK-24246:
---
Summary: Bump Pulsar to 2.8.1
Key: FLINK-24246
URL: https://issues.apache.org/jira/browse/FLINK-24246
Project: Flink
Issue Type: Improvement
Yufan Sheng created FLINK-23877:
---
Summary: Embedded Pulsar broker backend for testing
Key: FLINK-23877
URL: https://issues.apache.org/jira/browse/FLINK-23877
Project: Flink
Issue Type: Sub
Yufan Sheng created FLINK-23864:
---
Summary: The document for Pulsar Source
Key: FLINK-23864
URL: https://issues.apache.org/jira/browse/FLINK-23864
Project: Flink
Issue Type: Sub-task
49 matches
Mail list logo
