This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch auto-pick-60473-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from d8460d2dced branch-4.0: [fix](replica) do not select user drop replica
as possible #54434 (#60509)
add be3edc24f6a [Improve](StreamingJob) add max_filter_ratio and strict
mode for mysql/pg streaming job (#60473)
No new revisions were added by this update.
Summary of changes:
.../apache/doris/job/cdc/DataSourceConfigKeys.java | 4 ++
.../CommitOffsetRequest.java} | 25 ++++----
.../doris/job/cdc/request/FetchRecordRequest.java | 12 ----
.../job/cdc/request/JobBaseRecordRequest.java | 4 --
.../doris/job/cdc/request/WriteRecordRequest.java | 13 +---
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../doris/httpv2/rest/StreamingJobAction.java | 17 +----
.../streaming/DataSourceConfigValidator.java | 16 +++--
.../insert/streaming/StreamingInsertJob.java | 74 ++++++++++++++++++++--
.../streaming/StreamingJobSchedulerTask.java | 1 +
.../insert/streaming/StreamingJobStatistic.java | 3 +
.../insert/streaming/StreamingMultiTblTask.java | 37 +++++++++--
.../apache/doris/job/util/StreamingJobUtils.java | 5 +-
.../cdcclient/service/PipelineCoordinator.java | 10 +--
.../doris/cdcclient/sink/DorisBatchStreamLoad.java | 31 ++++++---
.../doris/cdcclient/sink/HttpPutBuilder.java | 9 +--
.../apache/doris/cdcclient/sink/LoadStatistic.java | 29 ++++-----
...t.out => test_streaming_mysql_job_errormsg.out} | 6 +-
.../cdc/test_streaming_mysql_job.groovy | 4 +-
.../test_streaming_mysql_job_create_alter.groovy | 2 +-
.../cdc/test_streaming_mysql_job_errormsg.groovy | 45 ++++++++++++-
.../cdc/test_streaming_mysql_job_restart_fe.groovy | 10 ++-
.../cdc/test_streaming_postgres_job.groovy | 4 +-
.../cdc/test_streaming_postgres_job_split.groovy | 6 +-
.../streaming_job/test_streaming_insert_job.groovy | 6 +-
.../test_streaming_insert_job_offset.groovy | 12 +++-
...st_streaming_job_alter_offset_restart_fe.groovy | 24 +++++--
.../test_streaming_job_restart_fe.groovy | 12 +++-
28 files changed, 295 insertions(+), 128 deletions(-)
copy
fe/fe-common/src/main/java/org/apache/doris/job/cdc/{split/AbstractSourceSplit.java
=> request/CommitOffsetRequest.java} (74%)
copy
fe/fe-core/src/main/java/org/apache/doris/job/disruptor/ExecuteTaskEvent.java
=>
fs_brokers/cdc_client/src/main/java/org/apache/doris/cdcclient/sink/LoadStatistic.java
(63%)
copy
regression-test/data/job_p0/streaming_job/cdc/{test_streaming_postgres_job_split.out
=> test_streaming_mysql_job_errormsg.out} (78%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]