0AyanamiRei opened a new pull request, #67509:
URL: https://github.com/apache/doris/pull/67509
### What problem does this PR solve?
Issue Number: None
Related PR: #66634
Problem Summary: `ALTER ROUTINE LOAD` updated the displayed CSV `enclose`
and `escape` properties but left the cached parser bytes unchanged. Newly
planned tasks therefore continued using the parser configuration from `CREATE
ROUTINE LOAD`.
This change refreshes the cached CSV parser bytes whenever ALTER properties
are applied. It also rebuilds those derived cache values from `jobProperties`
while loading a checkpoint, repairing checkpoints written with the inconsistent
state. This is independent of load-description replay.
### Release note
`ALTER ROUTINE LOAD` now applies updated CSV `enclose` and `escape`
characters to subsequent tasks.
### Check List (For Author)
- Test
- [x] Regression test
- [x] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason
Unit test executed:
`DORIS_THIRDPARTY=/path/to/thirdparty-with-thrift-0.24.0 ./run-fe-ut.sh
--run org.apache.doris.load.routineload.KafkaRoutineLoadJobTest`
Result: 13 tests passed.
The existing Kafka regression test now truncates the table and publishes a
row that requires the altered `enclose` and `escape` values before checking the
result. It was not run locally because the configured Kafka regression service
is unavailable; CI will run it in the Kafka-enabled environment.
- Behavior changed:
- [ ] No.
- [x] Yes. New Routine Load tasks use CSV parser properties changed by
ALTER.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
