whutpencil opened a new issue, #66993:
URL: https://github.com/apache/doris/issues/66993
## Is your feature request related to a problem?
Doris currently hardcodes `characterEncoding=utf-8` for MySQL/OceanBase JDBC
catalogs. Users connecting to legacy MySQL tables stored in latin1 (or gbk,
etc.) cannot read their data correctly, because Doris always forces UTF-8 and
even produces a duplicated parameter when the user specifies their own value:
```
jdbc:mysql://host:port/db?characterEncoding=latin1
```
becomes
```
jdbc:mysql://host:port/db?characterEncoding=latin1&characterEncoding=utf-8
```
## Describe the solution you'd like
Respect the `characterEncoding` value explicitly provided by the user in
`jdbc_url`. Concretely, in
`fe/fe-core/src/main/java/org/apache/doris/catalog/JdbcResource.java`, the
injection logic:
```java
newJdbcUrl = checkAndSetJdbcParam(dbType, newJdbcUrl, "characterEncoding",
"utf-8");
```
should skip injection when `characterEncoding` is already present (with any
value), and only append `characterEncoding=utf-8` as the default when it is
absent.
## Describe alternatives you've considered
1. Keep forcing UTF-8 but at least replace (not append) any user-specified
value — however this would still not serve latin1 users.
2. Add a new catalog property (e.g. `jdbc_character_encoding`) to control it
— heavier, and redundant since `jdbc_url` already carries the parameter.
## Additional context
- Root cause: `checkAndSetJdbcParam` checks
`jdbcUrl.contains("characterEncoding=utf-8")` literally, so any other value
(latin1/gbk/...) triggers appending a duplicate.
- Legacy latin1 tables are common in older systems; this limitation blocks
migration to Doris's JDBC federated queries.
- Current behavior exists on both branch-2.x and master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
