DanielLeens commented on issue #12753: URL: https://github.com/apache/seatunnel/issues/12753#issuecomment-6191909962
The `DECIMAL(39,0)` source-schema correction and the Spark limitation must be kept separate, but the limitation cannot be hidden by disabling Spark tests or by silently clamping to 38 digits. Either approach would leave a data-correctness regression unowned. Please do not add an implicit `DecimalType(>38) -> StringType` fallback to the shared Spark translator in #12787. That is a cross-connector schema-contract change and needs its own compatibility proposal, tests, EN/ZH documentation, and release-note decision. Conversely, #12787 should not merge while it makes every Spark read of a Doris LARGEINT schema fail before data is read. The next step is a dedicated Spark compatibility issue linked from #12787 that compares the viable explicit policies (a documented string representation, a clear preflight failure, or another preserved-schema approach) and covers the actual row-conversion path, not only schema construction. Keep #12787 focused on the Doris source representation and its Zeta/Flink coverage until that dependent Spark policy is agreed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
