gnehil commented on issue #200: URL: https://github.com/apache/doris-spark-connector/issues/200#issuecomment-2510418441
Hi, Yufei Thanks for your interest in the community. This is a good suggestion.For the current code structure, all functions are in one module. Since different spark versions map the date and timestamp types in catalyst to different java classes, it is difficult to be compatible with different versions of the API. But the good news is that an important refactoring is underway and will be released in the next version. So after this, different data deserialization can be performed for different spark versions, and this problem will not be difficult to solve. This optimization can be planned to be released in the version after next, and you are also welcome to contribute this optimization to the community. Best regards Li Heng Yufei Ding ***@***.***> 于2024年11月29日周五 20:17写道: > Would it be possible to add a parameter that allows users to choose > whether to convert datetime to timestamp? In Spark, using string-type dates > can sometimes cause confusion and require additional conversion steps for > users. > > — > Reply to this email directly, view it on GitHub > <https://github.com/apache/doris-spark-connector/issues/200#issuecomment-2507703611>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AHFVVKCY54EW4YNCCBT3XGT2DBLOFAVCNFSM6AAAAABGYH73VOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMBXG4YDGNRRGE> > . > You are receiving this because you commented.Message ID: > ***@***.***> > -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org