naxels opened a new issue, #5656:
URL: https://github.com/apache/seatunnel/issues/5656

   ### Search before asking
   
   - [X] I had searched in the 
[feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Description
   
   Hi team,
   
   Love SeaTunnel and have been seriously considering it for our future data 
integration needs at work.
   
   The one problem I stumble into with Oracle, one of our bigger databases is 
the NUMBER type.
   Looking through the issues & pull requests etc, I see that many other people 
are facing this issue.
   
   We as well cannot use the parallel feature to optimally move thousands of 
records unfortunately.
   
   I ran the OracleCatalog.java SELECT_COLUMNS_SQL_TEMPLATE SQL script
   and this was returned:
   
   <img width="1050" alt="image" 
src="https://github.com/apache/seatunnel/assets/3195443/ad3e216b-6ff4-4ecb-86f8-16e5207ad52f";>
   
   clearly with the defaults throwing me into Decimal territory.
   
   Given that this is a hard problem to solve with Oracle and the code is 
already complex to try to turn it into a number.
   
   I started thinking, what if there is an additional config option for JDBC, 
called something like
   partition_type
   partition_datatype
   partition_overwrite_type
   
   and setting this to integer or true (depending on your future thoughts 
regarding parallel support)
   would force SeaTunnel to act as if the column is indeed an Integer (or 
future supported type) and not a Decimal.
   
   Thank you for considering and keep up the good work!
   
   ### Usage Scenario
   
   For Oracle connector parallel execution, speeding up data transfers
   
   ### Related issues
   
   https://github.com/apache/seatunnel/pull/4439
   
   https://github.com/apache/seatunnel/pull/5209
   
   https://github.com/apache/seatunnel/issues/5204
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to