yihao-tcf commented on issue #9471: URL: https://github.com/apache/hudi/issues/9471#issuecomment-1695404040
> @yihao-tcf Thanks for raising this. I do understand your concern. Ideally run-once(without --continous) also should take care of incremental fetch according to source limit. We need a fix here. I believe that full data extraction does not require sub queries such as sourcelimit and pddquery, and users can be restricted from using the jdbc.fetchSize configuration. Setting the correct upper and lower limits, partition fields, and number of partitions using jdbc.fetchSize can improve extraction efficiency and reduce server load to a certain extent -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
