TaoZex commented on PR #3631:
URL: 
https://github.com/apache/incubator-seatunnel/pull/3631#issuecomment-1340543258

   > @TaoZex Hi, I have one question is that if 50 million rows of my source 
data are queried at one time. `batch_max_rows` is set to 100000, will 500 
stream load requests be sent to Doris at the same time?
   > 
   > As far as I know, the maximum number of concurrent stream load requests 
supported by a Doris database by default is 100. Can you add a config to 
control the number of concurrent requests in your code?
   > 
   > <img alt="image" width="640" 
src="https://user-images.githubusercontent.com/24907215/206080188-ab67cd98-3d8e-4644-ad17-181fcf450d81.png";>
   
   Thanks for your advice. In flush method, synchronized has been added. I 
tested it locally, and this problem didn't happen yet. I intend to improve the 
concurrency efficiency even more in the next release. Welcome to join us.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to