TaoZex commented on PR #3631: URL: https://github.com/apache/incubator-seatunnel/pull/3631#issuecomment-1340543258
> @TaoZex Hi, I have one question is that if 50 million rows of my source data are queried at one time. `batch_max_rows` is set to 100000, will 500 stream load requests be sent to Doris at the same time? > > As far as I know, the maximum number of concurrent stream load requests supported by a Doris database by default is 100. Can you add a config to control the number of concurrent requests in your code? > > <img alt="image" width="640" src="https://user-images.githubusercontent.com/24907215/206080188-ab67cd98-3d8e-4644-ad17-181fcf450d81.png"> Thanks for your advice. In flush method, synchronized has been added. I tested it locally, and this problem didn't happen yet. I intend to improve the concurrency efficiency even more in the next release. Welcome to join us. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
