syb853553110 commented on issue #5566: URL: https://github.com/apache/dolphinscheduler/issues/5566#issuecomment-852013212
> @syb853553110 It's hard code, you can submit a pr to improve. In addition, I think the way the attachment is generated can be optimized. The current plan is to put all into a JSONArray, and then generate files. I think it is possible to write 10,000 files at a time, which can solve the problem of excessive memory usage caused by putting all the files in the memory at one time. Is the limit of 10,000 also considered the problem of excessive memory usage when the amount of data is too large? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
