caiconghui commented on issue #5680: URL: https://github.com/apache/incubator-doris/issues/5680#issuecomment-823990047
> > > @caiconghui insert-job, broker load job and transaction jobs could be checked by coders anytime . > > > how about make them persistence, such as store in itself, make it a write audit log > > > > > > this PR is mainly to control memory usage, and I think we can implement it in next PR > > high memory usage cause of lots of history jobs in it , persistence such as store it in Doris or write it in audit log can > > * reduce memory usage. > * be read any time by developpers for hisitory jobs. > > how do u like it ? what is the format for audit log ? file or table data? I think if job writed in file, it is hard to managed, if stored in table, the steps may be some A bit cumbersome and data may be lost because we need to stream load it. In my option, we can do audit log by fe plugin as a addtiional way to record it while you can set expire time short -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
