+1 from me. It will be very useful if we can have something that can gather troubleshooting info easily. This part takes a while currently.
On Mon, May 30, 2022 at 9:52 AM Shiyan Xu <xu.shiyan.raym...@gmail.com> wrote: > Hi all, > > When troubleshooting Hudi jobs in users' environments, we always ask users > to share configs, environment info, check spark UI, etc. Here is an RFC > idea: can we extend the Hudi metrics system and make a diagnostic reporter? > It can be turned on like a normal metrics reporter. it should collect > common troubleshooting info and save to json or other human-readable text > format. Users should be able to run with it and share the diagnosis file. > The RFC should discuss what info should / can be collected. > > Does this make sense? Anyone interested in driving the RFC design and > implementation work? > > -- > Best, > Shiyan >
