FANNG1 commented on PR #9588: URL: https://github.com/apache/gravitino/pull/9588#issuecomment-3821354936
> For the 2nd problem, should I shade the Iceberg jar into this jar? If so, it will be bound to the specific Iceberg/Spark version. So my initial thought is not to put the Iceberg dependency into this job jar. It can be handled by users. What's your opinion? +1 for not shading the Iceberg runtime jar, besides place Iceberg runtime jar to spark classpath, should we provide a way to allow the user to specify the runtime jar path? > For the 3rd problem, the frequency of pulling the job state will hurt the performance, so I don't set a very short value by default. You can change the configuration. And for a production job, normally the job run time should not be very short, so I think it would not be a big problem in the real workload. The default time is 5 minutes. Could we shorten it to 10 or 20 seconds to balance performance and user experience? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
