vinothchandar commented on pull request #2899: URL: https://github.com/apache/hudi/pull/2899#issuecomment-834595116
>each writer task takes a AbstractWriteClient, and there may be multiple write tasks in one process. @danny0405 please help me understand this better. By one process, you mean one yarn flink job? or jvm process? In Spark, the model is the executors talk to the driver running the embedded timeline server in Spark. We don't run the timeline server in the executors. Could you explain the Flink model little more Let me look at the code again to see if/how we avoid the side effects in the meantime. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
