awdavidson commented on issue #731: URL: https://github.com/apache/incubator-uniffle/issues/731#issuecomment-1513812616
I think there needs to be a better solution for this problem? Currently, this limitation prevents large scale and iterative applications from using uniffle as we have an upper limit of approximately 1.2m tasks across the entire application because the `taskAttemptId` is being used. What’s the feasibility of using a combination of the `stageId` and `taskId`? What else can be done? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
