Sentiaus commented on issue #4240: URL: https://github.com/apache/texera/issues/4240#issuecomment-4636857621
@xuang7 I did consider a backend flow, however the UI already had the download service which I tried to use. I can make a redesign for a flow where we export directly from the backend. When I was initially making the design, I considered the size of the biggest public files hosted in Hub and thought it was fine to go with a frontend only design based on this. One way we could go about implementing this would be adding a function in ResultExportService to export to drive and WorkflowExecutionService for the endpoint. Currently the largest public files in Hub are about 1-2 GBs. Is it safe to assume we should account for the biggest files to be ~100-200 GB? If this is required then on top of adding the functions above, we may want to create a background job that handles this. As for the Token Storage, I do think the current implementation of Token Storage is standard, but it can be improved by using a KMS to do envelope encryption, rather than having a key in configuration. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
