unsubscribe

unsubscribe

Argo for general purpose k8s scheduling

Hi, Is there any update for use case of argo for k8s. As I understand it, Kubeflow uses it for scheduling. Outside of machine learning and MLOps on Kubernetes has anyone used Argo for standard ETL as well and if so any experience. Thanks Mich

Re: Spark File Output Committer algorithm for GCS

Thank you. Will try out these options. With Best Regards, On Wed, Jul 19, 2023 at 1:40 PM Mich Talebzadeh wrote: > Sounds like if the mv command is inherently slow, there is little that can > be done. > > The only suggestion I can make is to create the staging table as > compressed to

Re: Spark File Output Committer algorithm for GCS

Sounds like if the mv command is inherently slow, there is little that can be done. The only suggestion I can make is to create the staging table as compressed to reduce its size and hence mv? Is that feasible? Also the managed table can be created with SNAPPY compression STORED AS ORC