Sure, Horovod is commonly used on Spark for this: https://horovod.readthedocs.io/en/stable/spark_include.html
On Tue, Feb 22, 2022 at 8:51 PM Vijayant Kumar <vijayant.ku...@mavenir.com.invalid> wrote: > Hi All, > > > > Anyone using Apache spark with TensorFlow for building models. My > requirement is to use TensorFlow distributed model training across the > Spark executors. > > Please help me with some resources or some sample code. > > > > Thanks, > > Vijayant > ------------------------------ > > This e-mail message may contain confidential or proprietary information of > Mavenir Systems, Inc. or its affiliates and is intended solely for the use > of the intended recipient(s). If you are not the intended recipient of this > message, you are hereby notified that any review, use or distribution of > this information is absolutely prohibited and we request that you delete > all copies in your control and contact us by e-mailing to > secur...@mavenir.com. This message contains the views of its author and > may not necessarily reflect the views of Mavenir Systems, Inc. or its > affiliates, who employ systems to monitor email messages, but make no > representation that such messages are authorized, secure, uncompromised, or > free from computer viruses, malware, or other defects. Thank You >
