Dear Sean,
I do agree with you to a certain extent, makes sense. Perhaps I am wrong in
asking for native integrations and not depending on over engineered
external solutions which have their own performance issues, and bottlenecks
in live production environment. But asking and stating ones
I faced
>>>> the issue of version dependencies on those and had a hard time fixing the
>>>> library compatibilities. Hence a couple of below doubts:-
>>>>
>>>>
>>>>
>>>>- Does *Horovod* have any dependencies
On the contrary, distributed deep learning is not data parallel. It's
dominated by the need to share parameters across workers.
Gourav, I don't understand what you're looking for. Have you looked at
Petastorm and Horovod? they _use Spark_, not another platform like Ray. Why
recreate this which has
>> there has been no major development recently on those libraries. I faced
>>> the issue of version dependencies on those and had a hard time fixing the
>>> library compatibilities. Hence a couple of below doubts:-
>>>
>>>
>>>
>>>
e any dependencies?
>>- Any other library which is suitable for my use case.?
>>- Any example code would really be of great help to understand.
>>
>>
>>
>> Thanks,
>>
>> Vijayant
>>
>>
>>
>> *From:* Sean Owen
>&
.?
>> Any example code would really be of great help to understand.
>>
>>
>> Thanks,
>>
>> Vijayant
>>
>>
>>
>> From: Sean Owen
>> Sent: Wednesday, February 23, 2022 8:40 AM
>> To: Vijayant Kumar
>> Cc: us
ta
>>>>> where I am using LSTM and transformers to forecast.
>>>>>
>>>>>
>>>>>
>>>>> I evaluated *SparkFlow* and *spark_tensorflow_distributor *libraries, and
>>>>> there has been no major development recently on
t; I evaluated *SparkFlow* and *spark_tensorflow_distributor *libraries, and
>>>> there has been no major development recently on those libraries. I faced
>>>> the issue of version dependencies on those and had a hard time fixing the
>>>> library comp
t;
>>>
>>>- Does *Horovod* have any dependencies?
>>> - Any other library which is suitable for my use case.?
>>>- Any example code would really be of great help to understand.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Vi
Horovod* have any dependencies?
>>- Any other library which is suitable for my use case.?
>>- Any example code would really be of great help to understand.
>>
>>
>>
>> Thanks,
>>
>> Vijayant
>>
>>
>>
>> *From:
which is suitable for my use case.?
>- Any example code would really be of great help to understand.
>
>
>
> Thanks,
>
> Vijayant
>
>
>
> *From:* Sean Owen
> *Sent:* Wednesday, February 23, 2022 8:40 AM
> *To:* Vijayant Kumar
> *Cc:* user @spark
> *S
y dependencies?
>- Any other library which is suitable for my use case.?
>- Any example code would really be of great help to understand.
>
>
>
> Thanks,
>
> Vijayant
>
>
>
> *From:* Sean Owen
> *Sent:* Wednesday, February 23, 2022 8:40 AM
> *To:
is suitable for my use case.?
* Any example code would really be of great help to understand.
Thanks,
Vijayant
From: Sean Owen
Sent: Wednesday, February 23, 2022 8:40 AM
To: Vijayant Kumar
Cc: user @spark
Subject: [E] COMMERCIAL BULK: Re: TensorFlow on Spark
Email is from a Free Mail
13 matches
Mail list logo
