,
Varun Shah
On Fri, Mar 15, 2024, 03:10 Mich Talebzadeh
wrote:
> Hi,
>
> When you create a DataFrame from Python objects using
> spark.createDataFrame, here it goes:
>
>
> *Initial Local Creation:*
> The DataFrame is initially created in the memory of the driver nod
d answered by the community over a
period of time and hence, if possible, we could leverage it as the starting
point for building a community before creating a complete new website from
scratch. Any thoughts on this?
Regards,
Varun Shah
On Mon, Mar 18, 2024, 16:29 Mich Talebzadeh
wrote:
> So
from you and learning from your experiences.
Sincerely,
Varun Shah
Hi Harry,
Ideally, you should not be fetching a url in your transformation job but do
the API calls separately (outside the cluster if possible). Ingesting data
should be treated separately from transformation / cleaning / join
operations. You can create another dataframe of urls, dedup if
++ DEV community
On Mon, Jul 17, 2023 at 4:14 PM Varun Shah
wrote:
> Resending this message with a proper Subject line
>
> Hi Spark Community,
>
> I am trying to set up my forked apache/spark project locally for my 1st
> Open Source Contribution, by building and creating a pa
Hi Team,
I am still looking for a guidance here. Really appreciate anything that
points me in the right direction.
On Mon, Jul 17, 2023, 16:14 Varun Shah wrote:
> Resending this message with a proper Subject line
>
> Hi Spark Community,
>
> I am trying to set up my forked apach
nTest for the full
> outpu
> [error] (catalyst / scalaStyleOnCompile) Failing because of negative
> scalastyle result
> [error] (scalaStyleOnTest) Failing because of negative scalastyle result
>
Can you please guide me if I am doing something wrong.
Regards,
Varun Shah
f negative
> scalastyle result
> [error] (scalaStyleOnTest) Failing because of negative scalastyle result
>
Can you please guide me if I am doing something wrong. Looking forward to
get a response soon :)
Regards,
Varun Shah
