t; > [Description: Description: Description: Description:
>> > cid:image001.jpg@01C85203.36A2AF30]
>> >
>> > From: Felix Cheung
>> > Sent: Thursday, November 12, 2020 04:05
>> > To: dev@sedona.apache.org
>&
ig Data Consultant
> > [Description: Description: Description: Description:
> > cid:image001.jpg@01C85203.36A2AF30]
> >
> > From: Felix Cheung
> > Sent: Thursday, November 12, 2020 04:05
> > To: dev@sedona.apache.org
> > Cc: Jinxuan Wu; Mohamed Sarwat; Netane
03.36A2AF30]
>
> From: Felix Cheung
> Sent: Thursday, November 12, 2020 04:05
> To: dev@sedona.apache.org
> Cc: Jinxuan Wu; Mohamed Sarwat; Netanel Malka; Paweł Kociński; Zongsi
> Zhang; d...@sedona.incubator.apache.org
> Subject: Re: Support Sp
...@sedona.incubator.apache.org
Subject: Re: Support Spark 2.4 in Sedona 1.0
I am not sure it should be a branch? It is common to deal with this as a
compile target, not as a separate branch. A separate branch might have
difficulty to release?
There are a few example in projects where they handle multiple Spark target
cription: Description: Description:
> > cid:image001.jpg@01C85203.36A2AF30]
> > --
> > *From:* Paweł Kociński
> > *Sent:* Wednesday, November 11, 2020 00:29
> > *To:* Jia Yu
> > *Cc:* dev@sedona.apache.org; d...@sedona.incubator.apache.org
Jia Yu
> *Cc:* dev@sedona.apache.org; d...@sedona.incubator.apache.org; Jinxuan Wu;
> Mohamed Sarwat; Netanel Malka; Zongsi Zhang
> *Subject:* Re: Support Spark 2.4 in Sedona 1.0
>
> Hi Jia,
> I think we should support spark 2.4, a lot of users still use it. More
> than that I think
ł Kociński
Sent: Wednesday, November 11, 2020 00:29
To: Jia Yu
Cc: dev@sedona.apache.org; d...@sedona.incubator.apache.org; Jinxuan Wu;
Mohamed Sarwat; Netanel Malka; Zongsi Zhang
Subject: Re: Support Spark 2.4 in Sedona 1.0
Hi Jia,
I think we should support spark 2.4, a lot of users still use it.
Hi Jia,
I think we should support spark 2.4, a lot of users still use it. More than
that I think more users still have jobs written in spark 2.4 than 3.0. We
will use an additional branch for that use case ? I mean Spark 2.4 with
scala 2.12 is important one.
Regards,
Paweł
pon., 9 lis 2020 o
Dear all,
In Sedona 1.0, we definitely will support Spark 3.0. But I wonder whether
we should support Spark 2.4.
In order to support Spark 2.4, we need to do the following
1. Compile the source using Scala 2.11. Sedona master branch currently is
compiled by Scala 2.12 and Java 1.8
2. For the
