Hi,
On Mon, Apr 11, 2022 at 7:43 AM Jason Jun wrote:
> the official doc, https://spark.apache.org/docs/latest/job-scheduling.html,
> didn't mention that its working for kubernete cluster?
>
You could use Volcano scheduler for more advanced setups on Kubernetes.
Here is an article explaining ho
the official doc, https://spark.apache.org/docs/latest/job-scheduling.html,
didn't mention that its working for kubernete cluster?
Can anyone quickly answer this?
TIA.
Jason
Hi, Amin
In general, the Apache Spark community has received many feedbacks and been
moving forward to
- Use the latest Hadoop versions for more bug fixes including CVEs.
- Use Hadoop's shaded clients to minimize the dependency issues
Since the above is not achievable with Hadoop 2 clients, I be