Re: Spark 2.4.4 with Hadoop 3.2.0

2019-11-25 Thread Ismaël Mejía
Not officially. Apache Spark only announced support for Hadoop 3.x starting with the upcoming Spark 3. There is a preview release of Spark 3 with support for Hadoop 3.2 that you can try now: https://archive.apache.org/dist/spark/spark-3.0.0-preview/spark-3.0.0-preview-bin-hadoop3.2.tgz Enjoy!

Fwd: Spark 1.x - End of life

2017-10-24 Thread Ismaël Mejía
> think there’s a significant issue that people are missing. > > Matei > >> On Oct 19, 2017, at 5:20 AM, Ismaël Mejía <ieme...@gmail.com> wrote: >> >> Hello, >> >> I noticed that some of the (Big Data / Cloud Managed) Hadoop >> distributions are s

Spark 1.x - End of life

2017-10-19 Thread Ismaël Mejía
Hello, I noticed that some of the (Big Data / Cloud Managed) Hadoop distributions are starting to (phase out / deprecate) Spark 1.x and I was wondering if the Spark community has already decided when will it end the support for Spark 1.x. I ask this also considering that the latest release in the

Re: SparkWebUI and Master URL on EC2

2016-07-21 Thread Ismaël Mejía
must verify also that you can correctly access the VPC and create the tunnel or forwards to do so. Hope it helps, Ismaël Mejía On Thu, Jul 21, 2016 at 10:33 PM, Jacek Laskowski <ja...@japila.pl> wrote: > Hi, > > What's in the logs of spark-shell? There should be the host and port &g