[ANNOUNCEMENT] Plan for dropping Python 2 support

Hi all, Today we announced the plan for dropping Python 2 support [1] in Apache Spark: As many of you already knew, Python core development team and many utilized Python packages like Pandas and NumPy will drop Python 2

Re: Should python-2 be supported in Spark 3.0?

I updated Spark website and announced the plan for dropping python 2 support there: http://spark.apache.org/news/plan-for-dropping-python-2-support.html. I will send an announcement email to user@ and dev@. -Xiangrui On Fri, May 31, 2019 at 10:54 PM Felix Cheung wrote: > Very subtle but someone

unsubscribe

Re: Support SqlStreaming in spark

Hi all, >From what I read there is an effort here to globally standardize SQL Streaming (Flink people, Google at others are working with SQL standardization body) https://arxiv.org/abs/1905.12133v1

[SS] ContinuousExecution.commit and excessive JSON serialization?

Hi, Why does ContinuousExecution.commit serialize an offset to JSON format just before deserializing it back (from JSON to an offset)? [1] val offset = sources(0).deserializeOffset(offsetLog.get(epoch).get.offsets(0).get.json) [1]