Spark Thrift Server in Kubernetes deployment

2020-06-21 Thread Subash K
Hi, We are currently using Spark 2.4.4 with Spark Thrift Server (STS) to expose a JDBC interface to the reporting tools to generate report from Spark tables. Now as we are analyzing on containerized deployment of Spark and STS, I would like to understand is STS deployment on Kubernetes is

Re: Unsubscribe

2020-06-21 Thread Wesley
please send an empty email to: dev-unsubscr...@spark.apache.org user-unsubscr...@spark.apache.org for unsubscribing yourself from the lists. Thanks. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Hey good looking toPandas () error stack

2020-06-21 Thread Anwar AliKhan
The only change I am making is spark directory name. It keeps failing in this same cell. df.toPandas() findspark.init('/home/spark-2.4.6-bin-hadoop2.7') FAIL findspark.init('/home/spark-3.0.0-bin-hadoop2.7'). PASS On Sun, 21 Jun 2020, 19:51 randy clinton, wrote: > You can see from the

Re: Hey good looking toPandas () error stack

2020-06-21 Thread Sean Owen
That part isn't related to Spark. It means you have some code compiled for Java 11, but are running Java 8. On Sun, Jun 21, 2020 at 1:51 PM randy clinton wrote: > You can see from the GitHub history for "toPandas()" that the function has > been in the code for 5 years. > >

Unsubscribe

2020-06-21 Thread Punna Yenumala

Re: Hey good looking toPandas () error stack

2020-06-21 Thread randy clinton
You can see from the GitHub history for "toPandas()" that the function has been in the code for 5 years. https://github.com/apache/spark/blame/a075cd5b700f88ef447b559c6411518136558d78/python/pyspark/sql/dataframe.py#L923 When I google IllegalArgumentException: 'Unsupported class file major

Re: Kafka Zeppelin integration

2020-06-21 Thread Alex Ott
Can you post what settings have you configured for Spark interpreter? I recently did a demo of using Zeppelin 0.9.0 preview1 + Structured Streaming + Kafka, running in distributed mode on the DSE Analytics, and everything just worked... P.S. Here is the notebook if you're interested