RE: [EXTERNAL] Re: GraphX Support

2022-03-21 Thread Jacob Marquez
Awesome, thank you! From: Sean Owen Sent: Monday, March 21, 2022 4:11 PM To: Jacob Marquez Cc: user@spark.apache.org Subject: [EXTERNAL] Re: GraphX Support You don't often get email from sro...@gmail.com. Learn why this is

Re: GraphX Support

2022-03-21 Thread Sean Owen
GraphX is not active, though still there and does continue to build and test with each Spark release. GraphFrames kind of superseded it, but is also not super active FWIW. On Mon, Mar 21, 2022 at 6:03 PM Jacob Marquez wrote: > Hello! > > > > My team and I are evaluating GraphX as a possible

GraphX Support

2022-03-21 Thread Jacob Marquez
Hello! My team and I are evaluating GraphX as a possible solution. Would someone be able to speak to the support of this Spark feature? Is there active development or is GraphX in maintenance mode (e.g. updated to ensure functionality with new Spark releases)? Thanks in advance for your help!

Re: [Spark SQL] Structured Streaming in pyhton can connect to cassandra ?

2022-03-21 Thread Mich Talebzadeh
dear student, Check this article of mine in Linkedin Processing Change Data Capture with Spark Structured Streaming There is a link to GitHub

Re: [Spark SQL] Structured Streaming in pyhton can connect to cassandra ?

2022-03-21 Thread Sean Owen
Looks like you are trying to apply this class/function across Spark, but it contains a non-serialized object, the connection. That has to be initialized on use, otherwise you try to send it from the driver and that can't work. On Mon, Mar 21, 2022 at 11:51 AM guillaume farcy <

[Spark SQL] Structured Streaming in pyhton can connect to cassandra ?

2022-03-21 Thread guillaume farcy
Hello, I am a student and I am currently doing a big data project. Here is my code: https://gist.github.com/Balykoo/262d94a7073d5a7e16dfb0d0a576b9c3 My project is to retrieve messages from a twitch chat and send them into kafka then spark reads the kafka topic to perform the processing in the

Re:NoSuchMethodError: org.apache.spark.sql.execution.command.CreateViewCommand.copy

2022-03-21 Thread lk_spark
sorry, it's my env problem. At 2022-03-21 14:00:01, "lk_spark" wrote: hi, all : I got a strange error: bin/spark-shell --deploy-mode client Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

NoSuchMethodError: org.apache.spark.sql.execution.command.CreateViewCommand.copy

2022-03-21 Thread lk_spark
hi, all : I got a strange error: bin/spark-shell --deploy-mode client Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 22/03/21 13:51:39 WARN util.Utils: spark.executor.instances less than