Re: Kafka Zeppelin integration

2020-06-21 Thread Alex Ott
Can you post what settings have you configured for Spark interpreter? I recently did a demo of using Zeppelin 0.9.0 preview1 + Structured Streaming + Kafka, running in distributed mode on the DSE Analytics, and everything just worked... P.S. Here is the notebook if you're interested

Kafka Zeppelin integration

2020-06-19 Thread silavala
hi here is my question. Spark code run on zeppelin is unable to find kafka source even though a dependency is specified. I ask is there any way to fix this. Zeppelin version is 0.9.0, Spark version is 2.4.6, and kafka version is 2.4.1. I have specified the dependency in the packages and add a

Re: Zeppelin Integration

2016-03-23 Thread ayan guha
Hi All After spending few more days with the issue, I finally found the issue listed in Spark Jira - https://issues.apache.org/jira/browse/SPARK-8659 I would love to know if there are any roadmap for this? Maybe someone from dev group can confirm? Thank you in advance Best Ayan On Thu, Mar

Re: Zeppelin Integration

2016-03-11 Thread Mich Talebzadeh
BTW, when the daemon is stopped on the host, the notebook just hangs if it was running, without any errors. The only way is to tail the last log in $ZEPPELIN_HOME/logs. So I would say a cron type job is required to scan the log for errors. Dr Mich Talebzadeh LinkedIn *

Re: Zeppelin Integration

2016-03-10 Thread ayan guha
Thanks guys for reply. Yes, Zeppelin with Spark is pretty compelling choice, for single user. Any pointers for using Zeppelin for multi user scenario? In essence, can we either (a) Use Zeppelin to connect to a long running Spark Application which has some pre-cached Dataframes? (b) Can Zeppelin

Re: Zeppelin Integration

2016-03-10 Thread Sabarish Sasidharan
I believe you need to co-locate your Zeppelin on the same node where Spark is installed. You need to specify the SPARK HOME. The master I used was YARN. Zeppelin exposes a notebook interface. A notebook can have many paragraphs. You run the paragraphs. You can mix multiple contexts in the same

Zeppelin Integration

2016-03-10 Thread ayan guha
Hi All I am writing this in order to get a fair understanding of how zeppelin can be integrated with Spark. Our use case is to load few tables from a DB to Spark, run some transformation. Once done, we want to expose data through Zeppelin for analytics. I have few question around that to sound