Jupyter Notebook (Scala, kernel - Apache Toree) with Vegas, Graph not showing data

2019-02-01 Thread karan alang
Anybody used Vegas-viz for charting/graphics on Jupyter Spark/Scala notebook ? I'm looking for input on the following issue - https://stackoverflow.com/questions/54473744/jupyter-notebook-scala-kernel-apache-toree-with-vegas-graph-not-showing-da Pls. let me know. thanks!

Re: Structured streaming from Kafka by timestamp

2019-02-01 Thread Tomas Bartalos
Hello, sorry for my late answer. You're right, what I'm doing is a one time query, not a structured streaming. Probably it will be best to describe my use case: I'd like to expose live data (via jdbc/odbc) residing in Kafka with the power of spark's distributed sql engine. As jdbc server I use

Re: Aws

2019-02-01 Thread Pedro Tuero
Hi Hiroyuki, thanks for the answer. I found a solution for the cores per executor configuration: I set this configuration to true: https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-configure.html#emr-spark-maximizeresourceallocation Probably it was true by default at version 5.16, but