Re: Structured Streaming on Kubernetes

2018-04-16 Thread Krishna Kalyan
;>> directories. >>> >>> >>> >>> However, I’m unaware of any specific use of streaming with the Spark on >>> Kubernetes integration right now. Would be curious to get feedback on the >>> failover behavior right now. >>> >>> >>&g

Structured Streaming on Kubernetes

2018-04-13 Thread Krishna Kalyan
Hello All, We were evaluating Spark Structured Streaming on Kubernetes (Running on GCP). It would be awesome if the spark community could share their experience around this. I would like to know more about you production experience and the monitoring tools you are using. Since spark on kubernetes

Unable to build spark documentation

2017-01-11 Thread Krishna Kalyan
Hello, I have been trying to build spark documentation. Instruction followed from link below https://github.com/apache/spark/blob/master/docs/README.md My Jekyll build fails below. (Error in the gist below) https://gist.github.com/krishnakalyan3/d0e38852efe97d7899d737b83b8d8702 and

Contributing to PySpark

2016-10-18 Thread Krishna Kalyan
Hello, I am a masters student. Could someone please let me know how set up my dev working environment to contribute to pyspark. Questions I had were: a) Should I use Intellij Idea or PyCharm?. b) How do I test my changes?. Regards, Krishna

Re: Error Running SparkPi.scala Example

2016-06-17 Thread Krishna Kalyan
java-5.1.12.jar") had size 11 instead of expected size 9 (SparkSubmitSuite.scala:294) On Thu, Jun 16, 2016 at 1:57 PM, Jacek Laskowski <ja...@japila.pl> wrote: > Hi, > > Before you try to do it inside another environment like an IDE, could > you build Spark using mvn or sbt a

Error Running SparkPi.scala Example

2016-06-15 Thread Krishna Kalyan
Hello, I am faced with problems when I try to run SparkPi.scala. I took the following steps below: a) git pull https://github.com/apache/spark b) Import the project in Intellij as a maven project c) Run 'SparkPi' Error Below: Information:16/06/16 01:34 - Compilation completed with 10 errors and 5

Re: RBM in mllib

2016-06-14 Thread Krishna Kalyan
Hi Robert, According to the jira the Resolution is wont fix. The pull request was closed as it did not merge cleanly with the master. (https://github.com/apache/spark/pull/3222) On Tue, Jun 14, 2016 at 4:23 PM, Roberto Pagliari wrote: > Is RBM being developed? > >