Re: spark ML Recommender program

2017-05-17 Thread Mark Vervuurt
If you are running locally try increasing driver memory to for example 4G en executor memory to 3G. Regards, Mark > On 18 May 2017, at 05:15, Arun > wrote: > > hi > > I am writing spark ML Movie Recomender program on Intelij on windows10 >

Re: Jupyter spark Scala notebooks

2017-05-17 Thread Mark Vervuurt
Hi Upendra, I got toree to work and I described it in the following JIRA issue. See the last comment of the issue. https://issues.apache.org/jira/browse/TOREE-336 Mark > On 18 May 2017, at 04:22, upendra 1991

Re: Connection via JDBC to Oracle hangs after count call

2016-07-11 Thread Mark Vervuurt
gt; <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw> > > http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> > > Disclaimer: Use it at your own risk. Any and all responsibility for any loss, > damage or destructio

Re: Connection via JDBC to Oracle hangs after count call

2016-07-11 Thread Mark Vervuurt
; shall not be understood as given or endorsed by Peridale Technology Ltd, its > subsidiaries or their employees, unless expressly so stated. It is the > responsibility of the recipient to ensure that this email is virus free, > therefore neither Peridale Technology Ltd, its subsidiaries

Re: DeepSpark: where to start

2016-05-05 Thread Mark Vervuurt
Wel you got me fooled as wel ;) Had it on my todolist to dive into this new component... Mark > Op 5 mei 2016 om 07:06 heeft Derek Chan het volgende > geschreven: > > The blog post is a April Fool's joke. Read the last line in the post: > >

Spark Path Wildcards Question

2015-12-17 Thread Mark Vervuurt
Hi Guys, quick verification question: Spark’s method like textFile(…) and sequenceFile(…) support wildcards. However if I have a directory structure with “hdfs:///data/year/month/day” (ex. "hdfs:///data/2015/12/17”), then its possible to crawl a whole year of data consisting of sequence files

Spark-Testing-Base Q/A

2015-10-21 Thread Mark Vervuurt
Hi Everyone, I am busy trying out ‘Spark-Testing-Base ’. I have the following questions? Can you test Spark Streaming Jobs using Java? Can I use Spark-Testing-Base 1.3.0_0.1.1 together with Spark 1.3.1? Thanks. Greetings, Mark

Re: Spark-Testing-Base Q/A

2015-10-21 Thread Mark Vervuurt
> On 21 Oct 2015, at 12:42, Holden Karau <hol...@pigscanfly.ca> wrote: > > > > On Wednesday, October 21, 2015, Mark Vervuurt <m.a.vervu...@gmail.com > <mailto:m.a.vervu...@gmail.com>> wrote: > Hi Everyone, > > I am busy trying out ‘Spark-Test