Unsubscribe

Unsubscribe

Unsubscribe

Unsubscribe

Re: Using Spark in mixed Java/Scala project

Hi Jakob, Thanks a lot for your help. I'll try this. Zoran On Wed, Jan 27, 2016 at 10:49 AM, Jakob Odersky wrote: > JavaSparkContext has a wrapper constructor for the "scala" > SparkContext. In this case all you need to do is declare a > SparkContext that is accessible both

Re: Problem to persist Hibernate entity from Spark job

ansaction() != null) { > session.getTransaction().rollback() > ex.printStackTrace() > } > } > } > } > } > } > session.close() > } > Thanks, Zoran On Sun, Sep 6, 2015 at 1:42 PM, Zoran Jeremic <zoran.jere...@gmail.com> wrote: > I h

Re: Problem to persist Hibernate entity from Spark job

ber...@gmail.com> wrote: > >> how do you create your session? do you reuse it across threads? how do >> you create/close session manager? >> look for the problem in session creation, probably something deadlocked, >> as far as I remember hib.session should be created pe

Re: Twitter streaming with apache spark stream only a small amount of tweets

use filter API, Twitter limits you to 400 hashtags you can follow. Thanks, Zoran On Wed, Jul 29, 2015 at 8:40 AM, Peyman Mohajerian mohaj...@gmail.com wrote: This question was answered with sample code a couple of days ago, please look back. On Sat, Jul 25, 2015 at 11:43 PM, Zoran Jeremic

Re: Twitter streaming with apache spark stream only a small amount of tweets

, Zoran Jeremic zoran.jere...@gmail.com wrote: Can you send me the subject of that email? I can't find any email suggesting solution to that problem. There is email *Twitter4j streaming question*, but it doesn't have any sample code. It just confirms what I explained earlier that without

Re: Twitter streaming with apache spark stream only a small amount of tweets

something obvious. Thanks, Zoran On Sat, Jul 25, 2015 at 8:44 PM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi, I've implemented Twitter streaming as in the code given at the bottom of email. It finds some tweets based on the hashtags I'm following. However, it seems that a large amount of tweets

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

at 9:22 PM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi Yana, Sorry for late response. I just saw your email. At the end I ended with the following pom https://www.dropbox.com/s/19fldb9qnnfieck/pom.xml?dl=0 There were multiple problems I had to struggle with. One of these were that my

Twitter streaming with apache spark stream only a small amount of tweets

Hi, I've implemented Twitter streaming as in the code given at the bottom of email. It finds some tweets based on the hashtags I'm following. However, it seems that a large amount of tweets is missing. I've tried to post some tweets that I'm following in the application, and none of them was

Re: How to restart Twitter spark stream

found = false for(tag - sampleHashTags){ if(status.getText.toLowerCase.contains(tag)) found = true } found }) filtered }) Thanks Best Regards On Fri, Jul 24, 2015 at 11:25 AM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi Akhil

Re: How to restart Twitter spark stream

On Wed, Jul 22, 2015 at 3:58 AM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi Akhil and Jorn, I tried as you suggested to create some simple scenario, but I have an error on rdd.join(newRDD): value join is not a member of org.apache.spark.rdd.RDD[twitter4j.Status]. The code looks like

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

is. Thanks a lot (I'd love to see your .pom if you have it on github or somewhere accessible). On Fri, Jul 10, 2015 at 2:24 PM, Zoran Jeremic zoran.jere...@gmail.com wrote: It looks like there is no problem with Tomcat 8. On Fri, Jul 10, 2015 at 11:12 AM, Zoran Jeremic zoran.jere...@gmail.com

Re: How to restart Twitter spark stream

= stream.transform(rdd ={ val samplehashtags=Array(music,film) val newRDD= samplehashtags.map { x = (x,1) } rdd.join(newRDD) }) Did I miss something here? Thanks, Zoran On Mon, Jul 20, 2015 at 9:54 AM, Zoran Jeremic zoran.jere...@gmail.com wrote: Thanks for explanation. If I

Re: How to restart Twitter spark stream

= twitterStream.transform(rdd ={ val newRDD = scc.sc.textFile(/this/file/will/be/updated/frequently).map(x = (x,1)) rdd.join(newRDD) }) ​newRDD will work like a filter when you do the join.​ Thanks Best Regards On Sun, Jul 19, 2015 at 9:32 PM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi Jorn, I

Re: How to restart Twitter spark stream

interval Le dim. 19 juil. 2015 à 7:40, Zoran Jeremic zoran.jere...@gmail.com a écrit : Hi, I have a twitter spark stream initialized in the following way: val ssc:StreamingContext = SparkLauncher.getSparkScalaStreamingContext() val config

How to restart Twitter spark stream

Hi, I have a twitter spark stream initialized in the following way: val ssc:StreamingContext = SparkLauncher.getSparkScalaStreamingContext() val config = getTwitterConfigurationBuilder.build() val auth: Option[twitter4j.auth.Authorization] = Some(new

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

It looks like there is no problem with Tomcat 8. On Fri, Jul 10, 2015 at 11:12 AM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi Ted, I'm running Tomcat 7 with Java: java version 1.8.0_45 Java(TM) SE Runtime Environment (build 1.8.0_45-b14) Java HotSpot(TM) 64-Bit Server VM (build 25.45

Re: Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

? Thanks On Jul 10, 2015, at 10:09 AM, Zoran Jeremic zoran.jere...@gmail.com wrote: Hi, I've developed maven application that uses mongo-hadoop connector to pull data from mongodb and process it using Apache spark. The whole process runs smoothly if I run it on embedded Jetty server

Spark on Tomcat has exception IncompatibleClassChangeError: Implementing class

Hi, I've developed maven application that uses mongo-hadoop connector to pull data from mongodb and process it using Apache spark. The whole process runs smoothly if I run it on embedded Jetty server. However, if I deploy it to Tomcat server 7, it's always interrupted at the line of code which