Destroy StreamExecutionEnv

e2<Map, Integer>>() { @Override public Tuple2<Map, Integer> map(String s) throws Exception { Map transaction = MAPPER.readValue(s, Map.class); return new Tuple2<>(transaction, 1); } }); counts.print(); -- jay vyas

setSlotSharing NPE: Starting a stream consumer in a thread

ps://gist.github.com/jayunit100/c7ab61d1833708d290df, and the offending line is the DataStream dataStream = env.readFileStream("/tmp/a",1000, FileMonitoringFunction.WatchType.ONLY_NEW_FILES); line. Thanks again ! -- jay vyas

Re: setSlotSharing NPE: Starting a stream consumer in a thread

() { public String map(String value) throws Exception { System.out.println(value); return ">>> > > > > " + value + " < < < < <<<"; } }); try { env.execute(); } catch(Except

Re: Using Flink with Redis question

Maybe wrapping Jedis with a serializable class will do the trick? But in general is there a way to reference jar classes in flink apps without serializable them? > On Sep 4, 2015, at 1:36 PM, Jerry Peng wrote: > > Hello, > > So I am trying to use jedis (redis

Re: Bigpetstore - Flink integration

r for the Product > and Transaction type. > I was able to run the code without the serializer registration. > > > -- Forwarded message -- > From: jay vyas <jayunit100.apa...@gmail.com> > Date: Wed, Sep 2, 2015 at 2:56 PM > Subject: Re: Hardware requirements

Re: Bigpetstore - Flink integration

ery scalable. >> >> I don't think that you need to register a Kryo serializer for the Product >> and Transaction type. >> I was able to run the code without the serializer registration. >> >> >> -- Forwarded message -- >> From: jay v

Re: Hardware requirements and learning resources

Just running the main class is sufficient > On Sep 2, 2015, at 8:59 AM, Robert Metzger <rmetz...@apache.org> wrote: > > Hey jay, > > How can I reproduce the error? > >> On Wed, Sep 2, 2015 at 2:56 PM, jay vyas <jayunit100.apa...@gmail.com> wrote: &g

Re: Hardware requirements and learning resources

irements would be very interesting for building small Flink >>>> clusters for educational purposes, or for small projects. >>>> >>>> Apart from that, I wonder if there is some blog post by the comunity >>>> about transitioning from Spark to Flink. I think it could be interesting, >>>> as there are some similarities in the APIs, but also deep differences in >>>> the underlying approaches. I was thinking in something like Breeze's >>>> cheatsheet comparing its matrix operatations with those available in Matlab >>>> and Numpy >>>> https://github.com/scalanlp/breeze/wiki/Linear-Algebra-Cheat-Sheet, or >>>> like http://rosettacode.org/wiki/Factorial. Just an idea anyway. Also, >>>> any pointer to some online course, book or training for Flink besides the >>>> official programming guides would be much appreciated >>>> >>>> Thanks in advance for help >>>> >>>> Greetings, >>>> >>>> Juan >>>> >>>> >>> >> > -- jay vyas

Re: Bigpetstore - Flink integration

and upward ! On Wed, Sep 2, 2015 at 9:33 AM, Robert Metzger <rmetz...@apache.org> wrote: > Okay, I see. > > As I said before, I was not able to reproduce the serialization issue > you've reported. > Can you maybe post the exception you are seeing? > > On Wed, Sep 2

Re: Serialization and kryo

1. Just wanted to updated.. possibly I'm hitting ? FLINK-1417 Automatically register nested types at Kryo https://issues.apache.org/jira/browse/FLINK-1417 ... On Sun, Aug 16, 2015 at 10:38 AM, jay vyas jayunit100.apa...@gmail.com wrote: Hi flink. I just ran into the following

Flink Streaming and flink-staging

to move forward.) Thanks ! -- jay vyas

Re: bigpetstore flink : parallelizing collections

at 9:07 AM, Maximilian Michels m...@apache.org wrote: Hi Jay, Great to hear there is effort to integrate Flink with BigTop. Please let us know if any questions come up in the course of the integration! Best, Max On Sun, Jul 12, 2015 at 3:57 PM, jay vyas jayunit100.apa...@gmail.com wrote

bigpetstore flink : parallelizing collections

the RDD from , and run a parallelized transform. In flink, i have an array of customers and i want to parallelize our transaction generator for each customer. How would i do that? -- jay vyas

Re: bigpetstore flink : parallelizing collections

= ExecutionEnvironment.getExecutionEnvironment(); DataSetMyType data = env.fromElements(myArray); data.map(new TrasactionMapper()).setParallelism(80); // makes sure you have 80 mappers Stephan On Sun, Jul 12, 2015 at 3:04 PM, jay vyas jayunit100.apa...@gmail.com wrote: Hi flink. Im happy to announce that ive