Re: Guide/ tips to do preferred development for Flink?

2014-08-08 Thread Henry Saputra
Thanks Ufuk, yeah originally I wanted to start local standalone dev env without actually going to target directory to start the server. But I will use local environment for dev for now to get more familiar about the flow. Thanks guys! - Henry On Fri, Aug 8, 2014 at 12:36 AM, Ufuk Celebi wrote:

Re: Guide/ tips to do preferred development for Flink?

2014-08-08 Thread Ufuk Celebi
Hey Henry, sorry for not getting back to you earlier. The difference is that the network stack does NOT start up and all data transfers are made locally via memory copies (no TCP channels). The default parallelism is set depending on the number of cores, so stuff will still run in parallel. I

Re: Guide/ tips to do preferred development for Flink?

2014-08-07 Thread Henry Saputra
Thanks Robert, it seems like it does work. So if it is running via local environment context it will just execute the local executor? How much is the difference does the flow in local vs cluster? - Henry On Wed, Aug 6, 2014 at 6:41 AM, Robert Metzger wrote: > The dev setup for developing Flink

Re: Guide/ tips to do preferred development for Flink?

2014-08-06 Thread Robert Metzger
The dev setup for developing Flink with IntelliJ is quite simple: Just checkout the source code and import it as a Maven project into IntelliJ. To verify the correctness of your setup, try running the main() method of the WordCount example. This should always work without troubles. You can use the

Re: Guide/ tips to do preferred development for Flink?

2014-07-31 Thread Henry Saputra
Hi Ufuk, Sorry I missed this email reply from you. Yeah, I also used IntelliJ for development and trying to do remote debugging instead. Could you share your dev setup to run Flink using IntelliJ instead? - Henry On Mon, Jul 21, 2014 at 12:29 AM, Ufuk Celebi wrote: > Hey Henry, > > On 21 Jul

Re: Guide/ tips to do preferred development for Flink?

2014-07-21 Thread Ufuk Celebi
Hey Henry, On 21 Jul 2014, at 09:18, Henry Saputra wrote: > What are your recommended setup to run and develop Flink locally? I use IntelliJ for day-to-day dev and testing and run everything inside the IDE. If you want to use real programs to test your code you can use JavaProgramTestBase for

Guide/ tips to do preferred development for Flink?

2014-07-21 Thread Henry Saputra
HI Guys, What are your recommended setup to run and develop Flink locally? I have been doing local Flink by going to flink-dist/target/ and run Flink from there. I was wondering if you guys have preferred way to do Flink development? Maybe we could add section about "Developing Flink" in the web