Re: Execution environments for testing: local vs collection vs mini cluster

2019-08-04 Thread Juan Rodríguez Hortalá
Hi, Thanks for your answer. I hadn't noticed that the collection environment only works for the batch API. It's also nice to know that the mini cluster is more an internal tool. So that the local execution environments for batch and streaming are working very well for me, I was just curious, thank

Re: Execution environments for testing: local vs collection vs mini cluster

2019-07-26 Thread Biao Liu
Hi Juan, Sorry for the late reply. 1. the environments of data stream and data set are not same. An obvious difference is there always be a "stream" prefix of environment for data stream. For example, StreamExecutionEnvironment is for data stream, ExecutionEnvironment and CollectionEnvironment ar

Re: Execution environments for testing: local vs collection vs mini cluster

2019-07-23 Thread Juan Rodríguez Hortalá
Hi Bao, Thanks for your answer. 1. Integration tests for my project. 2. Both data stream and data sets On Mon, Jul 22, 2019 at 11:44 PM Biao Liu wrote: > Hi Juan, > > I'm not sure what you really want. Before giving some suggestions, could > you answer the questions below first? > > 1. Do yo

Re: Execution environments for testing: local vs collection vs mini cluster

2019-07-22 Thread Biao Liu
Hi Juan, I'm not sure what you really want. Before giving some suggestions, could you answer the questions below first? 1. Do you want to write a unit test (or integration test) case for your project or for Flink? Or just want to run your job locally? 2. Which mode do you want to test? DataStream

Execution environments for testing: local vs collection vs mini cluster

2019-07-22 Thread Juan Rodríguez Hortalá
Hi, In https://ci.apache.org/projects/flink/flink-docs-stable/dev/local_execution.html and https://ci.apache.org/projects/flink/flink-docs-master/api/java/org/apache/flink/runtime/minicluster/MiniCluster.html I see there are 3 ways to create an execution environment for testing: - StreamExecut