Hello Robert, thanks a lot, I'll sure have a look at it!
Regards, Laurent. On Thu, 2 Apr 2020 at 10:54, Robert Metzger <rmetz...@apache.org> wrote: > Hey Laurent, > Flink developed an internal framework for executing end to end tests from > Java. Here's an example of such a test: > https://github.com/apache/flink/blob/master/flink-end-to-end-tests/flink-metrics-availability-test/src/test/java/org/pache/flink/metrics/tests/MetricsAvailabilityITCase.java#L98 > This should download and set up a real, distributed (on your machine, but > in different processes) Flink cluster. > > Best, > Robert > > On Tue, Mar 31, 2020 at 10:48 AM Laurent Exsteens < > laurent.exste...@euranova.eu> wrote: > >> Hi Tzu-Li, >> >> thanks a lot for your answer. I will try this! >> >> However, I was looking for something that does fully simulate a Flink >> cluster, including job-manager to task manager serialization issues and >> full isolation of the task managers (I guess in the MiniClusterResource, we >> are still on the same JVM, so static classes will still be available to all >> operators, which is different than on a real cluster). >> >> Cheers, >> >> Laurent. >> >> On Mon, 2 Mar 2020 at 13:24, Tzu-Li (Gordon) Tai <tzuli...@apache.org> >> wrote: >> >>> Hi Laurent, >>> >>> You can take a look at Flink's MiniClusterResource JUnit test rule, and >>> its >>> usages in the codebase for that. >>> The rule launches a Flink MiniCluster within the same JVM, and >>> submission to >>> the mini cluster resembles how it would be submitting to an actual Flink >>> cluster, so you would already be able to catch problems such as operator >>> serialization errors. >>> >>> Cheers, >>> Gordon >>> >>> >>> >>> -- >>> Sent from: >>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >>> >> >> >> -- >> *Laurent Exsteens* >> Data Engineer >> (M) +32 (0) 486 20 48 36 >> >> *EURA NOVA* >> >> Rue Emile Francqui, 4 >> >> 1435 Mont-Saint-Guibert >> >> (T) +32 10 75 02 00 >> >> *euranova.eu <http://euranova.eu/>* >> >> *research.euranova.eu* <http://research.euranova.eu/> >> >> ♻ Be green, keep it on the screen > > -- *Laurent Exsteens* Data Engineer (M) +32 (0) 486 20 48 36 *EURA NOVA* Rue Emile Francqui, 4 1435 Mont-Saint-Guibert (T) +32 10 75 02 00 *euranova.eu <http://euranova.eu/>* *research.euranova.eu* <http://research.euranova.eu/> -- ♻ Be green, keep it on the screen
