Re: Getting mini-cluster logs when debugging pyflink from IDE

2021-11-09 Thread Dian Fu
The logging directory could be configured via one the following way: - environment variable: FLINK_LOG_DIR - configuration 'env.log.dir' in $PYTHON_INSTALLATION_DIR/site-packages/pyflink/conf/flink-conf.yaml You could refer to [1] for more details. PS: This is only available for 1.13.3+ and

Re: Getting mini-cluster logs when debugging pyflink from IDE

2021-11-08 Thread Роман VVvKamper
Thanks for help, I’ll look into it :) Two more questions: Is there a way to configure this path? For example to write logs to a file in the working dir? And is there a way to redirect logst from file to stdout? On 9 Nov 2021, at 09:00, Dian Fu mailto:dian0511...@gmail.com>> wrote: Hi, The

Re: Getting mini-cluster logs when debugging pyflink from IDE

2021-11-08 Thread Dian Fu
Hi, The logs should appear in the log file of the TaskManger and you could find it under directory $PYTHON_INSTALLATION_DIR/site-packages/pyflink/log/ Regards, Dian On Mon, Nov 8, 2021 at 10:53 PM Роман VVvKamper wrote: > Hello, > > I'm trying to debug flink and pyflink job from IDE using

Getting mini-cluster logs when debugging pyflink from IDE

2021-11-08 Thread Роман VVvKamper
Hello, I'm trying to debug flink and pyflink job from IDE using mini cluster (local mode). When i doing it in the java flink, everything works like a charm - i can see flink mini-cluster logs in the console. But when i run pyflink job in local mode (through the IDE of by simply calling