Re: EMR Logging Woes

2020-10-27 Thread Rex Fenley
Thanks! I'll check these out. On Tue, Oct 27, 2020 at 12:58 AM Robert Metzger wrote: > Hi Rex, > > 1. You can also use the Flink UI for retrieving logs. That usually works > quite fast (unless your logs are huge). > > 2. These are the correct configuration files for setting the log level. > Are

Re: EMR Logging Woes

2020-10-27 Thread Robert Metzger
Hi Rex, 1. You can also use the Flink UI for retrieving logs. That usually works quite fast (unless your logs are huge). 2. These are the correct configuration files for setting the log level. Are you running on a vanilla EMR cluster, or are there modifications? The "problem" is that Flink on YAR

EMR Logging Woes

2020-10-26 Thread Rex Fenley
Hello, After lots of testing in local environments we're now trying to get our cluster running on AWS EMR. We followed much of the documentation from both AWS and Flink and have gotten to the point of creating a yarn session and submitting jobs. We successfully get back a Job ID and in the Yarn Ti