Re: Issue with writeAsText() to S3 bucket

2019-11-06 Thread Fabian Hueske
> > Michael > > > > *From: *Fabian Hueske > *Date: *Friday, October 25, 2019 at 6:04 AM > *To: *Michael Nguyen > *Cc: *"user@flink.apache.org" > *Subject: *Re: Issue with writeAsText() to S3 bucket > > > > *[External]* > > > > Hi Mich

Re: Issue with writeAsText() to S3 bucket

2019-10-28 Thread Nguyen, Michael
bucket upon cancelling my Flink job. Even in my situation, would this still be an issue with S3’s file listing command? Thanks, Michael From: Fabian Hueske Date: Friday, October 25, 2019 at 6:04 AM To: Michael Nguyen Cc: "user@flink.apache.org" Subject: Re: Issue with writeAsTe

Re: Issue with writeAsText() to S3 bucket

2019-10-25 Thread Fabian Hueske
Hi Michael, One reason might be that S3's file listing command is only eventually consistent. It might take some time until the file appears and is listed. Best, Fabian Am Mi., 23. Okt. 2019 um 22:41 Uhr schrieb Nguyen, Michael < michael.nguye...@t-mobile.com>: > Hello all, > > > > I am

Issue with writeAsText() to S3 bucket

2019-10-23 Thread Nguyen, Michael
Hello all, I am running into issues at the moment trying to print my DataStreams to an S3 bucket using writeAsText(“s3://bucket/result.json”) in my Flink job. I used print() on the same DataStream and I see the output I am looking for in standard output. I first confirm that my datastream has