Re: [EXTERNAL] Re: Bucketing/Rolling Sink: New timestamp appeded to the part file name everytime a new part file is rolled

2017-09-01 Thread Felix Cheung
tember 1, 2017 10:21:00 AM To: Aljoscha Krettek; Piotr Nowojski Cc: user@flink.apache.org Subject: Re: [EXTERNAL] Re: Bucketing/Rolling Sink: New timestamp appeded to the part file name everytime a new part file is rolled Thanks Aljoscha for the inputs. I will check to extend “BasePathBucketer” cl

Re: [EXTERNAL] Re: Bucketing/Rolling Sink: New timestamp appeded to the part file name everytime a new part file is rolled

2017-09-01 Thread Raja . Aravapalli
timestamp appeded to the part file name everytime a new part file is rolled Hi Raja, I think you can in fact do this by implementing a custom Bucketer. You can have a look at BasePathBucketer and extend that to include the timestamp in the path that is returned. You should probably clamp the