Hello ,
I have to create a custom Parquet writer with rolling sink , I'm seeing
error like this , I'm expecting every partition should write in a new file
?? Any tips ?
---
18:12:12.551 [flink-akka.actor.default-dispatcher-5] DEBUG
akka.event.EventStream - shutting down: StandardOutL
Hi,
the exception says
"org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException):
Failed to CREATE_FILE /y=2017/m=01/d=10/H=18/M=12/_part-0-0.in-progress for
DFSClient_NONMAPREDUCE_1062142735_3".
I would assume that your output format tries to create a file that already
exists.
Maybe you need
Thank you for the reply . I have found the issue ,my bad I was trying to
write from local intellij i local mode to remote HDFS, if I run execution
mode it works fine now .
On Wed, Jan 11, 2017 at 2:13 AM, Fabian Hueske wrote:
> Hi,
>
> the exception says
> "org.apache.hadoop.hdfs.protocol.Alrea
