[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-13 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17014126#comment-17014126 ] Kostas Kloudas commented on FLINK-15533: Thanks for the feedback [~lirui]! I ope

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-10 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013392#comment-17013392 ] Rui Li commented on FLINK-15533: [~kkl0u] I just tried the latest branch and it fixes th

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-10 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012832#comment-17012832 ] Kostas Kloudas commented on FLINK-15533: Sorry I just saw your message, I think

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-10 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012822#comment-17012822 ] Kostas Kloudas commented on FLINK-15533: I think I get the problem. Before 1.10

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-10 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012781#comment-17012781 ] Rui Li commented on FLINK-15533: Hi [~kkl0u], just confirmed the job succeeds if I write

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-10 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012633#comment-17012633 ] Kostas Kloudas commented on FLINK-15533: Hi [~lirui], I tried it on the {{master

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011735#comment-17011735 ] Rui Li commented on FLINK-15533: Hi [~kkl0u], I tried your patch and as I expected, it s

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011725#comment-17011725 ] Rui Li commented on FLINK-15533: [~kkl0u] That's correct. I also quickly tried with 1.9.

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011714#comment-17011714 ] Kostas Kloudas commented on FLINK-15533: [~lirui] To summarize the problem, your

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011680#comment-17011680 ] Kostas Kloudas commented on FLINK-15533: Hi [~lirui], I am also try to figure ou

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011669#comment-17011669 ] Rui Li commented on FLINK-15533: Hi [~kkl0u], thanks for the quick fix. IIUC, the change

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011651#comment-17011651 ] Kostas Kloudas commented on FLINK-15533: I have [branch|https://github.com/kl0u/

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011646#comment-17011646 ] Kostas Kloudas commented on FLINK-15533: [~lzljs3620320] I made it a blocker but

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Kostas Kloudas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011623#comment-17011623 ] Kostas Kloudas commented on FLINK-15533: Thanks for reporting this [~lirui] and

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011628#comment-17011628 ] Jingsong Lee commented on FLINK-15533: -- [~kkl0u] Do you think this is blocker or cr

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011612#comment-17011612 ] Zili Chen commented on FLINK-15533: --- Sounds reasonable. cc [~kkl0u] > Writing DataSt

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011599#comment-17011599 ] Rui Li commented on FLINK-15533: When we create a {{DataStreamSink}}, we get parallelism

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011575#comment-17011575 ] Zili Chen commented on FLINK-15533: --- The default value of {{parallelism.default}} is {

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011573#comment-17011573 ] Zili Chen commented on FLINK-15533: --- Could you attach the running job DAG on JIRA? It

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011570#comment-17011570 ] Zili Chen commented on FLINK-15533: --- >From my understanding if parallelism > 1, actual

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011566#comment-17011566 ] Rui Li commented on FLINK-15533: I set {{parallelism.default}} to 1 > Writing DataStrea

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011564#comment-17011564 ] Zili Chen commented on FLINK-15533: --- what is the value you set to {{parallelism.defaul

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011562#comment-17011562 ] Rui Li commented on FLINK-15533: [~tison] If I set {{parallelism.default}} in flink-conf

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Zili Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011546#comment-17011546 ] Zili Chen commented on FLINK-15533: --- [~lzljs3620320] but how? I don't see a clear reas

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011538#comment-17011538 ] Jingsong Lee commented on FLINK-15533: -- The second execution will be successful, Lo

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-09 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011530#comment-17011530 ] Rui Li commented on FLINK-15533: [~lzljs3620320] Thanks for the suggestions. Yes it can

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-08 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011510#comment-17011510 ] Jingsong Lee commented on FLINK-15533: -- Thanks [~lirui]  for tracking this. Can you

[jira] [Commented] (FLINK-15533) Writing DataStream as text file fails due to output path already exists

2020-01-08 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011507#comment-17011507 ] Rui Li commented on FLINK-15533: Hit this issue when working on FLINK-15511. These comme