[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2022-01-28 Thread kaka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17483659#comment-17483659 ] kaka commented on FLINK-25099: -- I have the same issue in Hive Connector, any updates on this issue? >

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451554#comment-17451554 ] chenqizhu commented on FLINK-25099: --- this is my submmision cli example. As you can see, it's very

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451514#comment-17451514 ] Junfan Zhang commented on FLINK-25099: -- If you could provide more detailed info like submmision cli

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451486#comment-17451486 ] chenqizhu commented on FLINK-25099: --- Now the only question is why the defaultFS configuration works

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451479#comment-17451479 ] Junfan Zhang commented on FLINK-25099: -- Good news [~libra_816] > flink on yarn Accessing two HDFS

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451473#comment-17451473 ] chenqizhu commented on FLINK-25099: --- The problem is that I did not authorize the checkpoint path.

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451193#comment-17451193 ] chenqizhu commented on FLINK-25099: --- When I ignore setting the default.fs=flinkcluster and specifying

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451160#comment-17451160 ] Junfan Zhang commented on FLINK-25099: -- Just ignore setting the default.fs=flinkcluster. but

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451140#comment-17451140 ] chenqizhu commented on FLINK-25099: --- But I want to write checkpoint to flinkcluster with SSD for

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451123#comment-17451123 ] Junfan Zhang commented on FLINK-25099: -- I think in yours architecture, you should not reset the

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451090#comment-17451090 ] chenqizhu commented on FLINK-25099: --- Our architecture is one YARN cluster and two HDFS clusters. The

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-30 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17451071#comment-17451071 ] Junfan Zhang commented on FLINK-25099: -- The submission cluster is {{hdfsn21n159}}. but you set the

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-29 Thread chenqizhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450876#comment-17450876 ] chenqizhu commented on FLINK-25099: ---  [~zuston]  This is all the client logs    

[jira] [Commented] (FLINK-25099) flink on yarn Accessing two HDFS Clusters

2021-11-29 Thread Junfan Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450853#comment-17450853 ] Junfan Zhang commented on FLINK-25099: -- Could you make the log level debug and attach more logs ?