xuekaiqi created KYLIN-4459:
-------------------------------
Summary: Continuous print warning log-DFSInputStream has been
closed already
Key: KYLIN-4459
URL: https://issues.apache.org/jira/browse/KYLIN-4459
Project: Kylin
Issue Type: Improvement
Components: Storage - Parquet
Reporter: xuekaiqi
Assignee: wangrupeng
Fix For: v4.0.0
when starting kylin with debug tomcat mode, we can see these logs.
{code:java}
2020-03-12 10:17:06,082 ERROR [pool-12-thread-1] curator.CuratorScheduler:205 :
Node(127.0.0.1) job server state conflict. Is ZK leader: true; Is active job
server: false
2020-03-12 10:17:06,830 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:06,830 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:06,830 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:08,717 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:08,717 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:08,717 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:12,936 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:12,936 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:12,936 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:14,152 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:14,152 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:14,152 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:17,603 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:17,603 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:17,603 WARN [Curator-LeaderSelector-0] hdfs.DFSClient:669 :
DFSInputStream has been closed already
2020-03-12 10:17:17,603 INFO [Curator-LeaderSelector-0]
threadpool.DefaultScheduler:166 : Finishing resume all running jobs.
2020-03-12 10:17:17,603 INFO [Curator-LeaderSelector-0]
threadpool.DefaultScheduler:170 : Fetching jobs every 30 seconds
2020-03-12 10:17:17,603 INFO [Curator-LeaderSelector-0]
threadpool.DefaultScheduler:180 : Creating fetcher pool instance:2094578449
{code}
Upgrade hadoop version to 2.7.2 can fix it, but need more test in case some
unpredictable problems
[https://community.cloudera.com/t5/Support-Questions/DFSInputStream-has-been-closed-already/td-p/125487]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
