hdfs output file operator

2016-07-22 Thread Raja . Aravapalli
Hi, I have File output operator which writes to hdfs files!! Application is trying to deploy the operator which writes to hdfs files in many different containers for a long timeā€¦ but is not succeeding!!! Status is showing as PENDING_DEPLOY In the logs of the container which the Application is

Re: hdfs output file operator

2016-07-22 Thread Sandesh Hegde
Please check, 1. AppMaster logs 2. Cluster resources On Fri, Jul 22, 2016 at 1:14 PM Raja.Aravapalli wrote: > > Hi, > > I have File output operator which writes to hdfs files!! > > Application is trying to deploy the operator which writes to hdfs files in > many different conta

Re: hdfs output file operator

2016-07-22 Thread Chinmay Kolhatkar
Hi Raja, I can see such a log message in AbstractFileOutputOperator at line 455. As this code is called from setup of the operator, the operator is getting deployed and then failing while restoring existing file because of mismatch in length of the file and the offset the operator has stored prev