[jira] [Created] (HDFS-6292) Display HDFS per user and per group usage on the webUI

[Ravi Prakash (JIRA)]

Ravi Prakash created HDFS-6292:
--

 Summary: Display HDFS per user and per group usage on the webUI
 Key: HDFS-6292
 URL: https://issues.apache.org/jira/browse/HDFS-6292
 Project: Hadoop HDFS
  Issue Type: Improvement
Affects Versions: 2.4.0
Reporter: Ravi Prakash
Assignee: Ravi Prakash


It would be nice to show HDFS usage per user and per group on a web ui.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Created] (HDFS-6291) FSImage may be left unclosed in BootstrapStandby#doRun()

[Ted Yu (JIRA)]

Ted Yu created HDFS-6291:


 Summary: FSImage may be left unclosed in BootstrapStandby#doRun()
 Key: HDFS-6291
 URL: https://issues.apache.org/jira/browse/HDFS-6291
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Ted Yu
Priority: Minor


At around line 203:
{code}
  if (!checkLogsAvailableForRead(image, imageTxId, curTxId)) {
return ERR_CODE_LOGS_UNAVAILABLE;
  }
{code}
If we return following the above check, image is not closed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

[jira] [Created] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

[Ted Yu (JIRA)]

Ted Yu created HDFS-6290:


 Summary: File is not closed in OfflineImageViewerPB#run()
 Key: HDFS-6290
 URL: https://issues.apache.org/jira/browse/HDFS-6290
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Ted Yu
Priority: Minor


{code}
  } else if (processor.equals("XML")) {
new PBImageXmlWriter(conf, out).visit(new RandomAccessFile(inputFile,
"r"));
{code}
The RandomAccessFile instance should be closed before the method returns.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1743

[Apache Jenkins Server]

See 

.Staging directory permission resets

[Mohanadarshan Vivekanandalingam]

Hi All,

I am new to hadoop and trying some samples related to that.. Here I have
created an hadoop (hadoop-1.0.4) cluster in a single machine and ran an
hadoop job. At this time Igot the below exception

java.io.IOException: The ownership/permissions on the staging directory
hdfs://localhost:8120/tmp/mapred/staging/mohan/.staging is not as expected.
It is owned by mohan and permissions are rwxr-xr-x. The directory must be
owned by the submitter mohan or by mohan and permissions must be rwx--
at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:108)

at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:798)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:792)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1123)

at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766)
at
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:458)
at
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1351)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1126)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:934)
at
org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:201)

at
org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:187)



Then, I have changed the permission to rwx-- using command: hadoop dfs
-chmod. Then hadoop job work fine.. But when restarting the cluster
.staging directory permission changes again rwxr-xr-x. Then I need to
change the permission again..

Is there any solution for this.. Are there any possible reasons for this
behaviour.. Please help..

Thanks in advance..

Regards,
Mohan