[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[ https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-309: - Resolution: Fixed Fix Version/s: 0.23.3 0.24.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to branch-23 and trunk. Thanks Sho! > FSEditLog should log progress during replay > --- > > Key: HDFS-309 > URL: https://issues.apache.org/jira/browse/HDFS-309 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Todd Lipcon >Assignee: Sho Shimauchi > Labels: newbie > Fix For: 0.24.0, 0.23.3 > > Attachments: HDFS-309.txt, HDFS-309.txt, HDFS-309.txt, HDFS-309.txt > > > When the NameNode is replaying a long edit log, it's handy to have reports on > how far through it is, so you can judge how much time it is remaining. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[ https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sho Shimauchi updated HDFS-309: --- Attachment: HDFS-309.txt Sure. I updated the patch to be able to be merged into trunk. > FSEditLog should log progress during replay > --- > > Key: HDFS-309 > URL: https://issues.apache.org/jira/browse/HDFS-309 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Todd Lipcon >Assignee: Sho Shimauchi > Labels: newbie > Attachments: HDFS-309.txt, HDFS-309.txt, HDFS-309.txt, HDFS-309.txt > > > When the NameNode is replaying a long edit log, it's handy to have reports on > how far through it is, so you can judge how much time it is remaining. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[ https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-309: - Status: Patch Available (was: Open) > FSEditLog should log progress during replay > --- > > Key: HDFS-309 > URL: https://issues.apache.org/jira/browse/HDFS-309 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Todd Lipcon >Assignee: Sho Shimauchi > Labels: newbie > Attachments: HDFS-309.txt, HDFS-309.txt, HDFS-309.txt > > > When the NameNode is replaying a long edit log, it's handy to have reports on > how far through it is, so you can judge how much time it is remaining. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[ https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sho Shimauchi updated HDFS-309: --- Attachment: HDFS-309.txt fixed > FSEditLog should log progress during replay > --- > > Key: HDFS-309 > URL: https://issues.apache.org/jira/browse/HDFS-309 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Todd Lipcon >Assignee: Sho Shimauchi > Labels: newbie > Attachments: HDFS-309.txt, HDFS-309.txt, HDFS-309.txt > > > When the NameNode is replaying a long edit log, it's handy to have reports on > how far through it is, so you can judge how much time it is remaining. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[
https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sho Shimauchi updated HDFS-309:
---
Attachment: HDFS-309.txt
Thanks for feedback!
I updated the patch.
The output is now like this:
{quote}
2012-02-29 02:05:20,619 INFO namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay
edit log
2012-02-29 02:05:20,625 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(127)) - edit log length: 1232, first
txid: 1, last txid: 23
2012-02-29 02:05:20,637 INFO namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(421)) - replaying edit log: 12/23
transactions completed. (52%)
{quote}
This replay progress message is printed once every second.
> FSEditLog should log progress during replay
> ---
>
> Key: HDFS-309
> URL: https://issues.apache.org/jira/browse/HDFS-309
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Todd Lipcon
>Assignee: Sho Shimauchi
> Labels: newbie
> Attachments: HDFS-309.txt, HDFS-309.txt
>
>
> When the NameNode is replaying a long edit log, it's handy to have reports on
> how far through it is, so you can judge how much time it is remaining.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[
https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sho Shimauchi updated HDFS-309:
---
Attachment: HDFS-309.txt
attached patch.
replay log will be generated like this:
{quote}
2012-02-25 19:40:30,768 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(118)) - Acquiring write lock to replay
edit log
2012-02-25 19:40:30,768 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: LogSegmentOp
[opCode=OP_START_LOG_SEGMENT, txid=1]
2012-02-25 19:40:30,769 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: SetGenstampOp
[genStamp=1001, opCode=OP_SET_GENSTAMP, txid=2]
2012-02-25 19:40:30,769 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: AddOp
[length=0, path=/testfile, replication=1, mtime=1330166430268,
atime=1330166430268, blockSize=67108864, blocks=[],
permissions=sho:supergroup:rw-r--r--,
clientName=DFSClient_NONMAPREDUCE_1990794058_1, clientMachine=127.0.0.1,
opCode=OP_ADD, txid=3]
2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: CloseOp
[length=0, path=/testfile, replication=1, mtime=1330166430481,
atime=1330166430268, blockSize=67108864, blocks=[blk_1906532225227800470_1001],
permissions=sho:supergroup:rw-r--r--, clientName=, clientMachine=,
opCode=OP_CLOSE, txid=4]
2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(134)) - replaying edit log: LogSegmentOp
[opCode=OP_END_LOG_SEGMENT, txid=5]
2012-02-25 19:40:30,771 DEBUG namenode.FSEditLogLoader
(FSEditLogLoader.java:loadEditRecords(436)) - replaying edit log finished
{quote}
> FSEditLog should log progress during replay
> ---
>
> Key: HDFS-309
> URL: https://issues.apache.org/jira/browse/HDFS-309
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Todd Lipcon
>Assignee: Sho Shimauchi
> Labels: newbie
> Attachments: HDFS-309.txt
>
>
> When the NameNode is replaying a long edit log, it's handy to have reports on
> how far through it is, so you can judge how much time it is remaining.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-309) FSEditLog should log progress during replay
[ https://issues.apache.org/jira/browse/HDFS-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-309: Labels: newbie (was: ) > FSEditLog should log progress during replay > --- > > Key: HDFS-309 > URL: https://issues.apache.org/jira/browse/HDFS-309 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Todd Lipcon > Labels: newbie > > When the NameNode is replaying a long edit log, it's handy to have reports on > how far through it is, so you can judge how much time it is remaining. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
