[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993952#comment-15993952 ]
Chen Liang commented on HDFS-11698: ----------------------------------- Thanks [~anu] for the comments! bq. May be as another JIRA – some commands to work against the sqlite DB ? Of the top of my head – list of containers, Get Datanodes from container name This is a good idea, will do, thanks! bq. May be as yet another JIRA – Another table that logs datanode UUID to container name or an index if that is possible so that we can print out all containers for a given datanode I think we can do this already with the SQL table {{containerMembers}} :), we can simply call {{SELECT * FROM containerMembers WHERE datanodeUUID = 'xx';}} where xx is a datanodeUUID. Adding an index can helpful though, will revisit this later. > Ozone: SCM: CLI: Add Debug command > ----------------------------------- > > Key: HDFS-11698 > URL: https://issues.apache.org/jira/browse/HDFS-11698 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone > Affects Versions: HDFS-7240 > Reporter: Anu Engineer > Assignee: Chen Liang > Attachments: HDFS-11698-HDFS-7240.001.patch > > > This is not discussed as part of the standard command line set, since these > are internal debug only commands. > We have levelDB that stores key, value pairs and value is always binary > blobs. These binary blobs can only be decoded using protobuf classes that are > part of ozone. > We would like to add an extension to SCM CLI which allows us to convert > levelDB to SQLlite, since SQLlite would have structured data and standard SQL > will work against it. > The reason to use SQLlite instead of some dump file like json is the scale, > it is possible that some levelDB files will have millions of keys, so having > an SQL DB with proper index will make debugging much easier. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org