[ https://issues.apache.org/jira/browse/HBASE-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13444661#comment-13444661 ]
Jonathan Hsieh commented on HBASE-6372: --------------------------------------- I had some outstanding issues about the test modification (it didn't test the feature). Since this is closed, can we file a follow on issue to fix the test and to report on the improvement it provided? > Add scanner batching to Export job > ---------------------------------- > > Key: HBASE-6372 > URL: https://issues.apache.org/jira/browse/HBASE-6372 > Project: HBase > Issue Type: Improvement > Components: mapreduce > Affects Versions: 0.96.0, 0.94.2 > Reporter: Lars George > Assignee: Shengsheng Huang > Priority: Minor > Labels: newbie > Fix For: 0.96.0 > > Attachments: HBASE-6372.2.patch, HBASE-6372.3.patch, > HBASE-6372.4.patch, HBASE-6372.5.patch, HBASE-6372.patch > > > When a single row is too large for the RS heap then an OOME can take out the > entire RS. Setting scanner batching in custom scans helps avoiding this > scenario, but for the supplied Export job this is not set. > Similar to HBASE-3421 we can set the batching to a low number - or if needed > make it a command line option. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira