[ 
https://issues.apache.org/jira/browse/HBASE-11994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aditya Kishore updated HBASE-11994:
-----------------------------------
    Attachment: HBASE-11994-PutCombiner-floods-the-M-R-log-with-repe.patch

This simple patch changes the log level to DEBUG and resets {{curSize}} to 0 on 
flush.

> PutCombiner floods the M/R log with repeated log messages.
> ----------------------------------------------------------
>
>                 Key: HBASE-11994
>                 URL: https://issues.apache.org/jira/browse/HBASE-11994
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.98.6
>            Reporter: Aditya Kishore
>            Assignee: Aditya Kishore
>         Attachments: 
> HBASE-11994-PutCombiner-floods-the-M-R-log-with-repe.patch
>
>
> {{o.a.h.h.mapreduce.PutCombiner}} logs an info message for each row that it 
> receives in its reduce() function, flooding the M/R tasks log.
> {noformat}
> ...............
> 2014-09-12 12:38:02,907 INFO [MapRSpillThread] 
> org.apache.hadoop.hbase.mapreduce.PutCombiner: Combined 1 Put(s) into 1.
> 2014-09-12 12:38:02,908 INFO [MapRSpillThread] 
> org.apache.hadoop.hbase.mapreduce.PutCombiner: Combined 1 Put(s) into 1.
> ...............{repeated 100s of thousand times.}
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to