[ 
https://issues.apache.org/jira/browse/AMBARI-25945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17735282#comment-17735282
 ] 

Mohammad Arshad commented on AMBARI-25945:
------------------------------------------

Added hbase.rpc.rows.warning.threshold in section Advanced ams-hbase-site with 
default value as 10000

!image-2023-06-20-18-36-37-450.png!

> Sync batch size in ambari metrics collector and ams hbase
> ---------------------------------------------------------
>
>                 Key: AMBARI-25945
>                 URL: https://issues.apache.org/jira/browse/AMBARI-25945
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics
>    Affects Versions: metrics-3.0.0
>            Reporter: Mohammad Arshad
>            Assignee: Mohammad Arshad
>            Priority: Major
>         Attachments: image-2023-06-20-18-36-37-450.png
>
>
> In metrics collector phoenix batch size is 10000, but in ams hbase batch size 
> is 5000. Because of this following warning message is constantly getting 
> logged
> {noformat}
> 2023-05-19 05:49:04,899 WARN  
> [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=61320] 
> regionserver.RSRpcServices: Large batch operation detected (greater than 
> 5000) (HBASE-18023). Requested Number of Rows: 5690 Client: ams//IP first 
> region in 
> multi=METRIC_RECORD_MINUTE_UUID,,1684154511984.1a0cc25ec53f3475ff282a47dc9d03b7.
> 2023-05-19 05:50:05,136 WARN  
> [RpcServer.default.FPBQ.Fifo.handler=21,queue=0,port=61320] 
> regionserver.RSRpcServices: Large batch operation detected (greater than 
> 5000) (HBASE-18023). Requested Number of Rows: 10000 Client: ams//IP first 
> region in 
> multi=METRIC_AGGREGATE_UUID,,1684154515075.77371e2960a2ce70bb15d223338ba893.
> {noformat}
> To fix this problem, either we should decrease phoenix batch size in 
> collector or increase batch size in ams hbase.
> I propose to increase the batch size in ams hbase



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to