[
https://issues.apache.org/jira/browse/AMBARI-25945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mohammad Arshad updated AMBARI-25945:
-------------------------------------
Description:
In metrics collector phoenix batch size is 10000, but in ams hbase batch size
is 5000. Because of this following warning message is constantly getting logged
{noformat}
2023-05-19 05:49:04,899 WARN
[RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=61320]
regionserver.RSRpcServices: Large batch operation detected (greater than 5000)
(HBASE-18023). Requested Number of Rows: 5690 Client: ams//IP first region in
multi=METRIC_RECORD_MINUTE_UUID,,1684154511984.1a0cc25ec53f3475ff282a47dc9d03b7.
2023-05-19 05:50:05,136 WARN
[RpcServer.default.FPBQ.Fifo.handler=21,queue=0,port=61320]
regionserver.RSRpcServices: Large batch operation detected (greater than 5000)
(HBASE-18023). Requested Number of Rows: 10000 Client: ams//IP first region in
multi=METRIC_AGGREGATE_UUID,,1684154515075.77371e2960a2ce70bb15d223338ba893.
{noformat}
To fix this problem, either we should decrease phoenix batch size in collector
or increase batch size in ams hbase.
I propose to increase the batch size in ams hbase
was:
In metrics collector phoenix batch size is 10000, but in ams hbase batch size
is 5000. Because of this following warning message is constantly getting logged
{noformat}
2023-05-19 05:49:04,899 WARN
[RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=61320]
regionserver.RSRpcServices: Large batch operation detected (greater than 5000)
(HBASE-18023). Requested Number of Rows: 5690 Client: ams//IP first region in
multi=METRIC_RECORD_MINUTE_UUID,,1684154511984.1a0cc25ec53f3475ff282a47dc9d03b7.
2023-05-19 05:50:05,136 WARN
[RpcServer.default.FPBQ.Fifo.handler=21,queue=0,port=61320]
regionserver.RSRpcServices: Large batch operation detected (greater than 5000)
(HBASE-18023). Requested Number of Rows: 10000 Client: ams//IP first region in
multi=METRIC_AGGREGATE_UUID,,1684154515075.77371e2960a2ce70bb15d223338ba893.
{noformat}
To fix this problem, either we should decrease phoenix batch size in collector
in increase batch size in ams hbase.
I propose to increase the batch size in ams hbase
> Sync batch size in ambari metrics collector and ams hbase
> ---------------------------------------------------------
>
> Key: AMBARI-25945
> URL: https://issues.apache.org/jira/browse/AMBARI-25945
> Project: Ambari
> Issue Type: Bug
> Components: ambari-metrics
> Affects Versions: metrics-3.0.0
> Reporter: Mohammad Arshad
> Assignee: Mohammad Arshad
> Priority: Major
>
> In metrics collector phoenix batch size is 10000, but in ams hbase batch size
> is 5000. Because of this following warning message is constantly getting
> logged
> {noformat}
> 2023-05-19 05:49:04,899 WARN
> [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=61320]
> regionserver.RSRpcServices: Large batch operation detected (greater than
> 5000) (HBASE-18023). Requested Number of Rows: 5690 Client: ams//IP first
> region in
> multi=METRIC_RECORD_MINUTE_UUID,,1684154511984.1a0cc25ec53f3475ff282a47dc9d03b7.
> 2023-05-19 05:50:05,136 WARN
> [RpcServer.default.FPBQ.Fifo.handler=21,queue=0,port=61320]
> regionserver.RSRpcServices: Large batch operation detected (greater than
> 5000) (HBASE-18023). Requested Number of Rows: 10000 Client: ams//IP first
> region in
> multi=METRIC_AGGREGATE_UUID,,1684154515075.77371e2960a2ce70bb15d223338ba893.
> {noformat}
> To fix this problem, either we should decrease phoenix batch size in
> collector or increase batch size in ams hbase.
> I propose to increase the batch size in ams hbase
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
