Online-Monitor Metrics Naming

Hi all,

This week, Backend-Infra team has landed some changes related to online-monitor. For applications that include those changes, there will be some changes to metrics naming:

rate-limiter metrics

instead of RL_<bucketName>_<metricName> it will become <bucketName>_RL_<metricName>
example: RL_abc_count -> abc_RL_count

RPC metrics

instead of rpc_client_<destNodeId>_<metricName> it will become <destNodeId>_rpc_client_<metricName>
example: rpc_client_tv99_latency_p95 -> tv99_rpc_client_latency_p95

API metrics

instead of <className>_<methodName>_<metricName> it will become <className>_<methodName>_api_<metricName>
example: CountryLocaleMappingServic_getDefaultLocaleByCountry_count -> CountryLocaleMappingServic_getDefaultLocaleByCountry_api_count

Mongo accessor metrics -> this one is only used by TERA

instead of <clusterName>_<dbName>_db_query_<metricName> it will become <dbName>_<clusterName>_db_query_<metricName>
example: axtari-mongod_traveloka-ari_db_query_exception_count -> traveloka-ari_axtari-mongod_db_query_exception_count

metrics from FlightBookingAddOnsMonitorImpl, FlightBookingSummaryMonitorImpl, FlightSubmitFrequentFlyerMonitorImpl, AccomWorkflowTaskHandlerMonitorServiceImpl, HotelInventorySearchServiceImpl -> I will contact the respective teams for these classes

We will try to add new Seyren alerts for affected metrics this but we don't change all the Grafana dashboards. So you will need to update your dashboards by yourself. One way to do this:

go to the dashboard
click the chart
click "Edit"
in the "Metrics" tab, click the button in the right side of metric name to duplicate metric
modify the duplicated metric
save the dashboard

We have updated this dashboard based on the steps above https://metrics.traveloka.com/dashboard/db/user-usrpapi-rpc. You can use the charts there as example for updating your dashboards, sample chart: https://metrics.traveloka.com/dashboard/db/user-usrpapi-rpc?panelId=3&fullscreen&edit.

Sorry for the inconvenience :bow: