Progress on Cost Optimization - W2 April 2020
- Cost Optimization
- Assess GCP storage cost (NRTProd)
- (Confirmed) Top Events that can be optimized (keep last 3 months data only - rolling. Potential cost saving ~$2500 from $3800 per month ):
- Merchandising_query (61TB, $731/month)
- Merchandising_page (56TB, $671/month)
- Monitor_client_mobile_app_screen_view (53TB, $638/month)
- Mobile_app_screen_view_ios_detail (27TB, $322/month)
- User_location_update (31TB, $368/month)
- Mobile_app_platform_front_end (18TB, $213/month)
- Mobile_app_platform_get_contents (12TB, $139/month)
- Mobile_app_device_log (9TB, $111/month)
- Recommend to stop sending data to traveloka-android-8888:firebase_performance.com_traveloka_android_ANDROID. Most of the data not being used at this time
- Assess BQ query cost (tvlk-data-user-prod & dev)
- In tvlk-data-user-prod, ~40% of query cost coming from commActivityViewer service. Remaining from Domo (40%) and Dark-Phoenix (20%)
- Cost in tvlk-data-user-dev is expected to increase compared to the last period, since we’re in progress migrating jobs from Databricks.
- Enforce team to always use _PARTITIONTIME as main filter, and change Overwrite to Append method while writing to the physical table. This potentially reduces query cost ~$50-$200/7days.
- Key projects including Cross Selling, Universal Search, Saved Item, Merchandising are BAU.
- Esp in Cross Selling, we’re planning to reiterate experimentation of new design cross selling booking form in app 3.21 or 3.22 (or in traffic slightly back to normal).
Target for this week:
- Building initial dashboard GDS for key projects:
- Common View Platform
- Cross Selling T1 - T2
- Universal Search
- Saved Item
- Segment <> Amplitude renewal/decommissioning discussion. //Complete handover process from Abhaya and team.
Reference:
https://docs.google.com/spreadsheets/d/1fwfUUjiCty-rsB77gN1gUJF7-QWPn3ZIw_-sYxTPBWU/edit?usp=sharing