Q22018 Strategy Plan
IMPROVE PROCESS
- Data Engineer (@davin.pradipta & @hans.kristian) tasks will now be moved to DATA JIRA dashboard. Already discussed with Mas Endy and he’s cool with it.
- DA On-Call improvements:
- DA on-call will handle request from Product Ops. So now all requests from Product Ops will be assigned to Elsa first. The real assignee will be determined in weekly sprint, depending on the current on-call on that week.
- Elsa to make On-Call schedule for this quarter (Note: on-call on left is the primary on-call for that period):
- Apr 16 - 22: ['syaf', 'ferdy']
- Apr 23 - 29: ['ferdy', 'dean']
- Apr 30 - May 6: ['dean', 'ardy']
- May 7 - 3: ['ardy', 'sandra']
- May 14 - 20: ['sandra', 'syaf']
- May 21 - 27: ['syaf', 'ferdy']
- May 28 - Jun 3: ['ferdy', 'dean']
- Jun 4 - 10: ['dean', 'ardy']
- Jun 11 - 17: ['ferdy', 'sandra']
- Jun 18 - 24: ['sandra', 'syaf']
- Jun 25 - Jul 1: ['ardy', 'dean']
- Elsa to create user group for DA on-call ( udah dibikin: @accom-da-oncall). The primary on-call has to update user group members in every beginning of the week. Kalo gak keganti kena konsekuensi harus on-call lagi minggu itu
:happy_pepe:
- DA On-Call will be the main PIC for issue regarding data incident / system incident, including issue in Datadog and Daily Sales Report. Please note than on-call need to have full ownership of every problem. If problem occured during his / her on-call period, must take full ownership of it until problem is resolved.
- Data Engineer (Davin & Hans) will have end-to-end ownership of Tracking & ETL:
- Data Table Definition is now designed by DE. DA will need to submit request in DATA JIRA to DE for every new tracking.
- DE is now in charge to perform testing on the trackings together with QA.
- Data Quality Metrics will be designed and checked regularly by DE, reported in every bi-weekly with Elsa.
- New flow of checking metrics -> Consider pake fitur ‘Metrics` nya Holistics? https://secure.holistics.io/metrics/manage
TECH VELOCITY
- Migrate all Hive datasets in DOMO and all reports using Hive tables in Holistics to RS / S3 -> Kita mulai cicil yah. Tapi target by end of Q2 sudah ke-migrate semua. PR untuk data analysts: list down semua Hive tables Accom di sini: https://docs.google.com/spreadsheets/d/1MO1y9jARrLio2f_C7RVWD8-Ima8I0vsDdztCpsleX1I/edit#gid=0 please complete by end of this week.
- Dataset review is now part of On-Call work scope -> Ini gw sebenernya ngeri-ngeri sedap. Enak sih di gw ama sandra jadi ga perlu constantly ke-distract lagi, tapi with a price of less control of query quality
:sob: @sandra.dwiananda gimana nih bu?
- Separate environment for testing ETL development -> no plan to separate this yet from other non-ETL jobs by other DEs or DAs. Will talk to Endy / Firman about this.
- Tracking testing playbook using Databricks -> PIC: @ardy.dwi . Target to be delivered end of this week or early next week
- A/B Test process flow optimization & automation
- We need to gather all generic processes into re-usable functions in Databricks. PIC nya Ardy lagi nih di note gw
:face_with_rolling_eyes: Ada yg lain yg mau volunteer take task ini mungkin?
- If there’s a chance, need to discuss with CJ as well for future planning related to optimizing A/B flow.
- Change tracking approach from “One event one table” to “Single table for all events”. -> @davin.pradipta @hans.kristian since you will handle DTD (Data Table Definition) design now, please take note of this ya.
- BIG CHANGE: Hotel Ranking ownership is now hand-overed to Data Accommodation! Please learn about the new data transfer service to Hotel Level View (storage of Hotel Ranking metrics data) in this wiki: https://29022131.atlassian.net/wiki/spaces/ECON/pages/425754726/HLV+Data+Transfer (jangan lupa baca link-link di dalamnya juga yah).
IMPROVE PEOPLE
- (Ini ide baru dari gw, gak kita bahas pas meeting) mau coba sesi “Show and Tell” ngga? Buat latihan present insight internal kita2 doang, dan dapet feedback rame2 dari kita semua. Gantiin war room quarter lalu.
- Quarterly studi banding ke team lain esp. User team -> Bisa coba undang Vino ke Monthly Sharing Session kita untuk jelasin tentang User / Platform.
- Pilot program untuk dapet “buddy” DA. Masing2 DA wajib pilih satu analysis project yg mau dikerjain bareng buddy DA nya.