Experienced data engineer with over 8 years of expertise in data warehousing and data governance. Adept at breaking down complex problems into actionable solutions and driving team performance to achieve results. Known for balancing technical proficiency with leadership to streamline processes and support organizational goals.
Experience
I supervised the design, development, and delivery of data platform and data pipelines by both Data Engineers and Data Analysts.
I migrated and developed critical data warehouse pipelines to ByteDance's data development tool.
- Delivered up to 20 critical data warehouse pipelines monthly in multiple domains.
- Delivered up to 10 cricical data ingestion pipelines monthly from multiple databases.
- Led the adoption of ByteDance's data development tool and standard.
- Served as the point of contact for all matters related to data warehouse infrastructure.
- Proactively monitored data warehouse pipelines and resolved issues to minimize disruptions.
I led a team that developed services for self-serve data warehouse activities.
- Led the development of a service for data warehouse pipeline creation and modification. It delivered up to 80 requests monthly, and increased team deliverables by up to 100% through automation.
- Led the development of a service for governing and executing general-purpose DML requests, which can be used for backfill or adhoc data import or export. It delivered up to 140 requests monthly.
- Led the development of a service for governing and executing view creation and modification for controlled data warehouse access. It delivered up to 90 requests monthly.
- Led the development of a service for granting or extending temporary table access. It delivered up to 100 requests monthly.
- Published a defensive publication titled 'Controlled Data Warehouse Access through SQL Views' (https://priorart.ip.com/IPCOM/000271224).
- Proactively monitored data warehouse pipelines and resolved issues to minimize disruptions.
I led a team that formulated and implemented data governance program.
- Developed policies, standards, and procedures to ensure data quality and security.
- Improved the organization and accessibility of LinkAja's business intelligence tool.
- Supervised the development of a data catalog tool by a vendor.
- Initiated a process to assess data model during product development to ensure it is suitable for data warehouse.
- Collaborated with Core Business Intelligence, Product Analytics, Legal, and Compliance to build a reliable, scalable, and secure data infrastructure.
I ensured the compliance of all data-related activities.
- Implemented policies, standards, and procedures to ensure data security.
- Assessed the data security aspect during external data sharing.
- Collaborated with IT Governance, Risk, and Compliance (IT GRC) and Legal to ensure the compliance of all data-related activities.
I led a team that initiated data governance program.
- Developed policies, standards, and procedures to ensure data quality and security.
- Assessed data model during product development to ensure it is suitable for data warehouse.
- Organized company-wide data-related courses to ensure data-driven culture.
- Analyzed and formulated a solution for the needs of business stakeholders.
- Collaborated with other data units (Data Engineering, Business Intelligence Analytics, and Data Science Engineering) to build a reliable and scalable data infrastructure.
I initiated data quality initiative.
- Created and implemented a data quality framework for data warehouse.
- Developed an automated testing tool for data warehouse.
- Investigated the root cause for data quality issues and formulated a solution for it.
Education
Publications
An automated service designed to process requests to access Data Warehouse tables. It handles access creation automatically upon approval of the request, controls access expiration, and validates to only pass whitelisted resources.