Data Platform Engineer, StepStone Germany (via EPAM Systems)
Mar, 2024 - Present
Building a self-service event data platform that provisions the infrastructure, tooling and access producers and (mostly analytics) consumers need to exchange data in a decoupled, governed way - streamlining end-to-end data-product creation.
Led the migration of the platform's Kafka estate to AWS MSK, improving reliability and operability of the streaming backbone
Designed and built an encryption service and supporting Java libraries to transparently encrypt and decrypt Avro message fields, enabling field-level data protection backed by AWS KMS
Stood up the event data platform foundation as infrastructure-as-code in Terraform across MSK, Glue, S3, ECS, DynamoDB, Lambda, Lake Formation and IAM
Automated performance and end-to-end testing for data pipelines, catching regressions before release
Instrumented platform observability with Datadog and CloudWatch
Built a Java-based CLI tool covering Terraform resource generation, Avro schema validation against a custom rule engine, and Java/dotnet package generation via templating - consolidating key developer workflows into a single internal tool
