Senior Data Engineer (8+ years) specializing in full-cycle platform architecture, from architecting Medallion Lakehouse patterns to building high-throughput delivery systems. Expertise includes implementing and leveraging platform modernization using Infrastructure as Code (Terraform) and containerization (Kubernetes), alongside designing resilient, high-volume data pipelines with self-healing mechanisms (DLQs/Circuit Breakers). Proven experience in building high-scale knowledge graphs (150M+ nodes, Neo4j) and architecting RAG pipelines to drive cutting-edge, LLM-powered AI products.

Skills

Platform & Architecture

Advanced
  • System Design
  • Medallion lakehouse
  • event-driven pipelines (AWS SQS, RabbitMQ)
  • multi-tenant
  • infrastructure-as-code (Terraform)
  • Kubernetes
  • RAG (Retrieval-Augmented Generation)

Data Engineering

Expert
  • Apache Airflow
  • SQLMesh
  • Databricks
  • PySpark
  • Polars
  • ETL pipelines
  • real-time data processing
  • circuit breakers
  • dead-letter queues
  • Pandas

Databases & Storage

Expert
  • Neo4j (150M+ nodes)
  • PostgreSQL
  • BigQuery
  • Snowflake
  • ElasticSearch
  • MongoDB
  • AWS S3

Cloud & Infrastructure

advanced
  • AWS (Lambda, SQS, S3, RDS, CloudWatch)
  • GCP (BigQuery, CloudSQL, Cloud Run, Dataproc)
  • Terraform
  • Docker
  • GitHub
  • CI/CD

Backend & APIs

expert
  • FastAPI
  • Django
  • Apollo GraphQL
  • REST API
  • gRPC
  • microservices

Programming Languages

advanced
  • Python (primary)
  • Go
  • JavaScript
  • Elixir

Observability & BI Tools

advanced
  • DataDog
  • CloudWatch
  • Metabase
  • Redash
  • Superset

Work Experience (7)

May 2025 - Oct 2025
Senior Software Engineer, Data
Earlybird Venture Capital.
 https://earlybird.com/
Berlin, Germany
  • Led comprehensive architectural triage and refactor, resulting in the elimination of over 2M lines of redundant code and binary files; improved modularity and modernized service deployments (e.g., Cloud Run) from Airflow DAGs to Infrastructure as Code (IaC).
  • Completely rewrote the core stealth startup suggestion generation module, enabling a front-end refactor that successfully resolved multiple long-standing product bugs.
  • Architected split of 1TB database (9M+ startups) to BigQuery warehouse and CloudSQL app database, implementing sync with 24-hour SLA using Airflow
  • Implemented Terraform IaC for 50% of GCP resources (CloudSQL, BigQuery), creating reproducible deployments and reducing infrastructure drift
Oct 2023 - Feb 2025
Senior Data Engineer
scoutbee GmbH.
 https://scoutbee.com/
Berlin, Germany
  • Engineered a state-tracking API (FastAPI) to govern the asynchronous batch enrichment pipeline (AWS Lambda, Airflow, Neo4j), eliminating manual supervision and reducing end-to-end latency by 80%.
  • Architected and deployed a highly reliable web scraping pipeline (Lambda, SQS, RDS) to process 16M supplier domains, cutting false positives from 40% to 20% by implementing self-healing mechanisms (circuit breakers/DLQs).
  • Architected and scaled the Neo4j knowledge graph (150M+ nodes) for the LLM chat product, ensuring sub-10s latency to successfully enable the company's pivot to a unified AI platform.
  • Optimized infrastructure costs by migrating high-volume, historical Neo4j data to Snowflake, resulting in significant savings and immediately enabling self-service SQL analytics for business intelligence (Sales/Ops).
Dec 2020 - Oct 2023
Data Engineer
scoutbee GmbH.
 https://scoutbee.com/
Berlin, Germany
  • Led architecture and development of the core data platform (Airflow, Kubernetes, Polars), replacing vendor solutions (Databricks/PySpark) and slashing infrastructure costs by 60-70%.
  • Automated and standardized all data transformations via robust Airflow-based ETL pipelines, reducing the customer-facing dataset integration SLA from 3 days to just hours.
  • Engineered a multi-tenant Data API layer (GraphQL, ElasticSearch) utilized by 6 major customer implementations (e.g., Unilever, Siemens), directly improving internal developer efficiency by 30%.
  • Architected a high-scale knowledge graph model (5M+ nodes, 40 labels), delivering millisecond query performance via optimized Neo4j indices.
  • Established the data warehouse foundation using Medallion Architecture (AWS S3, Databricks workflows), processing 50K-1M rows daily and transforming data into 15 Neo4j nodes per row.
Mar 2018 - Feb 2020
Software Engineer, Backend & Data
Pathao Ltd.
 https://pathao.com/
Dhaka, Bangladesh
  • Architected an event-driven queuing service for the food delivery platform, successfully scaling daily orders from 20K to 50K and reducing request latency from 600ms to 200ms.
  • Developed coupon and promotions microservices from scratch, establishing a critical new revenue channel by enabling highly targeted marketing campaigns and sophisticated restaurant discount programs.
  • Rewrote the core dispatcher microservice in Go, cutting order failures by 80% during peak demand via priority-based delivery person matching.
  • Drove Airflow adoption and platform modernization, replacing legacy Bash scripts by converting all Food and Rides table imports to Python/Airflow/BigQuery, and deploying BI dashboards (Metabase/Redash) to optimize key business operations.
May 2017 - Feb 2018
Software Engineer, Fullstack
Circle FinTech Ltd.
 https://circlefintech.com/
Dhaka, Bangladesh
  • Developed a unified financial application (hybrid mobile and Django backend), launching the MVP to market.
Dec 2016 - Apr 2017
Software Engineer
RDZ Solutions
 https://rdzsolutions.com/
Dhaka, Bangladesh
  • Contributed to the development and optimization of two key internal systems: a Django-based call center management system and the shipping container platform.
Nov 2015 - May 2016
Intern Software Engineer
WebAble Digital
 https://webable.digital/
Dhaka, Bangladesh
  • Developed a dashboard solution to monitor and analyze SendGrid mailing list performance and deliverability.
  • Customized and modified client WordPress themes based on specific customer requirements.

Education (1)

- 2018
BSc
 Computer Science
American International University - Bangladesh
0

Languages

English

C1

Bengali

C2

German

A2