I build robust data pipelines and analytics infrastructure that transform raw data into valuable insights. My expertise spans the entire data engineering lifecycle - from ingestion to transformation to serving.
| Core Languages | Python, Golang, SQL |
| Python Ecosystem | FastAPI, Streamlit, Pydantic, Polars, BeautifulSoup, Selenium, dlt |
| Big Data & Processing | Apache Spark, Kafka, Hadoop |
| Cloud & Infrastructure | GCP, AWS, Docker, Kubernetes, Terraform |
| Data Platforms | Snowflake, Databricks, DBT |
| Orchestration | Airflow, Mage |
| Databases | PostgreSQL, MongoDB, Cassandra, Elasticsearch, SQLite, MySQL |
| Visualization | Tableau, Looker Studio |
|
VS Code extension to view and explore binary data files directly in the editor. Supports 11 formats including pkl, h5, parquet, feather, joblib, npy, npz, msgpack, arrow, avro, nc, and mat. Technologies: TypeScript, Python, VS Code API, Virtual Environments |
|
|
Production-ready Infrastructure as Code template for AWS with support for dev, staging, and prod environments. Features modular architecture and remote state management. Technologies: Terraform, AWS, IaC, Multi-Environment Setup |
|
|
Distributed parallelization engine using Docker, Celery, and RabbitMQ for scalable task execution. Features dynamic worker scaling, fault tolerance, and throughput optimization. Technologies: Python, Docker, Celery, RabbitMQ, Distributed Systems |
|
|
End-to-end ETL pipeline that processes traffic accident data to identify patterns and risk factors. Technologies: Python, Apache Airflow, Spark, Data Visualization |
|
|
Data pipeline that aggregates property listing data to generate market insights and trends. Technologies: Python, DBT, Snowflake, Data Modeling |
|
|
Tool that extracts and processes professional network data to uncover industry trends and connection opportunities. Technologies: Python, Selenium, BeautifulSoup, MongoDB |
|
When I'm not building data pipelines, you might find me on the badminton court, swimming laps, or exploring new destinations.
