Designing high-throughput data pipelines, real-time transaction streaming architectures, and distributed data platforms.
Languages & Frameworks
|
Orchestration & Transformation
|
Databases & Storage
|
Analytics & Observability
|
Infrastructure & DevOps
|
Data Quality & Governance
|
- ETL/ELT Pipeline Development — Scalable, reliable workflows for structured and semi-structured data lakes and warehouses.
- Real-Time Streaming — Event-driven ingestion with Apache Kafka; building high-throughput pipelines for transaction and telemetry data.
- Data Transformation & Modeling — dbt-based star schema design, incremental models, and data quality testing layers.
- Workflow Orchestration — Complex DAG authoring, dependency management, SLA monitoring, and backfill handling with Apache Airflow.
- Financial Data Processing — Ledger design, safe transaction state management, and high-precision liquidity forecasting aggregates.
- Data Warehousing & Lakehouse — PostgreSQL, Cassandra, and Delta Lake architectures optimized for read/write query patterns at scale.
- Observability & Reliability — End-to-end pipeline monitoring with Grafana, Sentry alerting, connection pool health, and data quality gates.
- Containerized Deployments — Multi-container Docker workflows for local production parity and cloud-ready deployments.
📧 kiprutovictor39@gmail.com | 📞 +254 723 484 552