PinnedPublished inDev GeniusHow we mastered dbt: A true storyStaying sane in the modern world of data engineering is a non-trivial mission. As data engineers we ask ourselves the same question several…Mar 22, 2023Mar 22, 2023
Logs Don’t Lie: Debugging My Data Engineering Crisis in 2025Every data pipeline has its breaking point. Mine came in late 2024, throwing errors I couldn’t ignore. Logs showed signs of stagnation…Jan 61Jan 61
Goodbye Netlify, Hello Ghost: My Blog’s New HomeIn October 2021, I published my first blog post on Medium: Pub/Sub to BigQuery: How to Build a Data Pipeline Using Dataflow, Apache Beam…Nov 22, 2024Nov 22, 2024
Who’s Really Following You on Dev.to? A Guide to Analyzing Your AudienceThe reason I’m writing this post is to shed some light on an aspect of Dev.to that many of us don’t think twice about: our followers. We…Nov 13, 20242Nov 13, 20242
12 Steps to Organize and Maintain Your Python Codebase for BeginnersThe reason why I’m writing this post is to share some insights on keeping a project clean, even with lots of contributors. This is…Oct 30, 20241Oct 30, 20241
My Journey Learning AI for Songwriting: LSTMs and Taylor SwiftI spent last 4 months learning with the Machine Learning Zoomcamp. When it was time for the final project, I wanted to try something new…Feb 19, 20241Feb 19, 20241
The Data Engineering Docker-Compose Starter KitWe’ve all been there. Starting a new data engineering project and, instead of diving right into the fun stuff, we’re stuck setting up…Sep 29, 2023Sep 29, 2023
Published inDev GeniusThe Golang Saga: A Coder’s Journey There and Back Again. Part 3: The Graphing ConundrumWelcome back to the third part of “The Golang Saga: A Coder’s Journey There and Back Again.” In the first part of this series, I started…Aug 17, 2023Aug 17, 2023
Published inDev GeniusThe Golang Saga: A Coder’s Journey There and Back Again. Part 2: The Data ExpeditionWelcome back to the second part of “The Golang Saga: A Coder’s Journey There and Back Again.” In the first part of this series, I started…Jul 27, 20231Jul 27, 20231
Published inDev GeniusThe Golang Saga: A Coder’s Journey There and Back Again. Part 1: Leaving the ShireThe idea of learning Golang has been circulating in my head for quite some time. However, like many of us, I constantly found excuses to…Jul 4, 20231Jul 4, 20231
Published inDev GeniusUnleash Your Pipeline Creativity: Local Development with Argo Workflows and MinIO on MinikubeAs a data engineer, you know the joy of wrangling massive datasets and navigating complex data pipelines. Argo Workflows, a popular…Apr 28, 20231Apr 28, 20231
From Kafka to Amazon S3: Partitioning OutputsSo you’ve got a ton of data that needs to be processed in real-time, huh? Don’t worry, in this tutorial I’ll show you how to stream data…Apr 9, 20231Apr 9, 20231
Published inTowards Data SciencePubSub to BigQuery: How to Build a Data Pipeline Using Dataflow, Apache Beam, and JavaLearn how to create a data pipelineOct 4, 20212Oct 4, 20212