PinnedPublished inDev GeniusHow we mastered dbt: A true storyStaying sane in the modern world of data engineering is a non-trivial mission. As data engineers we ask ourselves the same question several…Mar 22, 2023Mar 22, 2023
12 Steps to Organize and Maintain Your Python Codebase for BeginnersThe reason why I’m writing this post is to share some insights on keeping a project clean, even with lots of contributors. This is…Oct 301Oct 301
My Journey Learning AI for Songwriting: LSTMs and Taylor SwiftI spent last 4 months learning with the Machine Learning Zoomcamp. When it was time for the final project, I wanted to try something new…Feb 191Feb 191
The Data Engineering Docker-Compose Starter KitWe’ve all been there. Starting a new data engineering project and, instead of diving right into the fun stuff, we’re stuck setting up…Sep 29, 2023Sep 29, 2023
Published inDev GeniusThe Golang Saga: A Coder’s Journey There and Back Again. Part 3: The Graphing ConundrumWelcome back to the third part of “The Golang Saga: A Coder’s Journey There and Back Again.” In the first part of this series, I started…Aug 17, 2023Aug 17, 2023
Published inDev GeniusThe Golang Saga: A Coder’s Journey There and Back Again. Part 2: The Data ExpeditionWelcome back to the second part of “The Golang Saga: A Coder’s Journey There and Back Again.” In the first part of this series, I started…Jul 27, 20231Jul 27, 20231
Published inDev GeniusThe Golang Saga: A Coder’s Journey There and Back Again. Part 1: Leaving the ShireThe idea of learning Golang has been circulating in my head for quite some time. However, like many of us, I constantly found excuses to…Jul 4, 20231Jul 4, 20231
Published inDev GeniusUnleash Your Pipeline Creativity: Local Development with Argo Workflows and MinIO on MinikubeAs a data engineer, you know the joy of wrangling massive datasets and navigating complex data pipelines. Argo Workflows, a popular…Apr 28, 20231Apr 28, 20231
From Kafka to Amazon S3: Partitioning OutputsSo you’ve got a ton of data that needs to be processed in real-time, huh? Don’t worry, in this tutorial I’ll show you how to stream data…Apr 9, 20231Apr 9, 20231
Published inTowards Data SciencePubSub to BigQuery: How to Build a Data Pipeline Using Dataflow, Apache Beam, and JavaLearn how to create a data pipelineOct 4, 20212Oct 4, 20212
