The harsh truth about the analytics industry is that “simple doesn’t sell”. It’s challenging to advocate for simplicity in data architecture because simple solutions often appear effortless, and who wants to invest in something that looks easy? While everyone claims…
I accidentally re-invented a Data Lakehouse. Over the last couple of months, I chipped away at my car price estimation tool whenever I could muster up some free time. I haven’t put much thought into the overall data architecture. This…
Goodbye, DBeaver! For the terminal lovers, have you checked out Harlequin? It’s a SQL IDE that you can easily install via pip and run right in your terminal. I’ve found it super user-friendly—really straightforward to install and use. Sure, it…
🚀 My personal Hall of Fame of tools and technologies 🛠️ (Python ecosystem edition) These tools and technologies have served me well over the years, so I thought I’d share them: 🔵 Click, Loguru: Creating command line interfaces🔵 dotenv, pyyaml:…
Relying solely on the outputs of machine learning (ML) models without a thorough verification can lead to unexpected results. Continuing from my previous DevLog, I embarked on a project to analyze car prices across various brands using data from AutoScout24.…
As a tech enthusiast and an follower of the “eat your own dog food” philosophy, I’ve embarked on a project that intertwines my passion for cars with my profession in Machine Learning. In this initial development log, I’d like to…
Overview: What is dbt and what can it do for your data pipeline? One tool that we recommend and often use is dbt (data build tool), which focuses on simplifying and accelerating the process of data transformation. In this blog,…
When it comes to designing a data warehouse, there are two main schema models that are commonly used: the star schema and the snowflake schema. Both of these models have their own unique characteristics and benefits, but they also have…
As a data engineer, you know that the field is full of challenges. From data quality to data transformation, there are always issues to be addressed and problems to be solved. In this post, we’ll take a look at some…