Relying solely on the outputs of machine learning (ML) models without a thorough verification can lead to unexpected results. Continuing from my previous DevLog, I embarked on a project to analyze car prices across various brands using data from AutoScout24.…
In the Snowflake data platform, databases are similar to virtual hard drives where you store data, while warehouses are the virtual compute resources you use to run analytical queries. Here’s what to know. In today’s data-driven world, having a robust…
Overview: What is dbt and what can it do for your data pipeline? One tool that we recommend and often use is dbt (data build tool), which focuses on simplifying and accelerating the process of data transformation. In this blog,…
Most businesses today are data-driven, and to make sound decisions, they need access to accurate and timely data. However, setting up and maintaining a data warehouse can be costly and time-consuming. Apache Superset is an open-source tool that makes it…
Building a data warehouse can be a costly endeavor, with several factors impacting the final price tag. Factors such as the size and complexity of the data, the tools and technologies used, the number of users, and the level of…
In today’s data-driven world, companies are constantly on the lookout for new and innovative ways to extract value from the vast amounts of data they generate and collect. To meet this demand, there are three key approaches that have emerged…
As a data engineer, you know that the field is full of challenges. From data quality to data transformation, there are always issues to be addressed and problems to be solved. In this post, we’ll take a look at some…
Treeverse LakeFS is an open-source, distributed file system designed for data lakes. It allows users to store, organize, and manage large volumes of structured and unstructured data in a single, scalable repository. One of the key features of LakeFS is…
MyData AG helps people in the business to get more value from their data. Value from data comes in three forms: Increase revenue, reduce costs and Peace of mind. If you have data in the core of your business process…