DEV Community

#etl

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
D-MO (Data Micro-Optimizer)

D-MO (Data Micro-Optimizer)

Comments
3 min read
How to Replicate MySQL to BigQuery with Sling

How to Replicate MySQL to BigQuery with Sling

Comments
9 min read
RAG na Prática: Por Que ETL, Chunking e Embedding Não São a Mesma Coisa

RAG na Prática: Por Que ETL, Chunking e Embedding Não São a Mesma Coisa

Comments
3 min read
Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs

Why Apache Airflow Instead of Cron? A Deep Dive Into How Airflow Actually Schedules Your DAGs

Comments
4 min read
Understanding Pega's `pzPVStream`: Why a 20-Year-Old Design Still Makes Sense

Understanding Pega's `pzPVStream`: Why a 20-Year-Old Design Still Makes Sense

Comments
5 min read
I Thought My Virtual Environment Was Broken... It Wasn't.

I Thought My Virtual Environment Was Broken... It Wasn't.

Comments
1 min read
Understanding ETL: A Chaotic Introduction

Understanding ETL: A Chaotic Introduction

Comments
4 min read
Why Sequential Reads Beat Random Reads in Postgres at Scale

Why Sequential Reads Beat Random Reads in Postgres at Scale

4
Comments 1
3 min read
schema drift를 fail이 아니라 warn으로 둔 이유

schema drift를 fail이 아니라 warn으로 둔 이유

Comments
2 min read
wide CSV 여러 개를 EAV로 모아 gold mart 만들기

wide CSV 여러 개를 EAV로 모아 gold mart 만들기

Comments
2 min read
source_hash로 같은 입력 재처리를 안전하게 skip하기

source_hash로 같은 입력 재처리를 안전하게 skip하기

Comments
1 min read
skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기

skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기

Comments
3 min read
AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran

AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran

Comments
6 min read
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Comments
2 min read
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't

Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't

Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.