What Does a Data Engineer Do in Production (No Hype)

If you learned Data Engineering with notebooks and clean datasets, this article is for you. In production there are no clean datasets: there are systems that change, pipelines that fail, and data that has to be correct every single day.

TL;DR

A Data Engineer in production:

Builds and maintains reliable pipelines