dbt Core Integration in the Homelab

Integrating dbt Core into the homelab to transform data with version control, tests and documentation — the T layer of ELT running on top of the local MySQL server.

Overview

After getting the homelab MySQL server up and running, the natural next step was to structure the transformation layer: adopting dbt Core to version, test and document the SQL models that used to live in loose scripts.

In progress

This log is being written as the project happens. Current scope:

Configure dbt Core against the homelab MySQL;
Migrate existing transformations into versioned models;
Add schema tests and generated documentation.

Field notes

Entry being updated — check back soon.