Docker and DBT starter template

TL;DR: Docker and DBT starter template

I am currently revising some data modeling concepts, and in the course I am doing they use Pentaho. However, the lecturer clearly states that Pentaho is just the tool, and the course is generic enough that you can use any tool you want.

At Cable, we used DBT (data build tool) to build our data models and run them on BigQuery. I became a big fan of DBT, and really wanted to use it during my course. So, to make my life easier, I created a starter template for Docker and DBT.

You can check out the GitHub repository here. All files should be self-explanatory, but open an issue if you have any questions.

Motivation

  1. I did not want to setup a Python environment - I have been using Poetry and it feels clunky to me
  2. I already had Docker installed on my machine, so I thought that I could have a similar workflow to VSCode’s devcontainers
  3. I still wanted to use Zed as my editor - so I wanted to make sure that the changes in my host machine were reflected in the container
  4. I also wanted to be able to generate and access the docs that DBT creates
  5. And finally I knew I could just use docker-compose to run the dbt container and the Postgres container easily together

I hope this helps you get started with Docker and DBT.

I like virtual coffees

Virtual coffees are a divisive topic. The opinions I have seen around me range from “yuck, no” to “they’re okay”. Personally, they can be really great! I have had many fulfilling conversations, ranging from learning moments about other areas of the company to deep, meaningful life conversations. This post serves to advocate for virtual coffee, to both managers and ICs, and to share a few tips that hopefully will help make your one-on-one moments better.

More …

Setting up a new Mac

I wanted to write a blogpost about how I setup my new Mac for work. However, I find myself being annoyed at my own process of setting up my Mac. I feel this because my process feels inefficient.

Let me walk you through how I setup things. And hopefully I will figure out the questions I should be asking myself to improve it.

More …

Learning to be managed

I said to myself that I was going to write once a month during 2024. I want to make good on that promise, though I am already late for January… So let’s just say I want to write on average once a month. Just a small change of the goal posts. I think it is acceptable.

Goal posts relate to the topic I want to talk about today: management. “Learning how to be managed” is a topic I am interested in, because I think I have been doing it wrong. And it took failing at one of my own goals to dive into it.

More …