Over the past 9 months, I’ve been working on a book to be published by O’Reilly Media. This past week, Data Pipelines Pocket Reference was…
In an ideal world, data engineers are presented with a source of ingesting data (the Extract and Load steps in ELT) from source systems that’s…
The death of the data warehouse, long prophesied, seems to always been on the horizon yet never realized. Much like cold fusion power and fully…
Deep breath. In and out. I’ve been doing a lot of that in 2020, and I know I’m not alone. I hesitated to write a…
Workflow management platforms are what data engineers use to schedule and coordinate the steps in a data pipeline – an activity sometimes referred to as…
A collection of free books, courses, and videos for data analysts and analytics engineers. dbt Fundementals dbt is the hottest thing in the “T” in…
Loading data that’s been stored in an S3 bucket into a Snowflake data warehouse is an incredibly common task for a data engineer. In an…
Sometimes I think that there’s nothing good about getting older. Workouts take just a bit more time to recover from, life’s responsibilities multiply, and you’re…
Though the title of this post may sound obvious to some, it’s not how most organizations function. Many excellent software engineers are led to believe…
He described his partners as “nostalgic for the future,” like many computer hobbyists of the day, and their discussions were frequently those of visionaries. Lee…