Is that time already? Another year gone by? Well, what a year it has been. Every year at this time, I like to look back…
Over the past 9 months, I’ve been working on a book to be published by O’Reilly Media. This past week, Data Pipelines Pocket Reference was…
In an ideal world, data engineers are presented with a source of ingesting data (the Extract and Load steps in ELT) from source systems that’s…
The death of the data warehouse, long prophesied, seems to always been on the horizon yet never realized. Much like cold fusion power and fully…
Deep breath. In and out. I’ve been doing a lot of that in 2020, and I know I’m not alone. I hesitated to write a…
Loading data that’s been stored in an S3 bucket into a Snowflake data warehouse is an incredibly common task for a data engineer. In an…
A while back, I wrote a post on why ELT is preferable to ETL with Amazon Redshift and other modern data warehouses such as Snowflake…
In a previous post, I wrote about using the COPY command to load data from an S3 bucket into a Redshift table. In this post,…
Considering building a data warehouse in Amazon Redshift? It’s a great option, even in an increasingly crowded market of cloud data warehouse platforms. If you’re…
When you’re loading and transforming data in your Redshift data warehouse, you’ll often want to stage data in a temporary table rather than insert it…