Skip to content

jackmulligan-ire/airflow-snowflake-pipeline

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Airflow Pipeline for Snowflake and GCP

A pipeline built to download a Parquet file containing taxi ride data, stage this in Google Cloud Storage, then create a table using an external stage in Snowflake.

You can find the Terraform file used to deploy the Snowflake and Google Cloud Platform infra for the project in this repo.

Screenshot 2025-01-26 at 15 03 47

About

Pipeline built using Docker, Airflow, Google Cloud Storage and Snowflake.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published