Skip to content

hnawaz007/datalake

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Trino with Iceberg, Postgres, and MinIO

This is the datalake setup using Trino with an Iceberg connector, Postgres as metastore, and MinIO for object storage.

Start everything up:

docker-compose up

Connect to the Trino controller to execute some SQL:

docker-compose exec controller trino

Stop and remove the containers and network:

docker-compose down

Airflow Setup

We build a custom image for Airflow. Dockerfile and docker-compose.yml file are available in this repo.

To build the image:

docker build -t airflow-trino -f Dockerfile . --no-cache

Start everything up:

docker-compose up -d

About

open source data lake

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published