This is the datalake setup using Trino with an Iceberg connector, Postgres as metastore, and MinIO for object storage.
Start everything up:
docker-compose upConnect to the Trino controller to execute some SQL:
docker-compose exec controller trinoStop and remove the containers and network:
docker-compose downWe build a custom image for Airflow. Dockerfile and docker-compose.yml file are available in this repo.
To build the image:
docker build -t airflow-trino -f Dockerfile . --no-cacheStart everything up:
docker-compose up -d