llm-hackathon

LLM pilot projects

Environment

This repo includes the recipe for a custom docker image with dependencies for a general ML/NLP/web scraping and langchain-based LLM development environment in python. It is not necessary to rebuild the image -- just pull it from dockerhub and spin it up.

Prerequisites (Ubuntu)

• Install Docker

• Install NVIDIA Drivers

• Install NVIDIA container toolkit

Environment setup

You can use native docker commands but this repo also includes a makefile docker.mk for convenience.

Pull the docker image from dockerhub:

make -f docker.mk pull

Run container in an interactive bash environment:

make -f docker.mk run