Internship Project: RAG Backend

This repository contains the code for an internship project that implements a RAG Backend.

Setup

Clone the Repository:

git clone https://github.com/shryesth/llm-chatbot.git

Create a .ENV File:

1. Create a file named .env in the root directory of the project.
2. Add the following lines to the .env file, replacing the placeholders with your actual API keys:

GEMMA_TOKEN=xxxxxxxxxx
GOOGLE_API_KEY=xxxxxxxxxx

• Note: Gemma token is Hugging Face API Key.

Install Dependencies:

pip install -r requirements.txt

Run the Server

python src/runner.py

Additional Notes:

• Due to GPU limitations, the project wasn't able to fully test the GEMMA local LLM. However, responses were still obtained.
• Make a GET request on server to obtain endpoints.