Any Free Version of this

[Raghucharan16]

Description

What is wrong or what would you like to see improved?
Nothing is Wrong but can we locally set it up with another open source LLM? and also with out cloud costs? just like a standalone application?

[pamelafox]

Yes, you can open it in a GitHub Codespace or VS Code Dev Container, which will use Postgres, and then you can configure it to use Ollama, per guide at:
https://github.com/Azure-Samples/rag-postgres-openai-python?tab=readme-ov-file#setting-up-the-environment-file

Let me know if that doesn't work for you.

[Raghucharan16]

Sure will check it out. 👍

[Raghucharan16]

Yes, you can open it in a GitHub Codespace or VS Code Dev Container, which will use Postgres, and then you can configure it to use Ollama, per guide at: https://github.com/Azure-Samples/rag-postgres-openai-python?tab=readme-ov-file#setting-up-the-environment-file

Let me know if that doesn't work for you.

Hi, @pamelafox , can we connect to our own [custom] postgres SQL database? so that LLM should refer that database for any user input questions[ basically to automate customer support service].

[pamelafox]

Good question! I've written up a page about bringing in a different table here:
https://github.com/Azure-Samples/rag-postgres-openai-python/blob/main/docs/customize_data.md
I also made some code changes so that there is slightly less code to update.

However, that may not be exactly what you're looking for. Do you already have a Azure PostgreSQL database, and you want it to use that deployed DB? Take a look at that guide and see how it could be more helpful.