Evaluations integration (#55)

* -improved version of langchain rag with observability

* -improved version of langchain rag with arize-phoenix

* removed the secret

* removed the secret

* pushed mlflow basic evals

---------

Co-authored-by: pavanmantha <pavan.mantha@thevaslabs.io>

Author: pavanjava

bootstraprag/templates/evaluations/mlflow_evals/basic_evaluations.py

@@ -0,0 +1,34 @@
+import mlflow
+import openai
+import pandas as pd
+from dotenv import load_dotenv, find_dotenv
+
+load_dotenv(find_dotenv())
+
+eval_data = pd.read_csv("input_data.csv")
+
+with mlflow.start_run() as run:
+    system_prompt = "Answer the following question in two sentences"
+    # Wrap "gpt-4" as an MLflow model.
+    logged_model_info = mlflow.openai.log_model(
+        model="gpt-4",
+        task=openai.chat.completions,
+        artifact_path="model",
+        messages=[
+            {"role": "system", "content": system_prompt},
+            {"role": "user", "content": "{question}"},
+        ],
+    )
+
+    # Use predefined question-answering metrics to evaluate our model.
+    results = mlflow.evaluate(
+        logged_model_info.model_uri,
+        eval_data,
+        targets="ground_truth",
+        model_type="question-answering",
+    )
+    print(f"See aggregated evaluation results below: \n{results.metrics}")
+
+    # Evaluation result for each data record is available in `results.tables`.
+    eval_table = results.tables["eval_results_table"]
+    print(f"See evaluation table below: \n{eval_table}")

bootstraprag/templates/evaluations/mlflow_evals/input_data.csv

@@ -0,0 +1,3 @@
+,inputs,ground_truth
+0,What is MLflow?,"MLflow is an open-source platform for managing the end-to-end machine learning (ML) lifecycle. It was developed by Databricks, a company that specializes in big data and machine learning solutions. MLflow is designed to address the challenges that data scientists and machine learning engineers face when developing, training, and deploying machine learning models."
+1,What is Spark?,"Apache Spark is an open-source, distributed computing system designed for big data processing and analytics. It was developed in response to limitations of the Hadoop MapReduce computing model, offering improvements in speed and ease of use. Spark provides libraries for various tasks such as data ingestion, processing, and analysis through its components like Spark SQL for structured data, Spark Streaming for real-time data processing, and MLlib for machine learning tasks"

bootstraprag/templates/evaluations/mlflow_evals/requirements.txt

@@ -0,0 +1,3 @@
+mlflow==2.16.2
+python-dotenv==1.0.1
+pandas==2.2.3