Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Typo fine-tune-llms-in-2025.ipynb #72

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Typo fine-tune-llms-in-2025.ipynb #72

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
7b96328
Typo fine-tune-llms-in-2025.ipynb
ChristianBernhard Dec 30, 2024
a5d1d1c
Fix typo fine-tune-llms-in-2025.ipynb
ChristianBernhard Jan 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion training/fine-tune-llms-in-2025.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -357,7 +357,7 @@
"* [LLM Evaluation doesn't need to be complicated](https://www.philschmid.de/llm-evaluation)\n",
"* [Evaluating Open LLMs with MixEval: The Closest Benchmark to LMSYS Chatbot Arena](https://www.philschmid.de/evaluate-llm-mixeval)\n",
"\n",
"We are going to use [Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) an open-source framework to evaluate language models on a wide range of tasks and benchmarks. The frameworks support evaluating models behind OpenAI compatible API endpoints, those can be locally or remotely. This super helpful as we can evaluate our model in the same environment we will use for production. \n",
"We are going to use [Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) an open-source framework to evaluate language models on a wide range of tasks and benchmarks. The frameworks support evaluating models behind OpenAI compatible API endpoints, those can be locally or remotely. This is super helpful as we can evaluate our model in the same environment we will use for production. \n",
"\n",
"\n",
"We are going to use [Text Generation Inference (TGI)](https://github.com/huggingface/text-generation-inference) for testing and deploying our model. TGI is a purpose-built solution for deploying and serving Large Language Models (LLMs). TGI enables high-performance text generation using Tensor Parallelism and continous batching. If you are or want to use vLLM you can check the Appendix on how to start the inference server.\n",
Expand Down