一个计算想用的LLMs推理、微调所需要的显存大小的计算工具
myblog 描述了对应的理解方式 ：http://whtblog.cn/archives/1719217334265
Cite：Estimating Memory Consumption of LLMs for Inference and Fine-Tuning for Cohere Command-R+ (huggingface.co)
-
Notifications
You must be signed in to change notification settings - Fork 0
FlypigW/LLMsneedsgraphmemory
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
一个计算想用的LLMs推理、微调所需要的显存大小的计算工具
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published