Skip to content

Commit

Permalink
bump version to v0.0.2 (#177)
Browse files Browse the repository at this point in the history
* bump version to v0.0.2

* fix command

* update installation and inference section
  • Loading branch information
lvhan028 authored Jul 28, 2023
1 parent 859658e commit 7e0b75b
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 12 deletions.
9 changes: 3 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,9 +55,7 @@ Below are quick steps for installation:
```shell
conda create -n lmdeploy python=3.10 -y
conda activate lmdeploy
git clone https://github.com/InternLM/lmdeploy.git
cd lmdeploy
pip install -e .
pip install lmdeploy
```

### Deploy InternLM
Expand All @@ -83,8 +81,7 @@ python3 -m lmdeploy.serve.turbomind.deploy internlm-chat-7b /path/to/internlm-ch
#### Inference by TurboMind

```shell
docker run --gpus all --rm -v $(pwd)/workspace:/workspace -it openmmlab/lmdeploy:latest \
python3 -m lmdeploy.turbomind.chat /workspace
python -m lmdeploy.turbomind.chat ./workspace
```

```{note}
Expand All @@ -109,7 +106,7 @@ python3 -m lmdeploy.serve.client {server_ip_addresss}:33337
or webui,

```shell
python3 -m lmdeploy.app {server_ip_addresss}:33337 internlm
python3 -m lmdeploy.app {server_ip_addresss}:33337
```

![](https://github.com/InternLM/lmdeploy/assets/67539920/08d1e6f2-3767-44d5-8654-c85767cec2ab)
Expand Down
7 changes: 2 additions & 5 deletions README_zh-CN.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,9 +54,7 @@ TurboMind 的 output token throughput 超过 2000 token/s, 整体比 DeepSpeed
```shell
conda create -n lmdeploy python=3.10 -y
conda activate lmdeploy
git clone https://github.com/InternLM/lmdeploy.git
cd lmdeploy
pip install -e .
pip install lmdeploy
```

### 部署 InternLM
Expand All @@ -82,8 +80,7 @@ python3 -m lmdeploy.serve.turbomind.deploy internlm-chat-7b /path/to/internlm-ch
#### 使用 turbomind 推理

```shell
docker run --gpus all --rm -v $(pwd)/workspace:/workspace -it openmmlab/lmdeploy:latest \
python3 -m lmdeploy.turbomind.chat /workspace
python3 -m lmdeploy.turbomind.chat ./workspace
```

```{note}
Expand Down
2 changes: 1 addition & 1 deletion lmdeploy/version.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# Copyright (c) OpenMMLab. All rights reserved.
from typing import Tuple

__version__ = '0.0.1'
__version__ = '0.0.2'
short_version = __version__


Expand Down

0 comments on commit 7e0b75b

Please sign in to comment.