From 8d96270189718e3218cbd46be425bd14e9ed8a7c Mon Sep 17 00:00:00 2001 From: QuentinN42 Date: Fri, 11 Dec 2020 00:30:25 +0100 Subject: [PATCH 1/3] requitements.txt added --- requirements.txt | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 requirements.txt diff --git a/requirements.txt b/requirements.txt new file mode 100644 index 00000000..202ee566 --- /dev/null +++ b/requirements.txt @@ -0,0 +1,9 @@ +NumPy +torch +fastBPE +Moses +Apex +libclang +submitit +six +sacrebleu==1.2.11 From 5cb1305311ceb7bf1d01d3c1fc2fd66d335a7689 Mon Sep 17 00:00:00 2001 From: QuentinN42 Date: Fri, 11 Dec 2020 01:25:34 +0100 Subject: [PATCH 2/3] versions in requirement.txt --- requirements.txt | 17 +++++++++-------- 1 file changed, 9 insertions(+), 8 deletions(-) diff --git a/requirements.txt b/requirements.txt index 202ee566..f76a2c1e 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1,9 +1,10 @@ -NumPy -torch -fastBPE -Moses -Apex -libclang -submitit -six +numpy==1.19.4 +Cython==0.29.21 +torch==1.7.1 +fastBPE==0.1.0 +moses==0.10.0 +apex==0.9.10.dev0 +libclang==10.0.1.0 +submitit==1.1.5 +six==1.15.0 sacrebleu==1.2.11 From 30f361a4b64cee03f419a1ef83da30c7241054bc Mon Sep 17 00:00:00 2001 From: QuentinN42 Date: Fri, 11 Dec 2020 01:27:05 +0100 Subject: [PATCH 3/3] pip install added in readme --- README.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 2f2435ec..0cf03ea9 100755 --- a/README.md +++ b/README.md @@ -14,7 +14,12 @@ Pytorch original implementation of TransCoder in [Unsupervised Translation of Pr - [submitit](https://pypi.org/project/submitit/) (to run the preprocessing pipeline on remote machine) - [six](https://pypi.org/project/six/) - [sacrebleu](https://pypi.org/project/sacrebleu/) (`pip install sacrebleu=="1.2.11"`) - + +All this dependencies can be installed using : +``` +$ pip install -r requirement.txt +``` + If your `libclang.so` is not in `/usr/lib/llvm-7/lib/`, replace the path to `libclang.so` to the correct path in `clang.cindex.Config.set_library_path('path_to_libclang')` in `code_tokenizer.py` If you run the data preprocessing pipeline, you will have to compile fastBPE. Go in XLM/tools/fastBPE and carry out the steps described in the [ReadMe](https://github.com/facebookresearch/TransCoder/blob/master/XLM/tools/README.md).