Code

Add CI/CD for unit tests#41

Code

Merged

xrsrke merged 107 commits intomainhuggingface/nanotron:mainfrom xrsrke/setup_cicdhuggingface/nanotron:xrsrke/setup_cicdCopy head branch name to clipboardFeb 16, 2024

Commits

Commits on Jan 19, 2024

• add CI/CD for unit tests

  xrsrke

  committed
  1c79951

  Copy full SHA for 1c79951

• fix

  xrsrke

  committed
  04491d3

  Copy full SHA for 04491d3

• fix syntax

  xrsrke

  committed
  fdd5d1e

  Copy full SHA for fdd5d1e

• fix

  xrsrke

  committed
  91208dd

  Copy full SHA for 91208dd

• fix

  xrsrke

  committed
  8da087d

  Copy full SHA for 8da087d

• update actions/checkout

  xrsrke

  committed
  00875c0

  Copy full SHA for 00875c0

• new runner label

  glegendre01

  authored
  cca7e56

  Copy full SHA for cca7e56

• fix typo

  glegendre01

  authored
  338c042

  Copy full SHA for 338c042

• add workflow dispatch

  glegendre01

  authored
  0c6433c

  Copy full SHA for 0c6433c

• remove path filter for triggering

  glegendre01

  authored
  6de2472

  Copy full SHA for 6de2472

Commits on Jan 23, 2024

• test ci

  xrsrke

  committed
  79b22d8

  Copy full SHA for 79b22d8

• update python version

  xrsrke

  committed
  c73623b

  Copy full SHA for c73623b

• add code quality

  xrsrke

  committed
  5efc135

  Copy full SHA for 5efc135

• refactor

  xrsrke

  committed
  4fb80a4

  Copy full SHA for 4fb80a4

• only check src

  xrsrke

  committed
  ceb21c2

  Copy full SHA for ceb21c2

• fix

  xrsrke

  committed
  05aa557

  Copy full SHA for 05aa557

• use docker image

  xrsrke

  committed
  0010cfa

  Copy full SHA for 0010cfa

• fix

  xrsrke

  committed
  dba1eed

  Copy full SHA for dba1eed

• use python 10

  xrsrke

  committed
  b2af5d0

  Copy full SHA for b2af5d0

Commits on Jan 24, 2024

• change docker image

  xrsrke

  committed
  8914de7

  Copy full SHA for 8914de7

• fix pip install

  xrsrke

  committed
  368beba

  Copy full SHA for 368beba

• add fa2-related tests

  xrsrke

  committed
  565e081

  Copy full SHA for 565e081

• fix

  xrsrke

  committed
  7b38326

  Copy full SHA for 7b38326

• update FA2 version

  xrsrke

  committed
  906477b

  Copy full SHA for 906477b

• add on push

  xrsrke

  committed
  4491ce7

  Copy full SHA for 4491ce7

• update FA2 to flash-attn>=2.5.0

  xrsrke

  committed
  5b22ede

  Copy full SHA for 5b22ede

Commits on Jan 29, 2024

• Merge branch 'main' of github.com:huggingface/nanotron into xrsrke/setup_cicd

  xrsrke

  committed
  5f3ce67

  Copy full SHA for 5f3ce67

• add searching for free ports in unit tests

  xrsrke

  committed
  9a03a04

  Copy full SHA for 9a03a04

• remove searching port

  xrsrke

  committed
  1cf4da2

  Copy full SHA for 1cf4da2

• move searching ports to distributed

  xrsrke

  committed
  f6d9847

  Copy full SHA for f6d9847

• Update 3d_parallelism_unit_tests.yaml

  xrsrke

  authored
  f675daf

  Copy full SHA for f675daf

• Update 3d_parallelism_unit_tests.yaml

  xrsrke

  authored
  0908b74

  Copy full SHA for 0908b74

• Update distributed.py

  xrsrke

  authored
  df7cb9d

  Copy full SHA for df7cb9d

• Update 3d_parallelism_unit_tests.yaml

  xrsrke

  authored
  839677a

  Copy full SHA for 839677a

Commits on Jan 30, 2024

• Update 3d_parallelism_unit_tests.yaml

  xrsrke

  authored
  b631186

  Copy full SHA for b631186

• Update distributed.py

  xrsrke

  authored
  128eea5

  Copy full SHA for 128eea5

Commits on Jan 31, 2024

• Refactor test_clip_grads_with_tp parameters

  NouamaneTazi

  committed
  f96808a

  Copy full SHA for f96808a

• Skip test cases for ALL_REDUCE mode with async communication

  NouamaneTazi

  committed
  d123d1b

  Copy full SHA for d123d1b

• Update init_method to use env://localhost:port

  NouamaneTazi

  committed
  b899564

  Copy full SHA for b899564

• tests run for all PRs

  NouamaneTazi

  committed
  ff32ddb

  Copy full SHA for ff32ddb

• Update branch filter in GitHub workflows

  NouamaneTazi

  committed
  abe42c6

  Copy full SHA for abe42c6

• skip ALL_REDUCE with async comm

  NouamaneTazi

  committed
  0a754a1

  Copy full SHA for 0a754a1

• make sure total_norm in clip grad is a scalar

  NouamaneTazi

  committed
  5d822bb

  Copy full SHA for 5d822bb

• Merge branch 'main' of github.com:huggingface/nanotron into xrsrke/setup_cicd

  xrsrke

  committed
  e5e2045

  Copy full SHA for e5e2045

• refactor

  xrsrke

  committed
  5d9652a

  Copy full SHA for 5d9652a

Commits on Feb 1, 2024

• zeros([]

  NouamaneTazi

  committed
  063020a

  Copy full SHA for 063020a

• Merge pull request #52 from huggingface/nouamane/fix_ci

  Show description for 741966b
  NouamaneTazi

  authored
  741966b

  Copy full SHA for 741966b

• exclude sanity_checks.py from CoL

  xrsrke

  committed
  e2ed85f

  Copy full SHA for e2ed85f

• exclude sanity_checks.py from CoL

  xrsrke

  committed
  91234fa

  Copy full SHA for 91234fa

Commits on Feb 10, 2024

• Merge branch 'main' of github.com:huggingface/nanotron into xrsrke/setup_cicd

  xrsrke

  committed
  a57cb9b

  Copy full SHA for a57cb9b

• fix expectation

  xrsrke

  committed
  8a98cfc

  Copy full SHA for 8a98cfc

• remove empty context manager in tp tests

  xrsrke

  committed
  29672db

  Copy full SHA for 29672db

• add reruning a tests if a port is in used

  xrsrke

  committed
  0a34e65

  Copy full SHA for 0a34e65

• fix checking total_norm should be a scalar

  xrsrke

  committed
  e3c3d11

  Copy full SHA for e3c3d11

• fix

  xrsrke

  committed
  63ca0d2

  Copy full SHA for 63ca0d2

• add more retrying

  xrsrke

  committed
  44c0e05

  Copy full SHA for 44c0e05

• fix clip grads

  xrsrke

  committed
  b8eeb1e

  Copy full SHA for b8eeb1e

• remove testing dim in clip grads

  xrsrke

  committed
  b553c4e

  Copy full SHA for b553c4e

• fuk

  xrsrke

  committed
  0b97c38

  Copy full SHA for 0b97c38

• refactor

  xrsrke

  committed
  8c7355e

  Copy full SHA for 8c7355e

• run tests in parallel

  xrsrke

  committed
  2a4e735

  Copy full SHA for 2a4e735

• not run fa2

  xrsrke

  committed
  d47555e

  Copy full SHA for d47555e

• only run 5 tests in parallel

  xrsrke

  committed
  3b70271

  Copy full SHA for 3b70271

• only run a test at a time

  xrsrke

  committed
  30b8004

  Copy full SHA for 30b8004

• add forking RNG

  xrsrke

  committed
  51a804c

  Copy full SHA for 51a804c

• fix circular import

  xrsrke

  committed
  cec0c04

  Copy full SHA for cec0c04

• fix rng

  xrsrke

  committed
  f42a43e

  Copy full SHA for f42a43e

• remove parallel tests

  xrsrke

  committed
  5b375f5

  Copy full SHA for 5b375f5

Commits on Feb 11, 2024

• add python random seed

  xrsrke

  committed
  081b17d

  Copy full SHA for 081b17d

• remove dist test, and add destroying process group after running a test

  xrsrke

  committed
  4dce881

  Copy full SHA for 4dce881

• fix

  xrsrke

  committed
  00bb0bf

  Copy full SHA for 00bb0bf

• edit

  xrsrke

  committed
  957826e

  Copy full SHA for 957826e

• fix

  xrsrke

  committed
  dc65581

  Copy full SHA for dc65581

• fix

  xrsrke

  committed
  0fe7bdd

  Copy full SHA for 0fe7bdd

• removing destroy pg

  xrsrke

  committed
  de52fc6

  Copy full SHA for de52fc6

• add destroying parallel_context in unit tests

  xrsrke

  committed
  f2afea3

  Copy full SHA for f2afea3

• ignore layer norm

  xrsrke

  committed
  97ebff4

  Copy full SHA for 97ebff4

• wtf is going on

  xrsrke

  committed
  6a5fd81

  Copy full SHA for 6a5fd81

Commits on Feb 13, 2024

• add small run

  xrsrke

  committed
  9c7e1a7

  Copy full SHA for 9c7e1a7

• run small with dist test

  xrsrke

  committed
  b2c71b0

  Copy full SHA for b2c71b0

• debug missing destroy

  xrsrke

  committed
  0d21bba

  Copy full SHA for 0d21bba

• fuck

  xrsrke

  committed
  6bb69ff

  Copy full SHA for 6bb69ff

• f

  xrsrke

  committed
  b39c831

  Copy full SHA for b39c831

• .

  NouamaneTazi

  committed
  3bd346d

  Copy full SHA for 3bd346d

• .

  NouamaneTazi

  committed
  dd0079e

  Copy full SHA for dd0079e

• try timeout-minutes and --rm

  NouamaneTazi

  committed
  91cf7e3

  Copy full SHA for 91cf7e3

• try -v

  NouamaneTazi

  committed
  7e0fcce

  Copy full SHA for 7e0fcce

• try

  NouamaneTazi

  committed
  6dcb73d

  Copy full SHA for 6dcb73d

• bring back parallel_context.destroy()

  NouamaneTazi

  committed
  b64f04f

  Copy full SHA for b64f04f

Commits on Feb 14, 2024

• add 3d tests

  xrsrke

  committed
  2d44ec7

  Copy full SHA for 2d44ec7

• add all cicd

  xrsrke

  committed
  5d03579

  Copy full SHA for 5d03579

• run parallel tests

  xrsrke

  committed
  ab09576

  Copy full SHA for ab09576

• only run 1 test

  xrsrke

  committed
  77e0764

  Copy full SHA for 77e0764

Commits on Feb 15, 2024

• add directly spawning processes

  xrsrke

  committed
  f43687f

  Copy full SHA for f43687f

• refactor spawn function as init_distributed

  xrsrke

  committed
  004e7f4

  Copy full SHA for 004e7f4

• please work

  xrsrke

  committed
  558b341

  Copy full SHA for 558b341

• catch overlaping port from find_free_port

  xrsrke

  committed
  98046f8

  Copy full SHA for 98046f8

• clean up

  xrsrke

  committed
  d96c7fa

  Copy full SHA for d96c7fa

• fix circular import

  xrsrke

  committed
  f56f8a7

  Copy full SHA for f56f8a7

• skip fp8 tests in FA2

  xrsrke

  committed
  a48b7bf

  Copy full SHA for a48b7bf

• update code quality

  xrsrke

  committed
  033aca9

  Copy full SHA for 033aca9

• fix

  xrsrke

  committed
  d4c27e7

  Copy full SHA for d4c27e7

• fix

  xrsrke

  committed
  39e5846

  Copy full SHA for 39e5846

• remove uncessary files

  xrsrke

  committed
  6f7e4b2

  Copy full SHA for 6f7e4b2

• fix search free poorts

  xrsrke

  committed
  cd51bd9

  Copy full SHA for cd51bd9

Commits on Feb 16, 2024

• set ParallelContext in wrapper

  xrsrke

  committed
  6c30d2c

  Copy full SHA for 6c30d2c

• remove uncessary comments

  xrsrke

  committed
  c705f4d

  Copy full SHA for c705f4d