Code

Custom samplingconfig addition#2633

Code

Open

buddhapuneeth wants to merge 48 commits intoNVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom buddhapuneeth:custom-samplingconfibuddhapuneeth/TensorRT-LLM:custom-samplingconfiCopy head branch name to clipboard

+12,869,294-1,906,429

Commits

Commits on Oct 15, 2023

• Updates for release/0.5.0

  juney-nvidia

  committed
  dcd773e

  Copy full SHA for dcd773e

Commits on Oct 18, 2023

• refresh 0.5.0 release branch with the latest revision

  juney-nvidia

  committed
  6b32b40

  Copy full SHA for 6b32b40

• Fix memory leak in falcon weight loader (NVIDIA#8)

  kaiyux

  authored
  b4af28c

  Copy full SHA for b4af28c

Commits on Oct 19, 2023

• update aarch64 batch manager libraries to release/0.5.0 (NVIDIA#10)

  

  Shixiaowei02

  authored and

  juney-nvidia

  committed
  4926a92

  Copy full SHA for 4926a92

• Minor doc updates

  juney-nvidia

  committed
  a42dc2b

  Copy full SHA for a42dc2b

• add git-lfs dependency for binaries (NVIDIA#11)

  Show description for 395f850
  

  Shixiaowei02

  authored and

  juney-nvidia

  committed
  395f850

  Copy full SHA for 395f850

• revise the homepage (NVIDIA#14)

  Show description for ffd5af3
  

  Shixiaowei02

  authored and

  juney-nvidia

  committed
  ffd5af3

  Copy full SHA for ffd5af3

• Fix the link to the documentation (NVIDIA#15)

  Show description for 84fd0dd
  

  jdemouth

  and

  jdemouth-nvidia

  authored
  84fd0dd

  Copy full SHA for 84fd0dd

Commits on Oct 20, 2023

• Fix small doc issue (NVIDIA#19)

  juney-nvidia

  authored
  9a5da6d

  Copy full SHA for 9a5da6d

• Fix two deadlinks in README.md (NVIDIA#21)

  Show description for 7295ce2
  wangkuiyi

  authored
  7295ce2

  Copy full SHA for 7295ce2

• Update docs/source/batch_manager.md (NVIDIA#40)

  kaiyux

  authored
  26f797c

  Copy full SHA for 26f797c

Commits on Oct 22, 2023

• Update windows related documentation (NVIDIA#59)

  juney-nvidia

  authored
  1c4a0ee

  Copy full SHA for 1c4a0ee

Commits on Oct 25, 2023

• fix doc typo. (NVIDIA#114)

  Show description for d0b56df
  

  nv-guomingz

  and

  Guoming Zhang

  authored
  d0b56df

  Copy full SHA for d0b56df

Commits on Oct 27, 2023

• update the batch manager (NVIDIA#152)

  Shixiaowei02

  authored
  11e1450

  Copy full SHA for 11e1450

Commits on Nov 2, 2023

• Add batch manager lib (NVIDIA#221)

  sestephens-nv

  authored
  f84d5fe

  Copy full SHA for f84d5fe

• patch for commit f84d5fe (NVIDIA#245)

  Shixiaowei02

  authored
  d8ebeee

  Copy full SHA for d8ebeee

Commits on Nov 8, 2023

• build: Update Windows torch versions (NVIDIA#309)

  sestephens-nv

  authored
  93174ab

  Copy full SHA for 93174ab

• Add Latest News section (NVIDIA#314)

  Shixiaowei02

  authored
  71a5b97

  Copy full SHA for 71a5b97

Commits on Nov 13, 2023

• Add Latest News section (NVIDIA#361)

  Shixiaowei02

  authored
  1f3a421

  Copy full SHA for 1f3a421

• Add Latest News section (NVIDIA#366)

  Shixiaowei02

  authored
  7ce7e1d

  Copy full SHA for 7ce7e1d

• Add Latest News section (NVIDIA#368)

  Shixiaowei02

  authored
  73a9ee4

  Copy full SHA for 73a9ee4

Commits on Nov 14, 2023

• Update the latest news (NVIDIA#379)

  kaiyux

  authored
  6837c81

  Copy full SHA for 6837c81

Commits on Nov 27, 2023

• Fix an issue of mpi4py (NVIDIA#475)

  Shixiaowei02

  authored
  a21e2f8

  Copy full SHA for a21e2f8

Commits on Nov 30, 2023

• Update TensorRT-LLM (NVIDIA#506)

  Show description for 587d063
  

  kaiyux

  and

  Shixiaowei02

  authored
  587d063

  Copy full SHA for 587d063

Commits on Dec 1, 2023

• update aarch64 libraries (NVIDIA#525)

  Shixiaowei02

  authored
  119e216

  Copy full SHA for 119e216

Commits on Dec 4, 2023

• Update TensorRT-LLM (NVIDIA#539)

  Show description for 8dd9c91
  

  kaiyux

  and

  Shixiaowei02

  authored
  8dd9c91

  Copy full SHA for 8dd9c91

• Update TensorRT-LLM (NVIDIA#546)

  Shixiaowei02

  authored
  9b3e12d

  Copy full SHA for 9b3e12d

• Update badge (NVIDIA#552)

  kaiyux

  authored
  b40cfac

  Copy full SHA for b40cfac

Commits on Dec 6, 2023

• Add batch manager static lib for Windows (NVIDIA#569)

  Show description for 0268914
  sestephens-nv

  authored
  0268914

  Copy full SHA for 0268914

Commits on Dec 20, 2023

• Update TensorRT-LLM (NVIDIA#708)

  Show description for 59f41c0
  Shixiaowei02

  authored
  59f41c0

  Copy full SHA for 59f41c0

Commits on Dec 22, 2023

• Fix a docker build error (NVIDIA#719)

  Shixiaowei02

  authored
  a8018c1

  Copy full SHA for a8018c1

Commits on Dec 26, 2023

• Update TensorRT-LLM Release branch (NVIDIA#745)

  Show description for 80bc075
  

  kaiyux

  and

  Shixiaowei02

  authored
  80bc075

  Copy full SHA for 80bc075

Commits on Jan 5, 2024

• Add batch manager static lib for Windows (NVIDIA#814)

  sestephens-nv

  authored
  2f169d1

  Copy full SHA for 2f169d1

Commits on Feb 29, 2024

• Update TensorRT-LLM Release branch (NVIDIA#1192)

  Show description for 5955b8a
  

  kaiyux

  and

  Shixiaowei02

  authored
  5955b8a

  Copy full SHA for 5955b8a

Commits on Mar 1, 2024

• Add 0.8 batch manager static lib for Windows (NVIDIA#1202)

  Show description for 37aee91
  tp5uiuc

  authored
  37aee91

  Copy full SHA for 37aee91

Commits on Apr 12, 2024

• Update TensorRT-LLM Release branch (NVIDIA#1445)

  Show description for 250d9c2
  

  5 peopleauthored
  250d9c2

  Copy full SHA for 250d9c2

Commits on Apr 17, 2024

• Update documents for release 0.9 (NVIDIA#1461)

  Shixiaowei02

  authored
  6533c4e

  Copy full SHA for 6533c4e

• Fix document (NVIDIA#1462)

  kaiyux

  authored
  a9356d4

  Copy full SHA for a9356d4

Commits on Jun 5, 2024

• TensorRT-LLM v0.10 update

  Show description for 9bd15f1
  

  3 peopleauthored
  9bd15f1

  Copy full SHA for 9bd15f1

Commits on Jul 17, 2024

• TensorRT-LLM v0.11 Update (NVIDIA#1969)

  kaiyux

  authored
  05316d3

  Copy full SHA for 05316d3

Commits on Jul 18, 2024

• fix : v0.11 windows docs (NVIDIA#1975)

  Show description for ab49b93
  tp5uiuc

  authored
  ab49b93

  Copy full SHA for ab49b93

Commits on Aug 29, 2024

• TensorRT-LLM v0.12 Update (NVIDIA#2164)

  Shixiaowei02

  authored
  bfc50a7

  Copy full SHA for bfc50a7

• Add Windows library for release 0.12 (NVIDIA#2165)

  Shixiaowei02

  authored
  28fb9aa

  Copy full SHA for 28fb9aa

Commits on Sep 30, 2024

• TensorRT-LLM v0.13 Update (NVIDIA#2269)

  Shixiaowei02

  authored
  201135e

  Copy full SHA for 201135e

• Add the known issue to windows installation guide (NVIDIA#2275)

  pamelap-nvidia

  authored
  9078696

  Copy full SHA for 9078696

Commits on Nov 1, 2024

• Update TensorRT-LLM v0.14.0 (NVIDIA#2401)

  kaiyux

  authored
  b088016

  Copy full SHA for b088016

Commits on Dec 4, 2024

• TensorRT-LLM Release 0.15.0 (NVIDIA#2529)

  Show description for 8f91cff
  

  Shixiaowei02

  and

  kaiyux

  authored
  8f91cff

  Copy full SHA for 8f91cff

Commits on Dec 27, 2024

• custom changes to add a new sampling config 'custom'

  

  EC2 Default User

  committed
  713c01c

  Copy full SHA for 713c01c