Code

Limit concurrent requests to 28000#19

Code

Open

Bslabe123 wants to merge 29 commits intomainAI-Hypercomputer/inference-benchmark:mainfrom

ephemeral-ports-fixAI-Hypercomputer/inference-benchmark:ephemeral-ports-fixCopy head branch name to clipboard

Commits

Commits on Mar 12, 2025

• first commit

  Bslabe123

  committed
  6725b70

  Copy full SHA for 6725b70

• refactor

  Bslabe123

  committed
  d976ec8

  Copy full SHA for d976ec8

Commits on Mar 26, 2025

• first commit

  Bslabe123

  committed
  f583747

  Copy full SHA for f583747

• revert

  Bslabe123

  committed
  945b76a

  Copy full SHA for 945b76a

• revert

  Bslabe123

  committed
  c3b40ca

  Copy full SHA for c3b40ca

Commits on Mar 27, 2025

• improper error handling

  Bslabe123

  committed
  3989da0

  Copy full SHA for 3989da0

• add comment

  Bslabe123

  committed
  5321440

  Copy full SHA for 5321440

• remove dummy call

  Bslabe123

  committed
  ed6e305

  Copy full SHA for ed6e305

• deduplicate flags

  Bslabe123

  committed
  20008f1

  Copy full SHA for 20008f1

• configurable sleep time

  Bslabe123

  committed
  1f65d63

  Copy full SHA for 1f65d63

• extra log

  Bslabe123

  committed
  614de11

  Copy full SHA for 614de11

• revert latency_throughput_curve.sh

  Bslabe123

  committed
  6a5196e

  Copy full SHA for 6a5196e

• more reversions

  Bslabe123

  committed
  099f730

  Copy full SHA for 099f730

• more reversions

  Bslabe123

  committed
  a319668

  Copy full SHA for a319668

• more reversions

  Bslabe123

  committed
  945cd1b

  Copy full SHA for 945cd1b

• more reversions

  Bslabe123

  committed
  87794d2

  Copy full SHA for 87794d2

• more reversions

  Bslabe123

  committed
  39fdba7

  Copy full SHA for 39fdba7

• log level debug -> info

  Bslabe123

  committed
  b1dbefb

  Copy full SHA for b1dbefb

• Merge branch 'main' into ephemeral-ports-fix

  Bslabe123

  authored
  d7caf8c

  Copy full SHA for d7caf8c

• remove log line

  Bslabe123

  committed
  817f172

  Copy full SHA for 817f172

• readd traceconfig

  Bslabe123

  committed
  67932bb

  Copy full SHA for 67932bb

• added active_connections_metric

  Bslabe123

  committed
  218b2d4

  Copy full SHA for 218b2d4

Commits on Mar 28, 2025

• revert ignore_eos

  Bslabe123

  committed
  b1beefa

  Copy full SHA for b1beefa

• added log

  Bslabe123

  committed
  08c2954

  Copy full SHA for 08c2954

• fix log

  Bslabe123

  committed
  bcf6cc7

  Copy full SHA for bcf6cc7

• fix comment

  Bslabe123

  committed
  be3a2d9

  Copy full SHA for be3a2d9

• remove comment

  Bslabe123

  committed
  927d366

  Copy full SHA for 927d366

• omit server metrics if connection limit reached

  Bslabe123

  committed
  53fa0e5

  Copy full SHA for 53fa0e5

• omit server metrics if connection limit reached

  Bslabe123

  committed
  fdf1024

  Copy full SHA for fdf1024