Skip to content

Commit

Permalink
docs: fix typo in tritonserver_type parameter and code example (#4394)
Browse files Browse the repository at this point in the history
docs: fix typo in tritonserver_type parameter and address inconsistency in code example

1. There is a typo in tritonserver_type=''http' with double ' before http
2. for example "To get OUTPUT__1 as a JSON dictionary:", there is an inconsistency in the return line where it mentions OUTPUT_0, but it should be OUTPUT_1.
  • Loading branch information
ilyahabr authored Jan 11, 2024
1 parent 118be91 commit b954ee7
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions docs/source/integrations/triton.rst
Original file line number Diff line number Diff line change
Expand Up @@ -93,7 +93,7 @@ From a developer perspective, remote invocation of Triton runners is similar to

.. note::

By default, ``bentoml.triton.Runner`` will run the ``tritonserver`` with gRPC protocol. To use HTTP/REST protocol, provide ``tritonserver_type=''http'`` to the ``Runner`` constructor.
By default, ``bentoml.triton.Runner`` will run the ``tritonserver`` with gRPC protocol. To use HTTP/REST protocol, provide ``tritonserver_type='http'`` to the ``Runner`` constructor.

.. code-block:: python
Expand Down Expand Up @@ -255,15 +255,15 @@ There are a few things to note here:
.. code-block:: python
InferResult = triton_runner.torchscript_mnist.run(np.zeros((1, 28, 28)), np.zeros((1, 28, 28)))
return InferResult.get_output("OUTPUT__0", as_json=True)
return InferResult.get_output("OUTPUT__1", as_json=True)
.. tab-item:: HTTP
:sync: http

.. code-block:: python
InferResult = triton_runner.torchscript_mnist.run(np.zeros((1, 28, 28)), np.zeros((1, 28, 28)))
return InferResult.get_output("OUTPUT__0")
return InferResult.get_output("OUTPUT__1")
Additonally, the Triton runner exposes all `tritonclient <https://github.com/triton-inference-server/client>`_ functions.

Expand Down

0 comments on commit b954ee7

Please sign in to comment.