For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

LLM (OpenAI)

Route requests to OpenAI’s chat completions API with the agentgateway binary.

Configure the agentgateway binary to route requests to the OpenAI chat completions API.

Before you begin

1. Install the agentgateway binary.

   LatestSpecific versionNightly build

   To install the latest release:

   curl -sL https://agentgateway.dev/install | bash

   To install a specific version, pass the --version flag. Use any release tag from the agentgateway releases page, such as ``.

   curl -sL https://agentgateway.dev/install | bash -s -- --version 

   To install the nightly build for development and testing:

   1. Go to the nightly release in GitHub Actions and click the release that you want to use.

   2. From the URL, get the release number, such as 24873456345 in https://github.com/agentgateway/agentgateway/actions/runs/24873456345.

   3. Using the gh CLI, download the release for your OS. The following example uses macOS.

      gh run download 24873456345 -R agentgateway/agentgateway -n release-binary-mac

   4. Make the binary file executable and move it to your binary location, such as in the following example.

      chmod +x agentgateway
      sudo mv agentgateway /usr/local/bin/agentgateway

   5. Verify that you have the nightly release.

      agentgateway --version

      Example output:

      {
        "version": "0.0.0-alpha.813d7d0",
        "git_revision": "813d7d0ab4757db7c8ed5a639bc63c0bb20ac116",
        "rust_version": "1.95.0",
        "build_profile": "release",
        "build_target": "aarch64-apple-darwin"
      }

2. Get an OpenAI API key.

Steps

Route to an OpenAI backend through agentgateway.

Next steps

Check out more guides related to LLM consumption with agentgateway.