Skip to main content

Parameters

See plugin common configurations for configuration options available to all plugins.

  • templates

    array[object]

    required


    An array of templates.

    • name

      string

      required


      Name of the template. When requesting the route, the request should include the template name that corresponds to the configured template.

    • template

      object

      required


      Template specification.

      • model

        string


        Name of the LLM model, such as gpt-4 or gpt-3.5. See your LLM provider API documentation for more available models.

      • messages

        array[object]


        Template message specification.

        • role

          string

          required

          vaild vaule:

          system, user, or assistant


          Role of the message.

        • content

          string

          required


          Content of the message (prompt).

  • max_req_body_size

    integer

    default: 67108864


    Maximum request body size in bytes buffered into memory. Larger request bodies are rejected. Available in API7 Enterprise from version 3.9.17 on the 3.9 line and from version 3.10.4 on the 3.10 line.