Skip to main content

Choose a Provider Upstream

A provider upstream is the model service AISIX AI Gateway calls after resolving a caller-facing model alias. AISIX stores the upstream credential in a provider key and uses an adapter to send requests in the format that the upstream expects.

Choose the setup path for the endpoint and account you use, not only for the model family. Configure Gemini through Google AI Studio when you have an AI Studio API key. Use Google Vertex AI when the model is hosted in a Google Cloud project.

Setup Paths

Choose among the direct provider and managed-platform setups:

SetupUse WhenAdapter
OpenAIYou call models through an OpenAI API account.openai
Azure OpenAIAn Azure OpenAI deployment hosts the model.azure-openai
AnthropicYou call Claude through the Anthropic API.anthropic
AWS BedrockAWS Bedrock hosts the model or inference profile.bedrock
Gemini (Google AI Studio)You call Gemini with a Google AI Studio API key.openai
Google Vertex AIA Google Cloud project hosts Gemini or another Vertex publisher model.vertex
Qwen (Alibaba Cloud)You call Qwen through Alibaba Cloud Model Studio.openai
DeepSeekYou call models through the DeepSeek API.openai
GroqYou call Groq-hosted models.openai
Mistral AIYou call models through the Mistral API.openai
Together AIYou call models from the Together AI catalog.openai

For another public or private endpoint that accepts OpenAI-compatible chat-completions requests, choose the corresponding general setup:

SetupUse WhenAdapter
Other OpenAI-Compatible ProvidersA public provider exposes an OpenAI-compatible API and does not have a dedicated setup guide.openai
Bring Your Own EndpointYou operate a private or self-hosted OpenAI-compatible endpoint such as vLLM, SGLang, or Ollama.openai

Each setup creates the same gateway resources: a provider key, a model alias, and a caller API key. The setup page provides the credential, upstream model identifier, and base URL shape for that path. Compare route support in Provider Compatibility, or review the upstream request formats in Adapter Protocol Families.