Skip to main content

Choose a Provider Upstream

A provider upstream is the model service AISIX AI Gateway calls after resolving a caller-facing model alias.

When you configure the upstream side of the request path, choose how AISIX should talk to the model service. The main decision is the upstream API format: an OpenAI-compatible API, AWS Bedrock, Google Vertex AI, or Azure OpenAI.

Setup Paths

Choose the adapter that matches the upstream API format, not the provider's business category.

Upstream API FormatExamplesSetup GuideAdapter
Public OpenAI-compatible vendorDeepSeek, Groq, Mistral, Together.ai, Fireworks, PerplexityOpenAI-Compatible Vendor Upstreamopenai
Private OpenAI-compatible endpointvLLM, SGLang, Ollama, private model proxyBring Your Own Endpointopenai
AWS Bedrock native APIBedrock foundation models or inference profilesAWS Bedrock Upstreambedrock
Google Vertex AI native APIVertex publisher modelsGoogle Vertex AI Upstreamvertex
Azure OpenAI APIAzure OpenAI deploymentsAzure OpenAI Upstreamazure-openai

Each setup guide creates the same gateway resources: a provider key, a model alias, and a caller API key. The provider-specific guide explains which credential, upstream model identifier, and base URL shape that provider family expects.

After configuring the provider key, model, and caller API key, send one proxy request through AISIX. Confirm that the response uses the caller-facing model alias.

API7.ai Logo

The digital world is connected by APIs,
API7.ai exists to make APIs more efficient, reliable, and secure.

Sign up for API7 newsletter

Product

API7 Gateway

SOC2 Type IIISO 27001HIPAAGDPRRed Herring

Copyright © APISEVEN PTE. LTD 2019 – 2026. Apache, Apache APISIX, APISIX, and associated open source project names are trademarks of the Apache Software Foundation