Skip to content
Skillpedia
Connectors (MCP)40k · #5000

arize-ai-provider-integration

Lets your agent manage integrations with LLM providers on the Arize AI platform. It's useful for setting up credentials and managing connections for model evaluation.

What it does

This tool lets you manage connections to AI services like OpenAI or Google Gemini. You can create, view, change, or remove these connections, which store the necessary access information for other parts of Arize AI to work.

When to use it

  • ✓When you need to connect Arize AI to a specific AI service.
  • ✓To add or remove access credentials for an AI service.
  • ✓To check which AI services are connected to Arize AI.

Example of what to ask your AI

“I want to connect OpenAI to Arize AI using my API key.”

Want more? Open the sections below.

How to use

The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.

Skill link

https://github.com/github/awesome-copilot/blob/main/skills/arize-ai-provider-integration/SKILL.md

Ready-to-paste message

Use this skill to help me: https://github.com/github/awesome-copilot/blob/main/skills/arize-ai-provider-integration/SKILL.md Read the SKILL.md file at that link and follow its instructions for my task.
How it works

You use specific commands to tell Arize AI how to connect to an AI service. This involves providing the service name, a name for the connection, and access details like an API key.

Installation

Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.

In the terminal (Claude Code, Codex, Cursor), in your project folder:

npx skills add github/awesome-copilot --skill arize-ai-provider-integration

Or download just the file:

curl -L https://raw.githubusercontent.com/github/awesome-copilot/main/skills/arize-ai-provider-integration/SKILL.md -o SKILL.md
Technical content (original SKILL.md)

Original text by the author, straight from GitHub.

Arize AI Integration Skill

SPACE — Most --space flags and the ARIZE_SPACE env var accept a space name (e.g., my-workspace) or a base64 space ID (e.g., U3BhY2U6...). Find yours with ax spaces list. Note: ai-integrations create does not accept --space — AI integrations are account-scoped. Use --space only with list, get, update, and delete.

Concepts

  • AI Integration = stored LLM provider credentials registered in Arize; used by evaluators to call a judge model and by other Arize features that need to invoke an LLM on your behalf
  • Provider = the LLM service backing the integration (e.g., openAI, anthropic, awsBedrock)
  • Integration ID = a base64-encoded global identifier for an integration (e.g., TGxtSW50ZWdyYXRpb246MTI6YUJjRA==); required for evaluator creation and other downstream operations
  • Scoping = visibility rules controlling which spaces or users can use an integration
  • Auth type = how Arize authenticates with the provider: default (provider API key), proxy_with_headers (proxy via custom headers), or bearer_token (bearer token auth)

Prerequisites

Proceed directly with the task — run the ax command you need. Do NOT check versions, env vars, or profiles upfront.

If an ax command fails, troubleshoot based on the error:

  • command not found or version error → see references/ax-setup.md
  • 401 Unauthorized / missing API key → run ax profiles show to inspect the current profile. If the profile is missing or the API key is wrong, follow references/ax-profiles.md to create/update it. If the user doesn't have their key, direct them to https://app.arize.com/admin > API Keys
  • Space unknown → run ax spaces list to pick by name, or ask the user
  • LLM provider call fails (missing OPENAI_API_KEY / ANTHROPIC_API_KEY) → run ax ai-integrations list --space SPACE to check for platform-managed credentials. If none exist, ask the user to provide the key or create an integration via the arize-ai-provider-integration skill
  • Security: Never read .env files or search the filesystem for credentials. Use ax profiles for Arize credentials and ax ai-integrations for LLM provider keys. If credentials are not available through these channels, ask the user.

List AI Integrations

List all integrations accessible in a space:

ax ai-integrations list --space SPACE

Filter by name (case-insensitive substring match):

ax ai-integrations list --space SPACE --name "openai"

Paginate large result sets:

# Get first page
ax ai-integrations list --space SPACE --limit 20 -o json

# Get next page using cursor from previous response
ax ai-integrations list --space SPACE --limit 20 --cursor CURSOR_TOKEN -o json

Key flags:

Flag Description
--space Space name or ID to filter integrations
--name Case-insensitive substring filter on integration name
--limit Max results (1–100, default 15)
--cursor Pagination token from a previous response
-o, --output Output format: table (default) or json

Response fields:

Field Description
id Base64 integration ID — copy this for downstream commands
name Human-readable name
provider LLM provider enum (see Supported Providers below)
has_api_key true if credentials are stored
model_names Allowed model list, or null if all models are enabled
enable_default_models Whether default models for this provider are allowed
function_calling_enabled Whether tool/function calling is enabled
auth_type Authentication method: default, proxy_with_headers, or bearer_token

Get a Specific Integration

ax ai-integrations get NAME_OR_ID
ax ai-integrations get NAME_OR_ID -o json
ax ai-integrations get NAME_OR_ID --space SPACE   # required when using name instead of ID

Use this to inspect an integration's full configuration or to confirm its ID after creation.


Create an AI Integration

Before creating, always list integrations first — the user may already have a suitable one:

ax ai-integrations list --space SPACE

If no suitable integration exists, create one. The required flags depend on the provider.

OpenAI

ax ai-integrations create \
  --name "My OpenAI Integration" \
  --provider openAI \
  --api-key $OPENAI_API_KEY

…

FAQ

What are 'LLM provider credentials'?

These are the login details (like API keys) that an AI service, such as OpenAI, uses to verify who is trying to connect and allow access.

What is an 'Integration ID'?

It's a unique code that identifies each connection you create between Arize AI and an AI service. It's like a registration number for the connection.

Can I connect any AI service?

Yes, the tool supports many popular providers like OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, and NVIDIA NIM, as well as OpenAI-compatible endpoints.

Details

Original description by the author

Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and other Arize features. Supports any LLM provider (e.g. OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, NVIDIA NIM). Use when the user mentions AI integration, LLM provider credentials, create integration, list integrations, update credentials, delete integration, or

repo: github/awesome-copilot

Popularity

GitHub stars
40k
Ranking position
#5000
License
MIT
Updated
10/15/2026

Is this skill useful?

0

Sign in to vote.

Comments

  • …

More skills from this repository

Similar skills