Introduction

ai-lib is a production-grade Rust crate providing a unified, reliability-focused multi‑provider AI SDK. It eliminates the complexity of integrating with multiple AI providers by offering a single, consistent interface.

Announcement: v0.3.0 released — unified transport & SSE, routing MVP (ModelArray + health checks + routing metrics), and interceptor examples. See routing guide and observability docs for details.

Goals

• Reduce integration cost across 17+ AI providers
• Improve success rate & tail latency via built-in reliability primitives
• Offer consistent streaming & function calling semantics across all providers
• Remain vendor-neutral and extensible with pluggable transport and metrics

Key Features

• Unified API for chat completions across all supported providers
• Streaming support with consistent delta handling (SSE + emulated fallback)
• Function calling with normalized tool schemas and policies
• Multimodal content support (text, images, audio) where providers support it
• Reliability primitives: retry with exponential backoff, circuit breaker, rate limiting
• Model management: performance-based selection, load balancing, health monitoring
• Batch processing with configurable concurrency limits
• Observability hooks for custom metrics and monitoring integration
• Progressive configuration from environment variables to explicit builder patterns

Supported Providers

ai-lib supports 17+ AI providers including OpenAI, Groq, Anthropic, Gemini, Mistral, Cohere, Azure OpenAI, Ollama, DeepSeek, Qwen, Baidu Wenxin, Tencent Hunyuan, iFlytek Spark, Moonshot Kimi, HuggingFace, TogetherAI, and xAI Grok.

Quick Start

use ai_lib::{AiClient, Provider, Message, Role, Content, ChatCompletionRequest};

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    let client = AiClient::new(Provider::Groq)?;
    let req = ChatCompletionRequest::new(
        client.default_chat_model(),
        vec![Message::user(Content::new_text("Hello, world!"))]
    );
    let resp = client.chat_completion(req).await?;
    println!("Answer: {}", resp.first_text()?);
    Ok(())
}

Next: Read Getting Started then explore Advanced Examples.