Feature Guide

Explore the capabilities of ai-lib-python

Core Features

⚡

Async Support

Full async/await support with httpx for non-blocking I/O operations

🔒

Type Safety

Pydantic v2 integration for runtime validation and IDE autocomplete

🔀

Model Routing

6 built-in routing strategies: round-robin, weighted, health-based, latency-based, cost-based, and custom

Enterprise Ready

🔄

Retry & Resilience

Automatic retry with exponential backoff, rate limiting, and circuit breaker

📊

Observability

OpenTelemetry ready with comprehensive metrics and tracing support

💾

Caching

Built-in caching support with pluggable cache backends

Integrations

📓

Jupyter Notebooks

Dedicated Jupyter integration for data science workflows

🚀

FastAPI

Perfect for building async AI-powered web services

🔬

ML Pipelines

Works seamlessly with pandas, numpy, and scikit-learn

Model Routing

6 built-in routing strategies to optimize for performance, cost, or reliability

Round Robin

Distribute requests equally across providers

Weighted

Route based on configured weights

Health-Based

Route to healthiest available provider

Latency-Based

Route to provider with lowest latency

Cost-Based

Route to lowest cost provider

Custom

Define your own routing logic

Your App

→

Router

→

Provider 1

Provider 2

Provider 3

Feature Parity

Rust SDK

100%

Python SDK

95%

Python SDK implements 95% of Rust SDK features, covering most production use cases.

Ready to Build?

Start using ai-lib-python in your project today

Quick Start Guide GitHub Repository