Extending the SDK
Add a new provider by implementing translation + transport mapping layers. High-level outline (adjust to actual trait names):
- Define capability & endpoint metadata (
ModelInfo,ModelCapabilities). - Implement a translator that converts
ChatCompletionRequest-> provider HTTP payload. - Implement response parser mapping provider JSON -> unified
ChatCompletionResponse(and chunks for streaming). - Register provider config (
ProviderConfigs). - Add optional pricing / performance metadata for routing heuristics.
Planned docs: full code template & test harness for a mock provider.