Extending the SDK
Add a new provider by implementing translation + transport mapping layers. High-level outline (adjust to actual trait names):
- Define capability & endpoint metadata (
ModelInfo
,ModelCapabilities
). - Implement a translator that converts
ChatCompletionRequest
-> provider HTTP payload. - Implement response parser mapping provider JSON -> unified
ChatCompletionResponse
(and chunks for streaming). - Register provider config (
ProviderConfigs
). - Add optional pricing / performance metadata for routing heuristics.
Planned docs: full code template & test harness for a mock provider.