contenox
Browse docs/

Provider Blueprints

Cloud/hosted model providers plug into runtime/modelrepo behind the modelrepo.Provider interface; request-side selection happens in runtime/llmrepo. These docs cover provider-specific integration designs.

DocStatusWhat it covers
aws-bedrock.mdimplementedBedrock Converse API provider: dependency assessment, auth chain, codec fit
cloud-context-caching.mdblueprintMapping the backend-agnostic AssembleContext manifest onto native prompt/context caching APIs (Anthropic, Gemini/Vertex, OpenAI)

Esc to close