​
Backends Overview

This section provides an overview of the modules within this directory.
  • cache - Caching strategies.
  • dummy - This module holds shim backends used for smoke tests.
  • formatter - Abstract interfaces for Formatters.
  • huggingface - A backend that uses the Huggingface Transformers library.
  • model_ids - Utilities for model identifiers.
  • ollama - A model backend wrapping the Ollama Python SDK.
  • openai - A generic OpenAI compatible backend that wraps around the openai python sdk.
  • tools - Utilities for dealing with tools.
  • types - Useful type definitions for models, formatters, and backends.
  • watsonx - A generic WatsonX.ai compatible backend that wraps around the watson_machine_learning library.