fireworks_client¶

Classes

FireworksClient([api_key, ...])

A component wrapper for Fireworks AI's OpenAI-compatible API.

class FireworksClient(api_key: str | None = None, chat_completion_parser: Callable[[Completion], Any] = None, input_type: Literal['text', 'messages'] = 'text', base_url: str = 'https://api.fireworks.ai/inference/v1/', env_api_key_name: str = 'FIREWORKS_API_KEY')[source]¶

Bases: OpenAIClient

A component wrapper for Fireworks AI’s OpenAI-compatible API.

This class extends OpenAIClient by customizing several key parameters: - Sets the API base URL to "https://api.fireworks.ai/inference/v1/". - Uses the environment variable "FIREWORKS_API_KEY" to obtain the API key. - Defaults the input type to "messages", which is suitable for multi-turn chat interactions.

Example usage with AdalFlow Generator:

from adalflow.core import Generator
from adalflow.components.model_client.fireworks_client import FireworksClient


generator = Generator(
    model_client=FireworksClient(),
    model_kwargs={
        "model": "accounts/fireworks/models/llama-v3p1-8b-instruct",
        "temperature": 0.7,
    }
)

prompt_kwargs = {
    "input_str": "Hello from Fireworks AI! Can you summarize the concept of quantum mechanics?"
}

response = generator(prompt_kwargs)