DeepInfra

The DeepInfra model provides access to DeepInfra’s hosted language models.

Parameters

Parameter	Type	Default	Description
id	str	"meta-llama/Llama-2-70b-chat-hf"	The id of the DeepInfra model to use
name	str	"DeepInfra"	The name of the model
provider	str	"DeepInfra"	The provider of the model
api_key	Optional[str]	None	The API key for DeepInfra (defaults to DEEPINFRA_API_KEY env var)
base_url	str	"https://api.deepinfra.com/v1/openai"	The base URL for the DeepInfra API
supports_native_structured_outputs	bool	False	Whether the model supports native structured outputs

DeepInfra extends OpenAILike and accepts all of its parameters.