remote::bedrock

Description

AWS Bedrock inference provider using OpenAI compatible endpoint.

Configuration

Field	Type	Required	Default	Description
allowed_models	list[str] | None	No		List of models that should be registered with the model registry. If None, all models are allowed.
refresh_models	bool	No	False	Whether to refresh models periodically from the provider
api_key	SecretStr | None	No		Authentication credential for the provider
network	NetworkConfig | None	No		Network configuration including TLS, proxy, and timeout settings.
network.tls	TLSConfig | None	No		TLS/SSL configuration for secure connections.
network.tls.verify	bool | Path	No	True	Whether to verify TLS certificates. Can be a boolean or a path to a CA certificate file.
network.tls.min_version	Literal[TLSv1.2, TLSv1.3] | None	No		Minimum TLS version to use. Defaults to system default if not specified.
network.tls.ciphers	list[str] | None	No		List of allowed cipher suites (e.g., ['ECDHE+AESGCM', 'DHE+AESGCM']).
network.tls.client_cert	Path | None	No		Path to client certificate file for mTLS authentication.
network.tls.client_key	Path | None	No		Path to client private key file for mTLS authentication.
network.proxy	ProxyConfig | None	No		Proxy configuration for HTTP connections.
network.proxy.url	HttpUrl | None	No		Single proxy URL for all connections (e.g., 'http://proxy.example.com:8080').
network.proxy.http	HttpUrl | None	No		Proxy URL for HTTP connections.
network.proxy.https	HttpUrl | None	No		Proxy URL for HTTPS connections.
network.proxy.cacert	Path | None	No		Path to CA certificate file for verifying the proxy's certificate. Required for proxies in interception mode.
network.proxy.no_proxy	list[str] | None	No		List of hosts that should bypass the proxy (e.g., ['localhost', '127.0.0.1', '.internal.corp']).
network.timeout	float | TimeoutConfig | None	No		Timeout configuration. Can be a float (for both connect and read) or a TimeoutConfig object with separate connect and read timeouts.
network.timeout.connect	float | None	No		Connection timeout in seconds.
network.timeout.read	float | None	No		Read timeout in seconds.
network.headers	dict[str, str] | None	No		Additional HTTP headers to include in all requests.
aws_access_key_id	SecretStr | None	No		The AWS access key to use. Default use environment variable: AWS_ACCESS_KEY_ID
aws_secret_access_key	SecretStr | None	No		The AWS secret access key to use. Default use environment variable: AWS_SECRET_ACCESS_KEY
aws_session_token	SecretStr | None	No		The AWS session token to use. Default use environment variable: AWS_SESSION_TOKEN
aws_role_arn	str | None	No		The AWS role ARN to assume. Default use environment variable: AWS_ROLE_ARN
aws_web_identity_token_file	str | None	No		The path to the web identity token file. Default use environment variable: AWS_WEB_IDENTITY_TOKEN_FILE
aws_role_session_name	str | None	No		The session name to use when assuming a role. Default use environment variable: AWS_ROLE_SESSION_NAME
region_name	str | None	No	us-east-2	AWS Region for the Bedrock Runtime endpoint
profile_name	str | None	No		The profile name that contains credentials to use.Default use environment variable: AWS_PROFILE
total_max_attempts	int | None	No		An integer representing the maximum number of attempts that will be made for a single request, including the initial attempt. Default use environment variable: AWS_MAX_ATTEMPTS
retry_mode	str | None	No		A string representing the type of retries Boto3 will perform.Default use environment variable: AWS_RETRY_MODE
connect_timeout	float | None	No	60.0	The time in seconds till a timeout exception is thrown when attempting to make a connection. The default is 60 seconds.
read_timeout	float | None	No	60.0	The time in seconds till a timeout exception is thrown when attempting to read from a connection.The default is 60 seconds.
session_ttl	int | None	No	3600	The time in seconds till a session expires. The default is 3600 seconds (1 hour).

Sample Configuration

api_key: ${env.AWS_BEARER_TOKEN_BEDROCK:=}
region_name: ${env.AWS_DEFAULT_REGION:=us-east-2}
aws_role_arn: ${env.AWS_ROLE_ARN:=}
aws_web_identity_token_file: ${env.AWS_WEB_IDENTITY_TOKEN_FILE:=}