Remote-Hosted Distributions

Remote-hosted distributions are OGX endpoints hosted by partners that you can connect to directly.

Distribution	Endpoint	Inference
Together	https://ogx.together.ai	remote::together
Fireworks	https://ogx-preview.fireworks.ai	remote::fireworks

Connecting

Point any OpenAI-compatible client at the endpoint:

from openai import OpenAI

client = OpenAI(
    base_url="https://ogx.together.ai/v1",
    api_key="your-together-api-key",
)

response = client.chat.completions.create(
    model="meta-llama/Llama-3.2-3B-Instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

Or use the CLI:

pip install ogx-client
ogx-client configure --endpoint https://ogx.together.ai
ogx-client models list

Connecting​

Connecting