llmgw

An OpenAI-compatible endpoint in front of self-hosted models.

Point any OpenAI client at this address. The API is the one you already have a client for; only the base URL changes.

Base URL

https://llmgw.mynodes.xyz/v1

Example

curl https://llmgw.mynodes.xyz/v1/chat/completions \
  -H "Authorization: Bearer $LLMGW_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "<model-name>", "messages": [{"role":"user","content":"hello"}]}'

Replace <model-name> with a name from GET https://llmgw.mynodes.xyz/v1/models, which needs your key. Sending the placeholder unchanged is answered with the list of models that are available. 

from openai import OpenAI
client = OpenAI(base_url="https://llmgw.mynodes.xyz/v1", api_key=os.environ["LLMGW_API_KEY"])

Which models

GET /v1/models lists what is available to your key. It needs the key, which is why this page does not list them: this page is served to anyone who can reach the address.

Getting a key

Create an account. Someone will approve it, and then you can issue your own keys from your profile — as many as you need, revoking them yourself when a laptop is retired or a script is done.

Already have an account? Sign in.

A key is shown once and never again — only its hash is kept here — so put it in a password manager straight away.

Deneme kumesi: Qwen2.5-0.5B, CPU uzerinde.

Once you have one