---
title: "LiteLLM OpenAI compatible endpoint: pentest models"
canonical: https://pentestllm.ai/guides/litellm
generated: 2026-11-18T03:35:58.123Z
source: https://pentestllm.ai/guides/litellm
base_url: https://api.pentestllm.ai/v1
---

# A LiteLLM OpenAI-compatible endpoint for security models, with a fallback chain

LiteLLM against this endpoint: the openai/ prefix, a model id and api_base, in the Python SDK and the proxy config.yaml, with three builds chained as fallbacks.

Steps checked October 25, 2026 · prices as of November 17, 2026

If LiteLLM already fronts the models behind your tooling, adding this endpoint is three values: `openai/` plus a model id, the `api_base`, and a key. The guide fills them with uncensored builds that answer the recon, exploit review and triage questions a stock model declines, in the Python SDK first and then in the proxy’s `config.yaml` with three builds chained as fallbacks. Field names come from docs.litellm.ai, checked on 25 October 2026.

New to builds that had their refusals removed? Read [abliterated vs uncensored](https://pentestllm.ai/blog/abliterated-vs-uncensored) first, then return here for the wiring.

## What you need

- model: openai/glm-5.3-uncensored the openai/ prefix in front of any id on the models page
- api_base: https://api.pentestllm.ai/v1 stops at /v1
- api_key: sk-ptl-live-… made in the console; exported as PTL_API_KEY

Make the key in the [console](https://app.pentestllm.ai/console). It begins with `sk-ptl-`, you see it once, and it draws on credit you add from $10. The ids live on the [model list](https://pentestllm.ai/models). To watch a build answer before you touch LiteLLM, the home page prompt box gives a few free turns and the [playground](https://pentestllm.ai/playground) runs any build with a key.

## Why the model name starts with openai/

LiteLLM reads the provider off the prefix of the model string. A server that serves OpenAI’s `/chat/completions` gets the `openai/` prefix, then that server’s own id. The [OpenAI-compatible endpoints doc](https://docs.litellm.ai/docs/providers/openai_compatible) explains the prefix in a single comment: it is there "so litellm knows to route to OpenAI".

That doc also asks you to keep the base URL as the server gives it, `/v1` included. All of the uncensored and security-tuned builds here speak the OpenAI wire format, so the one prefix reaches the whole catalog. Checked against litellm 1.106.3, the PyPI release current on 25 October 2026.

## First reply from the Python SDK

A single call and no config file. The reply has the OpenAI shape, so anything you wrote against the OpenAI SDK parses it as before. The sample prompt is recon triage on a host inside your scope.

```python
import os
import litellm

response = litellm.completion(
    model="openai/glm-5.3-uncensored",
    api_base="https://api.pentestllm.ai/v1",
    api_key=os.environ["PTL_API_KEY"],
    messages=[{"role": "user", "content": "Rank these open ports on the in-scope host by what to test first: 22, 80, 443, 3306, 8080."}],
    max_tokens=600,
)
print(response.choices[0].message.content)
```

To try another build, change the id behind `openai/`. The rest of the call stays, since one base URL and one key front every build.

## A fallback chain over three builds

Give the Router named deployments and a `fallbacks` map. The [reliability doc](https://docs.litellm.ai/docs/proxy/reliability) describes the behavior: once a call has failed `num_retries` times it moves to the next name, and the fallbacks are tried in the order written.

```python
import os
from litellm import Router

BASE = "https://api.pentestllm.ai/v1"
KEY = os.environ["PTL_API_KEY"]

def build(model_id):
    return {"model": f"openai/{model_id}", "api_base": BASE, "api_key": KEY}

router = Router(
    model_list=[
        {"model_name": "uncensored-primary", "litellm_params": build("glm-5.3-uncensored")},
        {"model_name": "uncensored-second", "litellm_params": build("deepseek-v4-pro-uncensored")},
        {"model_name": "uncensored-third", "litellm_params": build("glm-5.3-abliterated")},
    ],
    fallbacks=[{"uncensored-primary": ["uncensored-second", "uncensored-third"]}],
    num_retries=1,
)

response = router.completion(
    model="uncensored-primary",
    messages=[{"role": "user", "content": "Rank these open ports on the in-scope host by what to test first: 22, 80, 443, 3306, 8080."}],
)
print(response.choices[0].message.content)
```

Know what the chain can and cannot absorb. Every entry shares one key, so a 401 or a 402 is identical on all three builds and no fallback repairs it. The chain earns its place when a single build misbehaves: a 404 because the id dropped out of the catalog, a 429, a 5xx, a timeout. And since the [docs page](https://pentestllm.ai/docs) states that a request failing before a model answers is never charged, a request that falls through to a backup is billed one time, at the backup’s rate.

The deployment names are aliases. Your scanner or triage script asks for `uncensored-primary` and never learns a model id, so swapping builds is one edited line in the list, not a code change. `num_retries=1` grants a failing build a second attempt before the chain advances; a retry that dies before the model answers costs nothing either, so retries cost you time, not credit.

## The same chain as a proxy config.yaml

The proxy loads these deployments from a file and exposes them on an OpenAI-format endpoint of its own, which is how you share one key across a team’s tools. `os.environ/` pulls a value from the environment so the key stays out of the file. The `model_info` prices are the catalog’s at the moment this page rendered, so LiteLLM’s spend tracking lines up with what the API actually bills.

```
model_list:
  - model_name: uncensored-primary
    litellm_params:
      model: openai/glm-5.3-uncensored
      api_base: https://api.pentestllm.ai/v1
      api_key: os.environ/PTL_API_KEY
    model_info:
      input_cost_per_token: 0.000000282
      output_cost_per_token: 0.000000846
  - model_name: uncensored-second
    litellm_params:
      model: openai/deepseek-v4-pro-uncensored
      api_base: https://api.pentestllm.ai/v1
      api_key: os.environ/PTL_API_KEY
    model_info:
      input_cost_per_token: 0.00000097
      output_cost_per_token: 0.00000194
  - model_name: uncensored-third
    litellm_params:
      model: openai/glm-5.3-abliterated
      api_base: https://api.pentestllm.ai/v1
      api_key: os.environ/PTL_API_KEY
    model_info:
      input_cost_per_token: 0.0000021825
      output_cost_per_token: 0.000004365

router_settings:
  fallbacks: [{"uncensored-primary": ["uncensored-second", "uncensored-third"]}]

litellm_settings:
  num_retries: 1
  request_timeout: 120

general_settings:
  master_key: os.environ/LITELLM_MASTER_KEY
```

```bash
export PTL_API_KEY="sk-ptl-live-…"
export LITELLM_MASTER_KEY="sk-pick-your-own"
litellm --config config.yaml
```

The proxy comes up on port 4000. Any OpenAI SDK reaches it with the master key, requesting `uncensored-primary` as the model. Per LiteLLM’s custom pricing doc the two `*_cost_per_token` keys only drive tracking; billing is unaffected.

### Fallbacks for context size and content filters

`context_window_fallbacks` catch LiteLLM’s `ContextWindowExceededError`. The reliability doc makes `enable_pre_call_checks: true` under `router_settings` a requirement for that check; leave it out and every request goes to the provider regardless of size. The check also needs a published window to compare against, and the three builds above publish none in the catalog. If you want a context fallback, add a fourth deployment for [`nemotron-3-ultra-550b-a55b-uncensored`](https://pentestllm.ai/models/nemotron-3-ultra-550b-a55b-uncensored), whose listing shows 262,144 tokens, and map `uncensored-primary` onto it.

`content_policy_fallbacks` trigger on a provider’s content-filter error, LiteLLM’s `ContentPolicyViolationError`. This is the fallback a tester cares about: map a stock model on another provider to `uncensored-primary`, and the exploit review or malware triage question it filtered lands here instead. One limit: a refusal typed into an ordinary reply is a 200, not an error, so LiteLLM never sees it as something to fall back from.

## Which builds belong in the chain

Lead with the build you prefer; the backups only bill on the requests that reach them. At writing time, all three had held steady since 12 October on [the daily real-model check](https://pentestllm.ai/proof), which sends the same prompt to every model once a day and records whether the reply still matches. The column below shows today’s verdict.

| Model | Build | Input $/M | Output $/M | Context | Wire formats |
| --- | --- | --- | --- | --- | --- |
| [GLM-5.3 Uncensored](https://pentestllm.ai/models/glm-5.3-uncensored) glm-5.3-uncensored | Uncensored | $0.282 | $0.846 | — | openai |
| [DeepSeek V4 Pro Uncensored](https://pentestllm.ai/models/deepseek-v4-pro-uncensored) deepseek-v4-pro-uncensored | Uncensored | $0.97 | $1.94 | — | openai |
| [GLM-5.3 Abliterated](https://pentestllm.ai/models/glm-5.3-abliterated) glm-5.3-abliterated | Abliterated | $2.1825 | $4.365 | — | openai |

Prices per million tokens, read from the live catalog on 2026-11-17.

| Build id | Name in config.yaml | Today’s check | Context window |
| --- | --- | --- | --- |
| [`glm-5.3-uncensored`](https://pentestllm.ai/models/glm-5.3-uncensored) | `uncensored-primary` | Steady since Oct 12 | not published |
| [`deepseek-v4-pro-uncensored`](https://pentestllm.ai/models/deepseek-v4-pro-uncensored) | `uncensored-second` | Steady since Oct 12 | not published |
| [`glm-5.3-abliterated`](https://pentestllm.ai/models/glm-5.3-abliterated) | `uncensored-third` | Steady since Oct 30 | not published |

Context windows from the catalog on 2026-11-17; verdicts read from /proof when the page rendered.

Mixing two GLM builds with a DeepSeek build means an outage across one family still leaves a working answer. More of each family is on the [uncensored GLM](https://pentestllm.ai/uncensored/glm) and [uncensored DeepSeek](https://pentestllm.ai/uncensored/deepseek) pages.

## Cost of a batch through the chain

The worked case, a nightly triage run: 10,000 requests, each 1,200 prompt tokens in and 350 reply tokens out, every one answered by the same build.

| Model | 10,000 requests |
| --- | --- |
| [GLM-5.3 Uncensored](https://pentestllm.ai/models/glm-5.3-uncensored) | $6.35 |
| [DeepSeek V4 Pro Uncensored](https://pentestllm.ai/models/deepseek-v4-pro-uncensored) | $18.43 |
| [GLM-5.3 Abliterated](https://pentestllm.ai/models/glm-5.3-abliterated) | $41.47 |

Worked out at render time from the catalog prices on 2026-11-17: requests × 1,200 × input rate, plus requests × 350 × output rate.

An actual month lands near the first row, plus a backup’s rate on whatever fell through. The [pricing page](https://pentestllm.ai/pricing) has every per-token rate.

## Prove the key before you blame the config

This returns the ids your key may call. It is free, so run it first.

```bash
curl https://api.pentestllm.ai/v1/models \
  -H "Authorization: Bearer sk-ptl-live-…"
```

A 200 with ids in it means both key and base URL are right. A 401 tells you which kind of wrong the key is:

```
HTTP 401
{"error":{"message":"No API key was sent.","type":"authentication_error","param":null,"code":"invalid_api_key"}}
```

```
HTTP 401
{"error":{"message":"The API key is not valid.","type":"authentication_error","param":null,"code":"invalid_api_key"}}
```

Both bodies exactly as the API sent them on 25 October 2026.

## LiteLLM errors against this endpoint

LiteLLM turns each status into an exception, per its exception mapping doc: 401 becomes `AuthenticationError`, 402 `PaymentRequiredError`, 404 `NotFoundError` and 429 `RateLimitError`.

### Every call returns Not Found

The OpenAI-compatible doc’s own fix: `api_base` must end in `/v1`. Confirm as well that the model string begins with `openai/`.

### 404 model_not_found on a single build

The id behind `openai/` does not exist in the catalog; the chain continues with the next build; correct the id against the list the curl above printed.

```
HTTP 404
{"error":{"message":"No such model: glm-5.3-uncensord.","type":"not_found_error","param":null,"code":"model_not_found"}}
```

### 402 insufficient_balance

Credit is at zero, so each build in the chain fails the same way. Add credit in the console; the refused requests were not charged.

```
HTTP 402
{"error":{"message":"The prepaid balance does not cover this request. Top up at … to continue.","type":"insufficient_quota","param":null,"code":"insufficient_balance"}}
```

## Questions

### Does LiteLLM count as OpenAI compatible?

In both directions. A model string starting with openai/ makes it call an OpenAI-compatible endpoint, and its proxy exposes an OpenAI-format endpoint of its own on port 4000.

### What does "OpenAI-compatible API endpoint" mean?

A server that accepts the requests and returns the responses of OpenAI's /v1/chat/completions, so a client needs nothing beyond a base URL, a key and a model id. Here the base URL is https://api.pentestllm.ai/v1. See the docs page.

### What are the exact LiteLLM values for this provider?

model is openai/ followed by the provider's id, api_base is its URL ending in /v1, api_key is its key. For this API: openai/glm-5.3-uncensored and https://api.pentestllm.ai/v1.

### Which other prefixes does LiteLLM know for compatible servers?

Its doc lists provider-specific ones, hosted_vllm among them, for servers that match a known shape. This API takes the plain openai/ prefix. See the model list.

### Can a Node tool talk to the LiteLLM proxy?

Yes. The proxy speaks the OpenAI format, so the OpenAI Node SDK works with baseURL set to the proxy and the master key as apiKey.

### Will LiteLLM report spend for these builds?

Only when it has the prices. The config above writes the catalog’s per-token rates into model_info, and LiteLLM uses them for tracking alone. See per-token prices.

Every model above is on the [uncensored model list](https://pentestllm.ai/models) with its live price per million tokens. [Per-token pricing](https://pentestllm.ai/pricing) sets the whole catalog side by side, and the [family directory](https://pentestllm.ai/uncensored) groups the builds by base model.

[Get a key](https://app.pentestllm.ai/console) Prepaid from $10, no subscription.

## New models and price changes, once a month.

New uncensored builds with their prices, price moves, and what the daily model check found.
