Skip to content
ThinkWatch
Start typing to search the docs.
ThinkWatch Core · Configuration reference

Configuration reference#

ThinkWatch Core reads one file, config.yaml. This page describes every field in it: what it does, its default, the values it takes, and how a change reaches the running process. To run core on a server and control it from the desktop app, see Running core on a server.

The field tables on this page are generated from the code, and a test fails when they disagree, so a field listed here is a field the binary reads.

Where the file is#

PlatformDefault location
macOS, Linux~/.thinkwatch/config.yaml
Windows%APPDATA%\ThinkWatch\config.yaml

THINKWATCH_HOME replaces the directory, and --config <path> names the file for a single command. The directory holds everything else core keeps as well: the request database (data.db), the configuration history (history/), the downloaded price table (model_prices.json) and the local control socket (twcore.sock; on Windows a loopback port recorded in control.port). The directory is private to its owner (0700), the file is 0600: it holds keys in plain text.

twcore serve writes a starting configuration when there is none, and twcore init writes one on request. Both produce this:

version: 1
listen:
  control:
    key: 6629…753d       # generated
clients:
  - name: default
    key: tw-…            # generated

That is a complete, valid configuration. It has no upstream yet, so the control plane runs and requests are answered with an error saying so. Adding one upstream makes it forward:

providers:
  - name: anthropic
    base_url: https://api.anthropic.com
    key: ${ANTHROPIC_API_KEY}

How the file is read#

  • A field name that is not in this reference is an error. A misspelled prot: is not ignored while the gateway quietly starts on the default port; the whole file is refused and the message names the field.
  • Defaults are not written into the file. Anything left out has the default in the tables below. The app and the command line add a field only when its value differs from the default, so what is in the file is what someone chose.
  • ${VAR} reads an environment variable in fields marked “${VAR} allowed”: upstream keys, header values, proxy passwords. It is read from the environment of the core process when a request is sent; an unset variable fails that upstream’s requests and names the variable. Under systemd, that environment is the unit’s EnvironmentFile.
  • Names are references. Rules, groups and keys refer to upstreams, groups, routes and price sheets by name. A name that points nowhere is an error at load time rather than a rule that never matches. Renaming in the app changes every reference in the same write. Names starting with __ are reserved for built-ins.
  • version is the format version, 1. A file with a higher version was written by a newer twcore and is refused.

How a change takes effect#

There are three ways to change the configuration, and they all go through the same path: the desktop app, twcore config …, and editing the file in an editor. Core watches the file and reloads it within a second of a save; nothing needs to be restarted.

A new version is applied only if it passes every stage:

  1. It parses as YAML.
  2. It matches the schema: known fields, the right types.
  3. It is consistent: names are unique, references resolve, patterns compile, CIDR ranges are well formed.
  4. The runtime objects can be built from it.

If any stage fails, the previous configuration stays in service, and the error says which stage failed and where. A typo never takes the gateway down. The desktop app shows the rejection until a valid version is saved.

Changes to listen.gateway apply live as well: core opens the new listener, and if it cannot (the port is taken) it keeps the old one and reports why. Retention changes are applied on the next hourly clean-up.

When two writers edit at once (the app and a hand edit), the second write is refused with a version mismatch instead of overwriting the first.

History and rollback#

Every version that was in effect is kept in history/ beside the file, with where it came from (the app, the command line, an outside edit, a rollback, a credential rotation). The last 50 are kept.

twcore check                      # validate the file without starting anything
twcore config show                # print it, with its version
twcore config history             # list the versions, newest first
twcore config rollback 3f9a2c     # go back to a version (a prefix is enough)
twcore config set /listen/gateway/port 8790 --int

These commands work on the file directly, so they work when core is not running, which is when a rollback is most needed. A running core picks their changes up like any other save.

twcore config set <path> <value> changes one value that is already written in the file. The path names list items by their name (/providers/anthropic/base_url); a number is an index (/routes/0/rules/1/to). The value is a string unless --int, --bool or --null says otherwise. The result is validated before it is written. To add a field that is not in the file yet, edit the file.

Credentials the gateway writes back#

One write is not made by a person. When an upstream’s OAuth token endpoint issues a new refresh token, the old one stops working, so the gateway writes the new token (and the access token with its expiry) back into providers[].oauth. Only those values change; comments and layout are left as they are.

Reference#

Each table lists every field of one section. ”—” in the Default column means the field is simply absent unless written; the description says what that means.

Top level#

FieldTypeDefaultDescription
versionintegerrequiredFormat version of this file. The only version is 1. A file with a higher number was written by a newer twcore and is refused rather than half-understood.
listenobject, listen—Where the gateway and the control channel listen.
clientslist of clients[][]Gateway keys. At least one is required; twcore init and the first twcore serve write one named default.
providerslist of providers[][]Upstreams. None is a valid configuration: the control plane runs and requests are answered with an error saying no upstream is configured.
proxieslist of proxies[][]Outbound proxies, declared once and referred to by name from providers[].proxy.
pricingobject, pricing—Refreshing the default price table, and price sheets of your own.
client_probesobject, client_probes—What happens to the helper requests clients send on their own (health checks, warm-ups, titles).
securityobject, security—The five guards. All of them start in observe or off, so out of the box nothing is changed or blocked.
retentionobject, retention—How long request logs are kept.
failoverobject, failover—How long an upstream is set aside after it fails, and how long the start of a stream is awaited.
groupslist of groups[][]Strategy groups: several upstreams behind one name, with a way to pick among them.
routeslist of routes[][]Routes. Without any, requests fail over across all upstreams in the order they are declared.
default_routestring—The route for keys that do not name one. Unset: the route named default, or the built-in failover when there is none.
default_keystring—The gateway key for clients that were not given a key of their own. Unset: the key named default, or the first key. It cannot be disabled.

listen#

Where core accepts connections. There are two kinds: the AI gateway that clients send requests to, and the control channel the desktop app and twcore commands use.

FieldTypeDefaultDescription
gatewayobject, listen.gateway—The AI gateway: the address clients send requests to.
controlobject, listen.control—The control channel: how the desktop app and twcore commands reach core. It holds the control key, so every configuration has it.

listen.gateway#

FieldTypeDefaultDescription
bindloopback | all | interface name | IP addressloopbackloopback is this machine only; all is every interface; an interface name (en0, eth0) is looked up again every few seconds and follows address changes, and while the interface is not there the gateway listens on 127.0.0.1 only and adds it once it appears; a fixed IP address stops working when the address changes. Binding one interface also listens on 127.0.0.1.
portinteger8788TCP port of the gateway.
allow_fromlist of strings[10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16, fc00::/7]Sources other than this machine that may connect, as CIDR ranges or single addresses. This machine is always allowed. [] means this machine only; 0.0.0.0/0 allows everyone and has to be written out.

When bind reaches beyond this machine, allow_from decides who gets in. The gateway has no TLS: expose it on networks you trust, or put it behind a tunnel or VPN.

listen:
  gateway:
    bind: all
    port: 8788
    allow_from: [192.168.1.0/24]

listen.control#

The control channel is how the desktop app, and twcore config and twcore control-key on the same machine, talk to core. Locally it is a socket file in the data directory (a loopback port on Windows); no network port is opened for it unless remote is enabled.

Every control connection, local or remote, starts with a handshake that proves both ends hold key (Noise_NNpsk0_25519_ChaChaPoly_BLAKE2s: the key is the pre-shared key, each connection negotiates fresh session keys, and the traffic is encrypted). There are no certificates. A peer without the key cannot complete the first message.

FieldTypeDefaultDescription
keystringgeneratedThe control key: 64 hexadecimal characters (32 bytes). Every control connection, local or remote, proves it knows this key. twcore serve writes one before listening if it is missing; a configuration where it is malformed is refused. Show it with twcore control-key, replace it with twcore control-key --rotate.
remoteobject, listen.control.remote—A network port for the desktop app on another machine. Additional to the local channel, never instead of it.

key is written by twcore serve before the control channel starts listening, if it is missing, and by twcore init. It is masked wherever the configuration is shown or kept in the history; saving a masked value back keeps the real one. A missing or malformed key (not 64 hexadecimal characters) makes the whole file invalid, so it cannot be replaced by a short, guessable one.

twcore control-key            # print the key, to paste into the desktop app
twcore control-key --rotate   # replace it; connected apps have to reconnect

Both run on the machine where core runs.

listen.control.remote#

A network port for a desktop app on another machine. It is opened in addition to the local channel, so a mistake here (a port that is taken, an allow_from that shuts you out) never locks out the machine itself: twcore config and the local app keep working.

FieldTypeDefaultDescription
enabledboolfalseListen on the remote port. Unset or false: no network port is opened for control. twcore remote enable and twcore remote disable switch it; a running core follows within a second.
bindloopback | all | interface name | IP addressallInterface to listen on, written as for listen.gateway.bind.
portintegerrequiredTCP port. There is no fixed default: twcore init and twcore remote enable write a random port between 20000 and 32000 (never the gateway’s) when they write this section. It cannot be 0 or the gateway’s port.
allow_fromlist of strings[10.0.0.0/8, 172.16.0.0/12, 192.168.0.0/16, fc00::/7]Sources that may connect, as for listen.gateway.allow_from, except that this machine is not let in automatically (it has the local channel). A connection from anywhere else is closed before the handshake, without a byte in reply; narrowing the list also closes open connections it no longer allows. A source that fails the handshake 5 times within a minute is ignored for a minute.
listen:
  control:
    key: 9f2c…e41a          # 64 hexadecimal characters
    remote:
      enabled: true
      bind: all
      port: 23483            # random, written when the section is generated
      allow_from: [192.168.1.0/24]

A connection over the remote port cannot do three things, whatever the app asks: shut core down (it is managed by systemd), change listen.control (the door it came in through), or produce a diagnostic bundle (it would be written on the server). Handshakes time out after 5 seconds; five failed handshakes from one source within a minute block that source for a minute.

clients#

Gateway keys: the keys clients such as Claude Code and Codex send to the gateway. A key is an identity. Limits, model scope and route are per key.

FieldTypeDefaultDescription
namestringrequiredName of the key; unique. Routing rules match it with when.client.
keystringrequiredThe key clients send (as x-api-key or Authorization: Bearer). Generated keys start with tw- so they are not mistaken for an upstream’s key. Unique.
max_concurrentinteger—Requests with this key that may run at once; the rest wait. Unset: no limit. 0 is refused.
allowlist of strings—Models this key may use, as model ids or globs (claude-*). Unset: every model. []: none at all.
routestring—Name of the route requests with this key take. Unset: default_route.
clientstring—The client this key was made for (claude-code, codex, …), recorded when the desktop app points a client at the gateway. A client has at most one.
disabledboolfalseRefuse every request made with this key, and keep the key.
clients:
  - name: default
    key: tw-a3f9c8d1e5b2h7k4m6n8p2q4
  - name: build-server
    key: tw-q8r2s4t6u8v2w4x6y8z2a4b6
    max_concurrent: 4
    allow: [claude-sonnet-*]
    route: cheap

providers#

Upstreams: the APIs requests are forwarded to.

FieldTypeDefaultDescription
namestringrequiredName of the upstream; unique, and not the name of a group. Names starting with __ are reserved.
base_urlstringrequiredEndpoint, http:// or https://, up to the version segment where the provider documents one (https://api.anthropic.com, https://api.openai.com/v1). For Bedrock, the region’s runtime endpoint: https://bedrock-runtime.<region>.amazonaws.com.
keystring, ${VAR} allowed—API key. It goes in the header the protocol expects: x-api-key (Anthropic), Authorization: Bearer (OpenAI, and a Bedrock API key), x-goog-api-key (Gemini). Leave it out for upstreams without a key, or when the credential is written in headers. Cannot be combined with oauth or aws.
headersmap of header name → value{}Additional request headers, in the order written; values may use ${VAR}, and {{access_token}} where oauth is set. At most 32. Headers HTTP or the gateway manages (host, content-length, connection, …) cannot be set.
oauthobject, providers[].oauth—OAuth credential: an access token obtained from a refresh token. Instead of key.
awsobject, providers[].aws—AWS access keys of a Bedrock upstream, written there or read from an AWS profile: every request is signed with them (SigV4). Instead of key, which holds a Bedrock API key.
protocolanthropic | openai-chat | openai-responses | gemini | chatgpt | bedrock—API format of the upstream. Unset: recognized from base_url for the official endpoints (a Bedrock runtime endpoint is bedrock), otherwise treated as anthropic.
forward_client_identityboolfalseAlso send the client’s own identity: its User-Agent, identity headers such as x-app and originator, and identity fields in the request body such as metadata.user_id. Values are the client’s, never made up. Off: requests carry ThinkWatch’s User-Agent and no client identity. For upstreams that admit only certain clients (Kimi For Coding, Bailian Coding Plan, relays restricted to official clients). Not available for chatgpt.
proxystringdirectdirect; system, the proxy in the core process’s HTTPS_PROXY, HTTP_PROXY or ALL_PROXY environment variables; or the name of an entry in proxies.
on_proxy_failfail | directfailWhen the proxy cannot be reached: fail the request, or go direct.
modelslist of strings[]Models to assume when the upstream does not answer /v1/models.
models_onlylist of strings—Use only these of the upstream’s models, as ids or globs. Others are not listed and are not routed here. Unset: all of them. Empty is refused; use disabled.
billingper-token | freeper-tokenper-token: cost is usage times the price in the upstream’s price sheet, subscription accounts included. free: cost is recorded as 0.
pricingstring—Name of a price sheet under pricing.sheets. Unset: the default price table.
disabledboolfalseTake the upstream out of routing and out of the model list, and keep its configuration.

A credential is one of four things: key, which goes in the header the protocol expects; oauth, a token obtained from a refresh token; aws, the access keys a Bedrock upstream signs its requests with; or headers, when the upstream wants something of its own. headers can be combined with the others, except for the header that already carries the credential.

providers:
  - name: anthropic
    base_url: https://api.anthropic.com
    key: ${ANTHROPIC_API_KEY}

  - name: relay
    base_url: https://relay.example.com/v1
    protocol: openai-chat
    headers:
      X-Relay-Token: ${RELAY_TOKEN}
    proxy: office
    models_only: [gpt-4.1*, o3]
    pricing: relay-discount

  - name: local
    base_url: http://127.0.0.1:11434/v1
    protocol: openai-chat
    billing: free

A request carries the request itself and the headers its upstream needs, and nothing else from the client: the credential and the headers written in headers; ThinkWatch’s own User-Agent; and, from the client’s request, only the headers the upstream’s protocol uses (anthropic-* for Anthropic, Idempotency-Key and X-Client-Request-Id for OpenAI, none for Gemini). Identity fields that clients fill in themselves, such as Claude Code’s metadata.user_id, are removed from the body. For an upstream that admits only certain clients, turn on forward_client_identity.

A ChatGPT account upstream (protocol: chatgpt) takes only the credential the desktop app obtains by signing in; it cannot be written by hand. Claude and Google subscription sign-ins are not supported; use an API key.

providers[].oauth#

FieldTypeDefaultDescription
accessstring—Current access token. Written back by the gateway after every refresh; unset means one is obtained on first use.
expires_atstring—When access expires, RFC 3339 in UTC. Written back with it. Unset: used until the upstream answers 401.
refreshstringrequiredRefresh token. When the token endpoint issues a new one, the old one stops working, so the gateway writes the new one back into this file.
endpointstringrequiredToken endpoint URL.
client_idstring—OAuth client id, if the endpoint wants one.
client_secretstring—OAuth client secret, if the endpoint wants one.
refresh_beforeduration (30s, 5m, 1h)—How long before expiry to refresh. Unset or unreadable: 5m.

The access token goes in the protocol’s authorization header. To put it somewhere else, write the header in headers with {{access_token}} where the token goes:

    oauth:
      refresh: ${VENDOR_REFRESH_TOKEN}
      endpoint: https://auth.example.com/oauth/token
      client_id: my-client
    headers:
      X-Access: Token {{access_token}}

providers[].aws#

FieldTypeDefaultDescription
access_key_idstring, ${VAR} allowed—Access key ID. Written together with secret_access_key; profile instead.
secret_access_keystring, ${VAR} allowed—Secret access key.
session_tokenstring, ${VAR} allowed—Session token of temporary credentials, such as those STS issues. When it expires, requests are refused until it is replaced.
profilestring—Profile in the AWS credential files to read the access keys from, instead of writing them here: ~/.aws/credentials and ~/.aws/config, or the files AWS_SHARED_CREDENTIALS_FILE and AWS_CONFIG_FILE name, on the machine core runs on. The files are read again when they change.
regionstring—Region to sign for. Unset: the one in base_url, which must then be a standard runtime endpoint. Required when base_url is a VPC endpoint or a proxy.

A Bedrock upstream authenticates in one of two ways. A Bedrock API key goes in key and is sent as Authorization: Bearer. AWS access keys go in aws, written there or read with aws.profile from a profile in the AWS credential files: every request is signed with them (SigV4) once its body is final, and the keys themselves are never sent. Keys written in the configuration can be read from the environment with ${VAR}. A profile is read from the files on the machine core runs on, and read again when they change, so a tool that refreshes temporary keys in ~/.aws/credentials needs no restart. Nothing runs a command to obtain a credential, so a profile that signs in through IAM Identity Center (aws sso login), runs a credential_process or assumes a role cannot be used; export the keys it produces instead.

providers:
  - name: bedrock
    base_url: https://bedrock-runtime.us-east-1.amazonaws.com
    key: ${AWS_BEARER_TOKEN_BEDROCK}

  - name: bedrock-keys
    base_url: https://bedrock-runtime.eu-west-1.amazonaws.com
    aws:
      access_key_id: ${AWS_ACCESS_KEY_ID}
      secret_access_key: ${AWS_SECRET_ACCESS_KEY}
      session_token: ${AWS_SESSION_TOKEN}

  - name: bedrock-profile
    base_url: https://bedrock-runtime.us-west-2.amazonaws.com
    aws:
      profile: dev

Requests are converted to Converse. The model list comes from the region’s control plane: the foundation models that can be invoked on demand, the inference profiles AWS defines (us.anthropic.claude-…), and the account’s application inference profiles, listed by the ARN they are invoked by. Listing needs bedrock:ListFoundationModels and bedrock:ListInferenceProfiles; without them requests are still forwarded, and models can list the models by hand. For a VPC endpoint or a proxy, write its address in base_url and the region in aws.region; the model list is asked of that address too.

proxies#

Outbound proxies. Different upstreams often need different ones, so there is no global switch: an upstream picks one with proxy.

FieldTypeDefaultDescription
namestringrequiredName used in providers[].proxy. direct and system are built in.
typesocks5 | socks5h | http | httpssocks5hsocks5h sends the host name to the proxy to resolve; socks5 resolves it locally first. http and https are HTTP proxies.
addrstringrequiredhost:port of the proxy.
authobject, proxies[].auth—User name and password, if the proxy wants them.

proxies[].auth#

FieldTypeDefaultDescription
userstringrequiredUser name.
passstring, ${VAR} allowedrequiredPassword.
proxies:
  - name: office
    type: http
    addr: proxy.example.com:3128
    auth:
      user: alice
      pass: ${PROXY_PASSWORD}

on_proxy_fail: fail is the default because falling back silently sends a request by a path you did not intend; you would believe you were on the proxy while you were not.

pricing#

The cost of a request is its usage times the price of the model. Prices come from the default price table (LiteLLM’s public dataset, a copy of which is built into the binary and refreshed daily) or from a price sheet an upstream picks. A change of price applies to requests from then on, never to ones already recorded.

FieldTypeDefaultDescription
auto_updatebooltrueRefresh the default price table from the network once a day. It is saved as model_prices.json beside config.yaml; the table built into the binary is used until then and when offline.
sheetslist of pricing.sheets[][]Price sheets of your own. An upstream uses one with providers[].pricing.

pricing.sheets#

FieldTypeDefaultDescription
namestringrequiredName of the sheet; unique.
multipliernumber1Applied to every price of the default table, cache and long-context prices included.
modelsmap of model id → pricing.sheets[].models.*{}Prices for single models. They replace the default table’s price for that model and are not multiplied.

pricing.sheets[].models#

Prices are in US dollars per million tokens, as printed on vendors’ price pages. Every field is written out; nothing is inferred when pricing.

FieldTypeDefaultDescription
inputnumberrequiredUS dollars per million input tokens.
outputnumberrequiredUS dollars per million output tokens.
cache_readnumberrequiredUS dollars per million tokens read from the prompt cache.
cache_write_5mnumberrequiredUS dollars per million tokens written to a 5-minute cache.
cache_write_1hnumberrequiredUS dollars per million tokens written to a 1-hour cache.
input_above_200knumber—Input price once a request’s input, cache reads and writes included, exceeds 200K tokens. Written together with output_above_200k, or neither. Cache prices stay the ones above.
output_above_200knumber—Output price once a request’s input, cache reads and writes included, exceeds 200K tokens.
pricing:
  sheets:
    - name: relay-discount
      multiplier: 0.8
      models:
        claude-sonnet-4-5-thinking:
          input: 3
          output: 15
          cache_read: 0.3
          cache_write_5m: 3.75
          cache_write_1h: 6

client_probes#

Some requests clients send are not the user’s: connectivity checks, warm-ups, session titles, topic detection, suggestions. Each class can be answered locally (intercept, nothing is sent upstream), passed through (passthrough), or handed to the routing rules (route, matched with when.intent). The defaults intercept only what nobody would miss.

FieldTypeDefaultDescription
health_checkintercept | passthrough | routeinterceptConnectivity checks (max_tokens: 1). Answered locally by default: nothing is lost.
warmupintercept | passthrough | routeinterceptWarm-up requests. Answered locally by default.
titlingintercept | passthrough | routepassthroughRequests that name a session. Passed through by default: intercepting them gives every session the same title.
topic_detectintercept | passthrough | routepassthroughTopic detection. Passed through by default.
suggestionintercept | passthrough | routepassthroughSuggestions. Passed through by default.

security#

Five guards, applied to every upstream alike. Each has a mode: off, observe (detect and record, change nothing) or enforce (act). They start in observe, except the output limit, which starts off. What enforce does differs per guard, and each says so below.

FieldTypeDefaultDescription
redactobject, security.redact—Outbound redaction: credentials found in a request are replaced before it leaves.
inspect_toolsobject, security.inspect_tools—Tool-call inspection: dangerous commands in the tool calls a model returns cut the response off.
hidden_textobject, security.hidden_text—Hidden characters that people cannot see and models can read refuse the request.
contentobject, security.content—Content filter: words or patterns in what the caller sends refuse the request.
output_limitobject, security.output_limit—Output length: a response longer than the limit is cut off.

security.redact#

Before a request leaves, credentials in it are looked for. Under enforce they are replaced.

FieldTypeDefaultDescription
modeoff | observe | enforceobserveoff does nothing; observe detects and records only, and changes nothing; enforce detects and acts.
enablelist of strings[]Built-in rules to switch on that are off out of the box, by id.
disablelist of strings[]Built-in rules to switch off, by id.
customlist of security.redact.custom[][]Rules of your own: whatever a pattern matches is treated as a credential.

FieldTypeDefaultDescription
namestringrequiredName shown in logs and in the app; it identifies the rule and has to be unique within this guard.
patternstringrequiredRegular expression.
disabledboolfalseSwitches the rule off and keeps it in the file.

Built-in rules:

idNameOut of the box
anthropic-api-keyAnthropic API keyon
openai-project-keyOpenAI project keyon
openai-api-keyOpenAI API keyon
github-personal-tokenGitHub personal access tokenon
github-oauth-tokenGitHub OAuth tokenon
github-server-tokenGitHub server tokenon
github-user-tokenGitHub user tokenon
github-fine-grained-tokenGitHub fine-grained tokenon
slack-bot-tokenSlack bot tokenon
slack-user-tokenSlack user tokenon
slack-app-tokenSlack app tokenon
aws-access-key-idAWS access key IDon
aws-temporary-key-idAWS temporary access key IDon
google-api-keyGoogle API keyon
google-oauth-tokenGoogle OAuth tokenon
gitlab-tokenGitLab tokenon
stripe-live-keyStripe live keyon
stripe-restricted-keyStripe restricted keyon
npm-tokennpm tokenon
digitalocean-tokenDigitalOcean tokenon
sendgrid-keySendGrid keyon
private-keyPrivate keyon
jwtJWTon
conn-string-passwordConnection string passwordon
internal-ipInternal IP addressoff
internal-domainInternal domainoff

security.inspect_tools#

Tool calls a model returns are checked against the rules. Under enforce, a match with rules set to cut stops the response, so the client never receives a complete call to run.

FieldTypeDefaultDescription
modeoff | observe | enforceobserveoff does nothing; observe detects and records only, and changes nothing; enforce detects and acts.
enablelist of strings[]Built-in rules to switch on that are off out of the box, by id.
disablelist of strings[]Built-in rules to switch off, by id.
actionsmap of built-in rule id → cut | record{}What a built-in rule does under enforce, written only where it differs from the factory setting (rm-rf-root: record).
customlist of security.inspect_tools.custom[][]Rules of your own, matched against the arguments of a tool call.

FieldTypeDefaultDescription
namestringrequiredName shown in logs and in the app; it identifies the rule and has to be unique within this guard.
patternstringrequiredRegular expression.
actioncut | recordrecordUnder enforce: cut the response off, or only record the match.
disabledboolfalseSwitches the rule off and keeps it in the file.

Built-in rules:

idNameUnder enforce, out of the box
curl-pipe-shDownload and runcut
base64-decode-execDecode and runcut
exfil-envSend out environment variablescut
exfil-credentialsSend out a credential filecut
exfil-credentials-reversedSend out a credential file (verb first)cut
ssh-key-readRead a private key or cloud credentialcut
write-startup-itemWrite a startup itemcut
crontab-installInstall a scheduled jobcut
rm-rf-rootDelete home or rootrecord
chmod-777World-writable permissionsrecord

security.hidden_text#

Characters people cannot see and models can read, in what the caller sends (tool results included). Under enforce, the request is refused.

FieldTypeDefaultDescription
modeoff | observe | enforceobserveoff does nothing; observe detects and records only, and changes nothing; enforce detects and acts.
disablelist of strings[]Kinds not to look for: tag, bidi.
KindWhat it is
tagUnicode tag characters (U+E0000 to U+E007F): invisible everywhere, read by the model, able to carry a whole instruction.
bidiBidirectional control characters: make the order shown differ from the order the model reads.

security.content#

Words or patterns in what the caller sends. Under enforce, a match with rules set to block refuses the request.

FieldTypeDefaultDescription
modeoff | observe | enforceobserveoff does nothing; observe detects and records only, and changes nothing; enforce detects and acts.
enablelist of strings[]Built-in rules to switch on that are off out of the box, by id.
disablelist of strings[]Built-in rules to switch off, by id.
actionsmap of built-in rule id → block | record{}What a built-in rule does under enforce, written only where it differs from the factory setting.
customlist of security.content.custom[][]Rules of your own.

FieldTypeDefaultDescription
namestringrequiredName shown in logs and in the app; it identifies the rule and has to be unique within this guard.
patternstringrequiredA keyword, or a regular expression with match: regex. Case-insensitive either way.
matchcontains | regexcontainscontains: the text contains pattern. regex: pattern is a regular expression.
actionblock | recordrecordUnder enforce: block the request, or only record the match.
disabledboolfalseSwitches the rule off and keeps it in the file.

Built-in rules:

idNameGroupOut of the boxUnder enforce, out of the box
ignore-previous-instructionsIgnore previous instructionsinjectiononblock
ignore-all-previousIgnore all previousinjectiononblock
disregard-your-instructionsDisregard your instructionsinjectiononblock
jailbreakJailbreakinjectionoffblock
danDANinjectionoffblock
developer-modeDeveloper modeinjectionoffblock
you-are-nowPersona manipulationpersonaoffblock
new-personaNew personapersonaoffrecord
act-asAct aspersonaoffrecord
pretend-to-bePretend to bepersonaoffrecord
system-promptSystem prompt extractionpersonaoffrecord
reveal-your-instructionsReveal instructionspersonaoffrecord
what-are-your-rulesWhat are your rulespersonaoffrecord
base64-wallBase64 smugglingpersonaoffrecord
zh-ignore-previousIgnore previous instructions (Chinese)chineseoffblock
zh-forget-yourForget your instructions (Chinese)chineseoffblock
zh-do-not-followDo not follow (Chinese)chineseoffblock
zh-you-are-nowYou are now (Chinese)chineseoffblock
zh-role-playRole-play (Chinese)chineseoffrecord
zh-reveal-yourReveal your instructions (Chinese)chineseoffrecord
zh-system-promptSystem prompt (Chinese)chineseoffrecord
zh-jailbreakJailbreak (Chinese)chineseoffblock

security.output_limit#

FieldTypeDefaultDescription
modeoff | observe | enforceoffOff out of the box: no single limit suits every use. observe records long responses; enforce stops the stream at the limit.
max_charsinteger100000Limit in characters (Unicode scalar values), from 1 to 1000000.
security:
  redact:
    mode: enforce
    enable: [internal-ip]
    custom:
      - name: employee-id
        pattern: 'EMP-\d{6}'
  inspect_tools:
    mode: enforce
  output_limit:
    mode: enforce
    max_chars: 200000

retention#

Two limits, because the two kinds of data differ in size by three orders of magnitude: request bodies are tens of kilobytes each, a request’s record a few hundred bytes. The byte limit covers bursts.

FieldTypeDefaultDescription
body_daysinteger7Days to keep request and response bodies.
row_daysinteger90Days to keep the record of each request (time, model, usage, cost).
body_max_bytesinteger2147483648Upper bound on the bytes bodies may take; beyond it the oldest days go first. The default is 2 GiB.

failover#

An upstream that fails is set aside for a while, so that the next requests go straight to the next candidate. How long depends on the reason the upstream gives: an insufficient balance waits for a top-up, a used-up quota waits until the moment the upstream says it resets, and a rate limit usually passes within seconds. A request with a single candidate is never affected.

Before the first content of a streamed answer reaches the client, an error the upstream sends in the stream moves the request to the next candidate, the same as an error status would.

FieldTypeDefaultDescription
failures_to_pauseinteger3Consecutive failures without a stated reason (5xx, connection errors) before the upstream is set aside. From 1 to 100.
pause_secsinteger60Seconds the first such pause lasts. Each further pause doubles it, up to max_pause_secs; one success resets it.
max_pause_secsinteger600Upper bound on the doubled pause, in seconds; not less than pause_secs.
no_balance_pause_secsinteger1800Seconds to set aside an upstream that reports an insufficient balance.
quota_pause_secsinteger3600Seconds to set aside an upstream whose quota is used up when it does not say when the quota resets. When it does, the upstream is set aside until then.
rate_limit_max_pause_secsinteger3600A rate-limited upstream is set aside for the time its Retry-After gives, at most this many seconds. Without Retry-After it counts as a failure without a stated reason.
stream_start_wait_secsinteger15Seconds to hold a streamed answer until its first content arrives. An error before then moves the request to the next upstream; after this long, what has arrived is passed on. From 1 to 120.

groups#

A group puts several upstreams behind one name. Rules send requests to a group with to.

FieldTypeDefaultDescription
namestringrequiredName of the group; unique, and not the name of an upstream.
typefallback | select | load-balance | url-test | cheapestfallbackfallback: the first healthy member, in order. select: the member named in selected. load-balance: take turns between new conversations. url-test: the fastest by measured time to first byte. cheapest: the lowest input price.
providerslist of stringsrequiredMember upstreams, by name.
selectedstring—For select: the chosen member.

fallback is the default because a single user’s machine has no load to spread.

Whatever the type, a conversation stays on the upstream that last answered it, so that what the upstream holds of it in its prompt cache is read again rather than paid for in full elsewhere. Within a turn (while the client sends tool results back) it always stays; across turns it stays while the previous answer read or wrote at least 1024 tokens of prompt cache and came less than five minutes ago. An upstream that is cooling down after failures releases the conversation, and whichever upstream answered after a failover is the one it stays on. The rule a turn matched at its start also holds for the rest of that turn: rules keyed on input size or images do not move a turn halfway, unless its input no longer fits the context window of a model the rule sends it to. load-balance therefore takes turns between new conversations.

routes#

A route is a list of rules evaluated top to bottom. Each key takes the route named in its route, otherwise default_route, otherwise the route named default; without any, requests fail over across all upstreams in the order they are declared.

FieldTypeDefaultDescription
namestringrequiredName of the route; unique. default is the one keys use unless told otherwise.
ruleslist of routes[].rules[][]Evaluated top to bottom; the first rule with to or deny that matches decides where the request goes.

routes[].rules#

FieldTypeDefaultDescription
namestringrequiredName shown in logs and in the traffic view.
whenobject, routes[].rules[].when—Conditions, all of which have to hold. Unset: matches every request.
tostring—An upstream or a group, by name; __all__ is every upstream in declared order. Not allowed together with when.provider_would_be.
setobject, routes[].rules[].set—Parameters to rewrite. Collected from every matching rule, not only the first.
denystring—Refuse the request with this reason.

routes[].rules[].when#

FieldTypeDefaultDescription
modelstring—Requested model, glob (claude-opus-*).
clientstring—Name of the gateway key the request used, exactly.
dialectstring—API format the client spoke: anthropic, openai-chat, openai-responses, gemini.
input_tokenscomparison (>200k, <=4k, ==3)—Estimated input tokens.
max_tokenscomparison (>200k, <=4k, ==3)—The request’s max_tokens. A request without one never matches.
tool_countcomparison (>200k, <=4k, ==3)—Number of tools offered.
cachebool—Whether the request uses the prompt cache.
toolsbool—Whether the request offers tools.
imagebool—Whether the request contains an image.
thinkingbool—Whether extended thinking is on.
streambool—Whether the response is streamed.
intentstring or list of strings—A client helper request: assistant_internal for any of them, or one class (titling). Only classes set to route in client_probes reach routing.
provider_would_bestring or list of strings—The upstream routing chose. Such a rule is evaluated after routing, may only set or deny, and cannot have to.

A comparison starts with >, >=, <, <= or ==, and the number may end in k or m: ">200k", "<=4k". Without an operator it is an error, not an equality: "200k" alone is refused.

routes[].rules[].set#

FieldTypeDefaultDescription
modelstring—Send a different model. The prompt cache of the session is lost.
max_tokensinteger—Replace max_tokens.
thinkingbool—Turn extended thinking on or off.
only_at_session_startboolfalseApply only when a session starts. Recorded and shown; not in effect yet.
groups:
  - name: fast
    type: url-test
    providers: [anthropic, relay]

routes:
  - name: default
    rules:
      - name: long context goes to the official API
        when: { input_tokens: ">200k" }
        to: anthropic
      - name: titles go to the cheap model
        when: { intent: titling }
        set: { model: claude-haiku-4-5 }
      - name: everything else
        to: fast
default_route: default

Environment variables#

VariableEffect
THINKWATCH_HOMEData directory, instead of ~/.thinkwatch (%APPDATA%\ThinkWatch on Windows).
TWCORE_LOGLog filter, in tracing syntax (info, debug, tw_gateway=debug).
HTTPS_PROXY, HTTP_PROXY, ALL_PROXY, NO_PROXYUsed by upstreams with proxy: system.
Any otherRead where the configuration writes ${NAME}.

This page is published from docs/config.md in the ThinkWatch Core repository, at v0.56.0.