Retry, Timeout, Circuit Breakers for LLM APIs
Wrap every model HTTP call with timeouts, jittered retries, and a circuit breaker so one slow provider cannot stall every agent process on the box.
NetBay journal
Practical guides for Linux, containers, CI/CD, self-hosting, and running VPS infrastructure from Netbay Engineering.
499 articles · 24 topics
Wrap every model HTTP call with timeouts, jittered retries, and a circuit breaker so one slow provider cannot stall every agent process on the box.
Organize workloads with namespaces and keep them from starving the node using resource requests and limits and ResourceQuota.
Move build outputs between pipeline stages correctly while keeping dependencies cached and artifacts immutable.
Write JSON logs from Node to stdout, let systemd capture them in journald, and query a single stream instead of rotating application log files.
Use ping, traceroute, and mtr to diagnose network latency and packet loss on a Linux VPS, and interpret the results correctly.
The honest picture of Gentoo on a small VPS: profile defaults, a USE budget, MAKEOPTS that match your cores, and binary packages when it matters.
RPM quietly records files on your RHEL-family server. Learn to query ownership, verify file integrity, and extract package contents without installing them.
Test database migrations in CI — against real databases, in order, with rollbacks — so schema changes do not break production at deploy.
Put PgBouncer in front of PostgreSQL 16 so app workers share a small pool of backends instead of opening one backend process per HTTP request.
Tune TLS 1.2 and 1.3 plus ciphers for nginx without cargo-cult SSL Labs chasing, and read a test grade as a checklist rather than a trophy hunt.
Hard bounces must suppress the address. Soft bounces may retry with a cap. Infinite queues hurt IP reputation and hide dead users in your app.
Split sshd policy with Match User, Group, and Address so git, sftp, humans, and CI automation stop sharing one global sshd_config on the VPS.