Custom deployments

Articles

9 September 2026

Static IP and DNS for GPU inference endpoints

Enterprises often ask an AI provider for a static IP, a network address that never changes, so they can write a firewall rule for it. Most managed inference endpoints don't have one, because the provider moves servers. A firewall rule on the provider's hostname, plus an API key, does the same job and keeps working when the address changes. Separately, if your company traffic runs through a proxy, turn on streaming for long answers, or the proxy may cut them off.

18 April 2026

Host fine-tuned model production APIs: a technical guide

Teams with several fine-tuned versions of one model often give each version its own GPU, and pay for five GPUs where one would do. The fix: load the base model once and serve each version as a small add-on file, a LoRA adapter. Five full copies of a 27-billion-parameter model need five 80 GB GPUs, while one base model with five adapters fits on one. On Lyceum, our fine-tuning (in early access) trains the adapter on GLM-5.3 Flash or Qwen3.8 27B in Europe and serves it per token, so only the model name in your code changes.

17 April 2026

Deploying private LLM endpoints on GPU cloud: a 2026 strategy

Some teams want a language model behind their own address, on GPUs reserved only for them. There are two ways to get one: deploy a Hugging Face model as a dedicated endpoint and let the provider run it, or run your own container on a rented GPU machine and run it yourself. Both accept OpenAI-style requests, so your code only changes its address and key. On Lyceum both run in European data centres, and dedicated endpoints pause after an idle hour, so you don't pay overnight.

16 April 2026

Deploying Llama 3 inference APIs on sovereign GPU clouds

Teams that want Llama 3 as their own API often pick GPUs by whether the model fits, then find it answers only one or two requests at a time. The GPUs need memory for the model and for every request it handles at once. So size them by the memory left after the model: Llama 3.1 8B fits on one 80 GB GPU, while Llama 3.1 70B needs 140 GB for the model alone. On Lyceum you deploy Llama 3 on a dedicated endpoint from its Hugging Face name, on GPUs in Europe, and an endpoint idle for an hour stops billing.

Your next workload starts here