GPUs, hardware and colocation

Running AI privately means making hardware decisions: which GPUs, how many, bought or rented, in your building, in a colocation facility or in a confidential cloud. Get it wrong and you overpay by six figures, or end up with machines that can't do confidential computing at all. We help you figure out the right hardware for your needs, the deployment type that fits your threat model, and the option that fits your budget. Then we source it, set it up and, if you want, run it.

Hardware and deployment plan: $4,900 fixed, 1 week

Also included in every Sovereignty Audit.

Workload sizing. Which models and workloads you'll run, at what concurrency and context length, plus the latency and throughput you need
Hardware recommendation. GPU class and count, memory, CPUs with confidential-computing support (AMD SEV-SNP, Intel TDX), networking and storage
Deployment fit. On-prem, colocation, confidential cloud or hybrid, compared against your threat model and residency rules (see Deployment models)
Budget options. Buy vs. lease vs. cloud, compared on 3-year total cost of ownership, with a "good / better / best" set of configurations
Security requirements for the hardware: confidential-computing capability, firmware and attestation support, and supply-chain checks

The plan fee is credited toward sourcing or a build signed within 60 days.

GPU and server sourcing

Procurement of GPUs, servers, networking and storage through our supplier network, with transparent pricing: hardware at quoted cost plus a disclosed sourcing fee
New or certified refurbished, depending on budget and support needs
Supply-chain verification: serial and firmware checks, confidential-computing capability confirmed before shipping
Burn-in and acceptance testing (stress, thermals, memory and interconnect), plus an attestation check on every machine
Delivery to your site or to a colocation facility in the jurisdiction you choose

Colocation

Owning the hardware without running a data center:

We place your machines in a professional data center in the country or region you need, so data residency is decided by where the rack physically is
Setup: racking, power, cooling, private networking, out-of-band management and WireGuard links back to your offices and clouds
Your hardware, your keys. The machines are yours and the disks are encrypted with your keys. Where supported, workloads run in confidential VMs, so even facility staff with physical access to the rack can't read memory. Physical attacks remain out of scope, and we say so.
Remote hands and monitoring, under a managed plan if you want us to operate it

Colocation space, power and bandwidth are billed at cost, plus management under your managed plan.

When the cloud is the better answer

Sometimes it is: spiky workloads, short projects, or no capital budget. Then we'll recommend confidential cloud capacity and size it for you. Our advice is the same whether or not we sell you hardware.

Book a free call and bring your workload, and your budget if you have one.