Skip to content

Cloud & Architecture · Paid

Google Cloud Spot VMs

Google Cloud Spot VMs are Compute Engine virtual machines that run on Google's excess capacity at a steep discount, in exchange for the possibility that Compute Engine preempts (stops or deletes) them at any time to reclaim that capacity. They are the latest version of Google's preemptible VMs and have no minimum or maximum runtime unless you set a limit yourself.

Who it is for: teams running fault-tolerant or restartable workloads, such as batch inference, embedding backfills, offline evaluations, data processing, CI jobs and stateless services that sit behind a load balancer with enough spare replicas. They are a poor fit for anything that cannot lose a machine without warning.

Key features: - Google says Spot prices give discounts of up to 91% off the on-demand price for many machine types, GPUs, TPUs and Local SSDs. Spot prices can change up to once a day. - GPUs can be attached to Spot VMs at Spot prices. Google recommends requesting dedicated preemptible GPU quota so Spot usage does not consume standard quota. - A configurable preemption notice duration: 0 seconds (the default, with a short best-effort shutdown period for a shutdown script) or 120 seconds, during which your workload can watch the preempted metadata value and drain itself. - A termination action of STOP (default) or DELETE. - Managed instance groups can recreate preempted VMs automatically and, with instance flexibility, favor machine types with lower observed preemption rates. - No charge for Spot VMs, GPUs or Local SSDs that are preempted within the first minute after they start.

Limitations: Spot VMs are not covered by any service level agreement and are excluded from the Compute Engine SLA. Spot VMs with GPUs are preempted during maintenance events and cannot be automatically restarted, and availability varies by zone, time and resource. Some machine series, such as A4X, are not supported.

Pricing type: paid, usage-based, at variable Spot rates listed on Google's Spot VMs pricing page.

Alternatives: standard on-demand Compute Engine VMs, resource-based committed use discounts (one- or three-year terms that include GPUs), future reservations in calendar mode for GPU capacity on a set date, Amazon EC2 Spot Instances and Azure Spot Virtual Machines.

Official URL: https://cloud.google.com/compute/docs/instances/spot

Official site