Cloud & Architecture · Paid
Replicate
Replicate is a cloud platform for running machine learning models through an API. It hosts thousands of public models contributed by the community and by model makers, including image, video, speech and language models, and it lets developers deploy their own private models packaged with Cog, Replicate's open-source tool for containerizing models.
Who it is for: developers who want to call an existing model with a few lines of code, prototype with many models quickly, or host a custom or fine-tuned model behind an API without operating GPU servers.
How it works: each model has a versioned API. Replicate scales instances up when requests arrive and down to a minimum count, zero by default, when demand falls. Its billing documentation says setting up an instance can take a few seconds while weights download, and an instance goes idle for a few minutes after a gap in requests before shutting down. Deployments let you set minimum and maximum instances and the hardware for a model.
Pricing type: pay-as-you-go. Billing depends on the model. Some public models are priced per output, for example per image or per million tokens, and others by hardware time. For public models you pay only for the time a model is actively processing your request; setup and idle time are free. Most private models run on dedicated hardware, so you pay for all the time an instance is online, including setup and idle time, except fast booting fine-tunes, which are billed only while active. As of November 11, 2026, Replicate's pricing page lists hardware such as the Nvidia T4 at $0.81 per hour, L40S at $3.51 per hour, A100 80 GB at $5.04 per hour and H100 at $5.49 per hour, with multi-GPU configurations available and some larger capacity tied to committed spend contracts. Enterprise plans add volume discounts, higher GPU limits and performance SLAs.
Alternatives: Modal, Runpod Serverless, Baseten, Hugging Face Inference Endpoints, and per-token model APIs such as Cloudflare Workers AI.
Official site: https://replicate.com
