Posted August 16, 2023 by bfirsh Here’s what’s changing:

We’re cutting the per-second price of public models in half. This is going to be applied to all your usage this month, on all public models, from SDXL to Llama 2, and requires no action on your part. Wahey! 🎉

Soon, we’ll be cutting the per-second price of private models in half, but we’ll also start charging for setup and idle time. This change will just be for new users. For existing users, this change is opt-in, so you’re not going to pay more.

Here are the prices:

HardwareBeforeAfterCPU$0.000200 per second$0.000100 per second ($0.36 per hour)Nvidia T4$0.000550 per second$0.000225 per second ($0.81 per hour)Nvidia A40$0.001300 per second$0.000575 per second ($2.07 per hour)Nvidia A100 (40GB)$0.002300 per second$0.001150 per second ($4.14 per hour)Nvidia A100 (80GB)$0.003200 per second$0.001400 per second ($5.04 per hour)