Reference

Brev for GPU Dev Environments! 🤙

This page is documentation for Brev GPU dev environments. Brev can help save money on GPUs by:

  1. Automatically shutting down the instance after 3 hours of inactivity. All uncommitted work is saved and can be easily resumed.

  2. Enabling your dev environment to change instances. You can start on a very cheap 2x4 and only move to a GPU instance when you need it, and back down to a CPU-only instance using the brev scale command or through the UI.


Getting Started

To start using Brev GPU dev environments, upgrade your CLI to the latest (or install it)

brew install brevdev/homebrew-brev/brev

To install

brew upgrade brevdev/homebrew-brev/brev

How to upgrade or downgrade your dev environment

Using the CLI:

Run brev scale with the instance you want to scale up or down to. Use the --gpu or --cpu flag accordingly.

For example, to scale to a g5g.xlarge GPU instance, run:

brev scale brev-environments-ui --gpu g5g.xlarge

To scale into a 2x8 CPU instance, run:

brev scale brev-environments-ui --cpu 2x8

See below for available instance types

Using the UI:

  1. From the console, click on your dev environment to go to the environment settings page

    img
  2. Click on the "Machine Settings" tab to change the instance type

    img
  3. Click on GPU or CPU to see the different instance types

    img
  4. Once the new instance is selected, click Deploy Changes and hang tight while it updates

    img

CPU instance types

Instance NameCPUmem
2x222
2x424
2x828
4x16416
8x32832

GPU instance types

Instance NameGPUvCPUmemGPUMem
p4d.24xlarge8961152320
p3.2xlarge186116
p3.8xlarge43224464
p3.16xlarge864488128
p3dn.24xlarge896768256
p2.xlarge146112
p2.8xlarge83248896
p2.16xlarge1664732192
g5.xlarge141624
g5.2xlarge183224
g5.4xlarge1166424
g5.8xlarge13212824
g5.16xlarge16425624
g5.12xlarge44819296
g5.24xlarge49638496
g5.48xlarge8192768192
g5g.xlarge18416
g5g.2xlarge116816
g5g.4xlarge1321616
g5g.8xlarge1643216
g5g.16xlarge21286432
g5g.metal21286432
g4dn.xlarge141616
g4dn.2xlarge183216
g4dn.4xlarge1166416
g4dn.8xlarge13212816
g4dn.16xlarge16425616
g4dn.12xlarge44819264
g4dn.metal896384128
g4ad.xlarge14168
g4ad.2xlarge18328
g4ad.4xlarge116648
g4ad.8xlarge23212816
g4ad.16xlarge46425632
g3s.xlarge1430.58
g3.4xlarge1161228
g3.8xlarge23224416
g3.16xlarge46448832
Previous
Home