Reference

Brev for GPU Dev Environments! 🤙

This page is documentation for Brev GPU dev environments. Brev can help save money on GPUs by:

  1. Automatically shutting down the instance after 3 hours of inactivity. All uncommitted work is saved and can be easily resumed.

  2. Enabling your dev environment to change instances. You can start on a very cheap 2x4 and only move to a GPU instance when you need it, and back down to a CPU-only instance using the brev scale command or through the UI.


Getting Started

To start using Brev GPU dev environments, upgrade your CLI to the latest (or install it)

brew install brevdev/homebrew-brev/brev

To install

brew upgrade brevdev/homebrew-brev/brev

How to upgrade or downgrade your dev environment

Using the CLI:

Run brev scale with the instance you want to scale up or down to. Use the --gpu or --cpu flag accordingly.

For example, to scale to a g5g.xlarge GPU instance, run:

brev scale brev-environments-ui --gpu g5g.xlarge

To scale into a 2x8 CPU instance, run:

brev scale brev-environments-ui --cpu 2x8

See below for available instance types

Using the UI:

  1. From the console, click on your dev environment to go to the environment settings page

    img
  2. Click on the "Machine Settings" tab to change the instance type

    img
  3. Click on GPU or CPU to see the different instance types

    img
  4. Once the new instance is selected, click Deploy Changes and hang tight while it updates

    img

CPU instance types

Instance NameCPUmem
2x222
2x424
2x828
4x16416
8x32832

GPU instance types

Instance NameGPUvCPUmemGPUMem
gpu_1x_a101xA103020024
gpu_1x_a100_sxm41xA1003020040
gpu_8x_a100_sxm48xA1001241800320
p4d.24xlarge8xA100961152320
p3.2xlarge1xV10086116
p3.8xlarge4xV1003224464
p3.16xlarge8xV10064488128
p3dn.24xlargeV10096768256
p2.xlarge1xK8046112
p2.8xlarge8xK803248896
p2.16xlarge16xK8064732192
g5.xlarge1xA10G41624
g5.2xlarge1xA10G83224
g5.4xlarge1xA10G166424
g5.8xlarge1xA10G3212824
g5.16xlarge1xA10G6425624
g5.12xlarge4xA10G4819296
g5.24xlarge4xA10G9638496
g5.48xlarge8xA10G192768192
g5g.xlarge1xT4g41616
g5g.2xlarge1xT4g83216
g5g.4xlarge1xT4g166416
g5g.8xlarge1xT4g3212816
g5g.16xlarge2xT4g6425632
g5g.metal2xT4g12851232
g4dn.xlarge1xT441616
g4dn.2xlarge1xT483216
g4dn.4xlarge1xT4166416
g4dn.8xlarge1xT43212816
g4dn.16xlarge1xT46425616
g4dn.12xlarge2xT44819264
g4dn.metal8xT496384128
g2.2xlarge1xK5208154
g2.8xlarge4xK520326016
g4ad.xlarge1xV5204168
g4ad.2xlarge1xV5208328
g4ad.4xlarge1xV52016648
g4ad.8xlarge2xV5203212816
g4ad.16xlarge4xV5206425632
g3s.xlarge1xM60430.58
g3.8xlarge2xM603224416
g3.16xlarge4xM606448832
Previous
Home