Reference
Brev for GPU Dev Environments! 🤙
This page is documentation for Brev GPU dev environments. Brev can help save money on GPUs by:
Automatically shutting down the instance after 3 hours of inactivity. All uncommitted work is saved and can be easily resumed.
Enabling your dev environment to change instances. You can start on a very cheap 2x4 and only move to a GPU instance when you need it, and back down to a CPU-only instance using the
brev scale
command or through the UI.
Getting Started
To start using Brev GPU dev environments, upgrade your CLI to the latest (or install it)
brew install brevdev/homebrew-brev/brev
To install
brew upgrade brevdev/homebrew-brev/brev
How to upgrade or downgrade your dev environment
Using the CLI:
Run brev scale
with the instance you want to scale up or down to. Use the --gpu
or --cpu
flag accordingly.
For example, to scale to a g5g.xlarge GPU instance, run:
brev scale brev-environments-ui --gpu g5g.xlarge
To scale into a 2x8 CPU instance, run:
brev scale brev-environments-ui --cpu 2x8
See below for available instance types
Using the UI:
From the console, click on your dev environment to go to the environment settings page
Click on the "Machine Settings" tab to change the instance type
Click on GPU or CPU to see the different instance types
Once the new instance is selected, click Deploy Changes and hang tight while it updates
CPU instance types
Instance Name | CPU | mem |
---|---|---|
2x2 | 2 | 2 |
2x4 | 2 | 4 |
2x8 | 2 | 8 |
4x16 | 4 | 16 |
8x32 | 8 | 32 |
GPU instance types
Instance Name | GPU | vCPU | mem | GPUMem |
---|---|---|---|---|
gpu_1x_a10 | 1xA10 | 30 | 200 | 24 |
gpu_1x_a100_sxm4 | 1xA100 | 30 | 200 | 40 |
gpu_8x_a100_sxm4 | 8xA100 | 124 | 1800 | 320 |
p4d.24xlarge | 8xA100 | 96 | 1152 | 320 |
p3.2xlarge | 1xV100 | 8 | 61 | 16 |
p3.8xlarge | 4xV100 | 32 | 244 | 64 |
p3.16xlarge | 8xV100 | 64 | 488 | 128 |
p3dn.24xlarge | V100 | 96 | 768 | 256 |
p2.xlarge | 1xK80 | 4 | 61 | 12 |
p2.8xlarge | 8xK80 | 32 | 488 | 96 |
p2.16xlarge | 16xK80 | 64 | 732 | 192 |
g5.xlarge | 1xA10G | 4 | 16 | 24 |
g5.2xlarge | 1xA10G | 8 | 32 | 24 |
g5.4xlarge | 1xA10G | 16 | 64 | 24 |
g5.8xlarge | 1xA10G | 32 | 128 | 24 |
g5.16xlarge | 1xA10G | 64 | 256 | 24 |
g5.12xlarge | 4xA10G | 48 | 192 | 96 |
g5.24xlarge | 4xA10G | 96 | 384 | 96 |
g5.48xlarge | 8xA10G | 192 | 768 | 192 |
g5g.xlarge | 1xT4g | 4 | 16 | 16 |
g5g.2xlarge | 1xT4g | 8 | 32 | 16 |
g5g.4xlarge | 1xT4g | 16 | 64 | 16 |
g5g.8xlarge | 1xT4g | 32 | 128 | 16 |
g5g.16xlarge | 2xT4g | 64 | 256 | 32 |
g5g.metal | 2xT4g | 128 | 512 | 32 |
g4dn.xlarge | 1xT4 | 4 | 16 | 16 |
g4dn.2xlarge | 1xT4 | 8 | 32 | 16 |
g4dn.4xlarge | 1xT4 | 16 | 64 | 16 |
g4dn.8xlarge | 1xT4 | 32 | 128 | 16 |
g4dn.16xlarge | 1xT4 | 64 | 256 | 16 |
g4dn.12xlarge | 2xT4 | 48 | 192 | 64 |
g4dn.metal | 8xT4 | 96 | 384 | 128 |
g2.2xlarge | 1xK520 | 8 | 15 | 4 |
g2.8xlarge | 4xK520 | 32 | 60 | 16 |
g4ad.xlarge | 1xV520 | 4 | 16 | 8 |
g4ad.2xlarge | 1xV520 | 8 | 32 | 8 |
g4ad.4xlarge | 1xV520 | 16 | 64 | 8 |
g4ad.8xlarge | 2xV520 | 32 | 128 | 16 |
g4ad.16xlarge | 4xV520 | 64 | 256 | 32 |
g3s.xlarge | 1xM60 | 4 | 30.5 | 8 |
g3.8xlarge | 2xM60 | 32 | 244 | 16 |
g3.16xlarge | 4xM60 | 64 | 488 | 32 |