How to run Dalai/Alpaca on Brev

In this guide, we show you how you can run Dalai out of the box with Brev. We've pre-configured the environment so everything is ready to go...

Dalai is a model that let's you run the Stanford Alpaca model and comes with a nice UI.

To get started, hit this link to create a new Brev environment

We've preset it with the config you will need.

1) Open your remote environment in VSCode

brev open dalai --wait

If you don't have the Brev CLI, you can install it here

2) Run the server:

./dalai serve

Head over to localhost:3000 to see the UI. VSCode should automatically forward the port to your local machine. If not, go to the ports tab and forward port 3000.