Skip to main content

Can I run my own model on Locai One?

J
Written by James Drayson

Yes. Locai One is designed to support both Locai Juno models and other open-weight models.

During setup, administrators can choose a Juno model, select another supported open-weight model, or use their own compatible weights.

The model still needs to fit the hardware available in the appliance. Larger models require more VRAM, so the appropriate model depends on whether you are using Locai One or Locai One Pro and on the quantisation and serving configuration.

For a new deployment, use the Management Portal to select and download the model intended for the appliance.

Did this answer your question?