Skip to content

Usage ​

This page is now several:

Single machine ​

Now on Quickstart.

Multi-machine ​

Now on Multi-machine setup.

Chat (OpenAI-compatible) ​

Now on Chat.

Local multimodal run ​

Now on Chat › From the command line.

Common flags ​

Now on CLI reference.

GPU troubleshooting ​

Now on Troubleshooting.

Free to run · Proprietary