1. Installation

Run the following command: 

curl -sSL https://www.anyway.dev/install.sh | sh

The two binaries anyd and any-cm are installed in .local/bin/anyway.

To check the installed version: 

anyd --version
any-cm --version

2. Running Anyway

The Anyway daemon (anyd) must be running on every GPU machine you want to manage. To start it, run the following command: 

anyd

Supported options:

Option Description
--port=<number> Port to listen on (default: 9100)
--logfile=<path> Redirect all output to the given log file
--verbose[=level] Load balancer logging, written to endpoint.log in the data directory: 0 = only failed requests (default when the option is not used), 1 = every incoming request (default when the option is used without a level), 2 = also the internal model status checks.
--version Show version and exit
--help Show how the command is used with its options, and exit
Info: Once running, the daemon accepts commands from the Control Manager.

3. Running the Control Manager

The Anyway Control Manager (any-cm) can run on a machine with or without a GPU. It serves the browser-based interface you use to manage your cluster.

With HTTPS:

any-cm  --cert=c.cert --key=k.key

Or without HTTPS:

any-cm  --no-https

Supported options:

Option Description
--cert=<path> Path to SSL certificate (required unless --no-https)
--key=<path> Path to SSL private key (required unless --no-https)
--no-https Run without HTTPS (plain HTTP)
--port=<number> Port to listen on (default: 3000)
--logfile=<path> Redirect all output to the given log file
--version Show version and exit
--help Show how the command is used with its options, and exit
Info: The dashboard is accessible from any browser at http://<control-manager-ip>:<port>. The Control Manager (any-cm) communicates with each Anyway process (anyd) running on your machines.
First run: On the very first start, an administrator account is created with the user name admin and a randomly generated password, which is printed to the console. Copy this password before closing the terminal, as you will need it to log in. You will be prompted to change it immediately after your first login.

4. Logging in

Open your browser and navigate to http://<control-manager-ip>:3000. You will be greeted by the login screen.

The Anyway Control Manager login page.

Use admin as the username and the password that was printed to the console when you first started any-cm. After logging in you will be asked to set a new permanent password.

First-login password change prompt.

You now have access to the Control Manager.

First view of the Control Manager.

5. Adding Machines

Before deploying any model, you need to register your GPU machines with the Control Manager. Each machine must be running anyd (see step 2).

1 In the dashboard, click on the Machines icon in the left sidebar, then click on in the top right corner.
The Machines panel.
2 Provide the IP address or the hostname of the machine.
Machine registration form.

Once added, your machines appear in the Machines view as shown below (the IP addresses in this screenshot have been anonymized).

The Machines panel.
Info: You can add as many machines as needed. The Control Manager tracks available VRAM across all machines in real time and uses this information when deciding where to place new model deployments.

6. Deploying a Model

1 Click on the Deployment icon in the left sidebar to display the list of all models available for download and deployment.
The Models panel.
2 Download the model at the quantization level of your choice.
The Models panel.

Clicking on a quantization level starts the download:

The Models panel.

Once the download completes, the quantization is listed as available:

The Models panel.
3 Select the model you want to deploy from the list, then click the deploy button .
The Models panel.

The model is being deployed:

The Models panel.

Then deployed, and loading the model weights:

The Models panel.

And finally, operational:

The Models panel.

Click on a model to expand its details. This panel shows the quantization level, the context length, the maximum number of parallel requests allowed, and the authentication settings (whether the model requires an API key):

The Models panel.

Use the toggle to enable authentication. An API key (bearer token) is then generated, which you can copy or regenerate at any time. Regenerating a key immediately invalidates the previous one and cannot be undone.

The Models panel.
Info: If you deploy a model that has not been downloaded yet, you are prompted to select a quantization level, and the model is downloaded automatically before deployment. Click the bin icon on a downloaded or downloading model to remove its files from the disk.

7. Viewing Statistics

Your Control Manager continuously collects GPU metrics from every registered machine (updated every second). You can view live and historical data from the Statistics panel.

The Statistics panel.

8. Managing Users

The Control Manager has a built-in user management system. As an administrator you can create additional accounts for colleagues who need access to the dashboard. Accounts can be created either with administrator privileges or as standard users. Standard users can deploy models on the available machines, but cannot add or remove machines.

1 Click on the User management icon at the bottom of the sidebar.
The Users settings page.
2 To add an account, click the Create User button.
The Users settings page.

9. Updating

Updating Anyway uses the same installer as a fresh installation. Run the command below, then restart anyd and any-cm: 

curl -sSL https://www.anyway.dev/install.sh | sh

Need Help?

Email: contact@anyway.dev
Documentation: Additional resources and advanced configuration options available upon request.