1. Setting up Anyway

Anyway (anyd) must be running on every GPU machine you want to manage.

Start Anyway

anyd [--port=9100]
Info: It listens on port 9100 by default. You can change this with the --port flag. Once running, it will accept commands from the Control Manager.

2. Setting up Anyway Control Manager

Anyway Control Manager (any-cm) can run on a machine with or without GPU. It serves a browser-based User Interface that you use to manage your machine cluster.

Start the Control Manager

any-cm [--port=3000]
Info: It runs on port 3000 by default. You can change this with the --port flag. The dashboard is accessible from any browser at http://<control-manager-ip>:3000. The Control Manager (any-cm) communicates with each Anyway process (anyd) running your machines.
First run: On the very first start, an admin account, with user name admin and a random admin password is generated and printed to the console. Copy it before closing the terminal, you will need it to log in. You will be prompted to change it immediately after your first login.

3. Logging in

Open your browser and navigate to http://<control-manager-ip>:3000. You will be greeted by the login screen.

The Anyway Control Manager login page.

Use admin as the username and the password that was printed to the console when you first started any-cm. After logging in you will be asked to set a new permanent password.

First-login password change prompt.

You have now access to the controle manager.

First view of the control manager

4. Adding Machines

Before deploying any model, you need to register your GPU machines with the Control Manager. Each machine must be running anyd (see step 1).

1 In the dashboard, click on the Machines icon in the left sidebar, then click on in the top right corner.
The Machines panel.
2 Provide the IP address of the machine. The system will try to connect. If the connection succeed you will be able to add it.
Machine registration form.

After adding your machines, they appear on the Machine view as follows (in the following screenshot, the IP addresses have been anonymized).

The Machines panel.
Info: You can add as many machines as needed. The Control Manager tracks available VRAM across all machines in real time and uses this information when deciding where to place new model deployments.

5. Deploying a Model

1 Click on the Deployment icon icon in the left sidebar, select the model to deploy in the list and click on deploy button .
The Models panel.

The model is deploying....

The Models panel.

Then, deployed.

The Models panel.

In the Machine Panel, you can see the model being distributed over the machine.

The Machine panel.
Info: If the model is already downloaded on the machine disks, a green checkmark icon appears. If it is not already downloaded, you can click on the download icon to download without deploying the model. If you try to deploy a model not downloaded already it will download it automatically before deploying it.

6. Viewing Statistics

Your control manager continuously collects GPU metrics from every registered machines (updated every second). You can view live and historical data from the Statistics panel.

The Statistics panel.

7. Managing Users

The Control Manager has a built-in user management system. As an administrator you can create additional accounts for colleagues who need access to the dashboard. You can create users with admin priviledges or simple users who will not be able to add or remove machines. Simple users can simply deploy models on the available machines.

1 Click on the User management icon in the bottom of side bar.
The Users settings page.
2 You can also create a User. Click on the "Create User" button.
The Users settings page.

Need Help?

Email: contact@anyway.dev
Documentation: Additional resources and advanced configuration options available upon request.