Road Map

What we are building next. Scope and timing may still change.

  1. In progress
    • Higher inference throughput. Core
    • Lower inference latency. Core
    • Automatic scaling of deployed models to match traffic. Plus
    • Metrics and logs ready to plug into Grafana. Plus
    • API key management. Plus
    • Support for reranker models Core
  2. Planned
    • Hot-swapping of models, with offloading to system RAM.
    • Make any deployed model an expert on given data.
    • Context size adjusted automatically, with no setting to pick.
    • Parallel requests tuned automatically, with no setting to pick.
    • More efficient model loading, for faster deployments.

Release notes

How to update.

Run the following command and restart anyd and any-cm:

curl -sSL https://www.anyway.dev/install.sh | sh

How to check your version.

Use option --version with anyd or any-cm.

anyd --version

v1.2

August 17, 2026 Latest

Expanded model support and tool calling, along with per-model API keys and a refined user experience.

  • ImprovedQuantization selection is now clearer, with deployment and download choices handled separately.
  • ImprovedFaster and more reliable message flow between anyd, the Control Manager server, and the browser.
  • ImprovedModel details are now presented in collapsible sections for easier navigation.
  • AddedSupport for additional models.
  • AddedTool calling support.
  • AddedPer-model API access, disabled by default, with API Bearer token generation.
  • AddedModels can now be given a custom name.
  • AddedManual scaling of a deployed model up or down to match traffic.
  • AddedDedicated log file per endpoint, with configurable verbosity for troubleshooting.
  • AddedDocumentation link added at the bottom of the navigation bar.

v1.1

June 3, 2026

Enhanced model lifecycle and download management.

  • ImprovedModel files can now be deleted directly via the Control Manager.
  • ImprovedActive downloads can now be canceled within the Control Manager.
  • ImprovedRemoving a machine from the Control Manager is effective without waiting for a target response.
  • ImprovedMore informative error message on a machine card when the connection fails.
  • RemovedEliminated dependency on wget.
  • AddedDeployed model cards now display a "Parallel Requests" status label.
  • AddedThe Version number is now displayed in the bottom-left corner of the Control Manager.
  • AddedWhen an update is available, a link to the release notes is displayed in the notification banner.

v1.0

April 27, 2026

First public release of Anyway.

  • Added One-click model deployment, with automatic distribution and placement based on available VRAM.
  • Added Automatic model download when deploying a model that isn't yet present on the target machines.
  • Added Live and historical GPU and token generation statistics.
  • Added User management with admin and standard accounts (only admins can add/manage/remove machines).

v0.7

January 19, 2026

First private release of Anyway Beta.