On ARM64 VPS, you don’t need a special Linux distro, but choosing one with strong ARM support makes installation much smoother.
Ubuntu 22.04 or 24.04 ARM64 is usually the best option because almost every package in the Ubuntu repo is already precompiled for ARM, so you can install things with:
sudo apt install <package>
with no manual builds.
AlmaLinux / Rocky Linux ARM64 also work well if you prefer a RHEL-based system, but the package variety is smaller than Ubuntu.
Avoid Debian ARM64 if you want the “fast install” experience because some apps still compile from source or use older versions.
If your goal is maximum speed + availability of precompiled apps:
Go with Ubuntu ARM64
Use Docker when available (many ARM images exist now)
Enable Snap or Flatpak if an application doesn’t exist in APT
So yes you should pick a distro with mature ARM repos, and Ubuntu is usually the easiest and fastest on ARM VPS.