Operating systems

Latitude.sh provides a variety of Operating systems that you can use to create your servers, such as Windows and Linux distributions. You can find all supported operating systems by going to the server create page or through the following API request.

curl --request GET \
     --url https://api.latitude.sh/plans/operating_systems \
     --header 'Authorization: Bearer <API_KEY>'

ML-in-a-Box

ML-in-a-Box is a custom image built by Latitude.sh that you can use to get started quickly with any of the GPU servers available. This image comes with several dependencies needed for Machine Learning and AI workloads and is automatically selected when you are deploying a GPU server and select Ubuntu as the Operating System.

The versions of the installed dependencies are optimized for compatibility and might not be the latest versions available.

DependencyVersion
Python3.10
NVIDIA CUDA12.1
NVIDIA Driver530.30.02
NVIDIA Container Toolkit1.14.2
NVIDIA cuDNN8.9.3.28
Docker24.0.6
PYTorch2.1.0+cu121

Custom images

Installing your own images is supported through iPXE scripts. Go to Custom image (iPXE) to learn more.