Installation¶

Install with pip¶

ScaleLLM is available as a Python Wheel package on PyPI. You can install it using pip:

# Install scalellm with CUDA 12.1 and Pytorch 2.3
$ pip install scalellm

If you want to install ScaleLLM with different version of CUDA and Pytorch, you can pip install it with provding index URL of the version.

$ pip install scalellm -i https://whl.vectorch.com/cu121/torch2.1/

$ pip install scalellm -i https://whl.vectorch.com/cu121/torch2.2/

$ pip install scalellm -i https://whl.vectorch.com/cu121/torch2.3/

$ pip install scalellm -i https://whl.vectorch.com/cu118/torch2.1/

$ pip install scalellm -i https://whl.vectorch.com/cu118/torch2.2/

$ pip install scalellm -i https://whl.vectorch.com/cu118/torch2.3/

$ curl -L

$ git clone

$ curl -L

$ git clone