Installation

We recommend installing LLM-ATC and the Skypilot dependency in a conda environment.

# create a fresh environment
$ conda create -n "sky" python=3.10
$ conda activate sky

# install llm-atc
$ pip install llm-atc

# For Macs, macOS >= 10.15 has a conflict with grpcio
$ pip uninstall grpcio; conda install -c conda-forge grpcio=1.43.0 --force-reinstall

Installation from Source

$ git clone https://github.com/Trainy-ai/llm-atc.git
$ pip install -e llm-atc

Cloud Credentials

Cloud authentication is handled through SkyPilot. Cloud account setup on SkyPilot

Below is an example of how to authenticate AWS and GCP.

# AWS credentials
$ pip install boto3
$ aws configure

# GCP credentials
$ pip install google-api-python-client
$ conda install -c conda-forge google-cloud-sdk
$ gcloud init
# run if there's no credentials file
$ gcloud auth application-default login

# See which clouds are enabled
$ sky check