Contents

Welcome to LLM ATC’s documentation!

Welcome to LLM ATC’s documentation!

Trainy

Star Watch Fork

LLM finetuning and serving in cloud

LLM-ATC is a tool for finetuning and serving open source large language models (LLMs).

LLM-ATC is multi-cloud with one interface.

  • Finetune on any cloud (AWS, Azure, GCP, Lambda Cloud, IBM, Samsung, OCI, Cloudflare).

  • Serving supported on (AWS, GCP). [More clouds in development!]

  • Models saved to object store (e.g. S3, GCS) for access anywhere.

  • Model registry for serving custom finetuned models

Documentation

Quickstart

next

Installation