T5

T5 is Google’s encoder-decoder text-to-text transformer family.

Example Model and Recipe

Run the Recipe

$
uv run automodel --nproc-per-node=8 examples/llm_finetune/t5/t5_small_squad.yaml

See the Installation Guide and LLM Fine-Tuning Guide.