datasets
hydra-core
megatron-fsdp
safetensors
torch
torchao!=0.14.0
tqdm
transformer_engine
transformers<5.0
wandb
pytest