bridge.recipes.llama.llama2

Module Contents

Functions

llama2_7b_pretrain_config

Return a pre-training config for Llama-2 7B.

API

bridge.recipes.llama.llama2.llama2_7b_pretrain_config() → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for Llama-2 7B.

Recommended parallelism: TP=2, PP=1.