bridge.recipes.llama.h100.llama2

Module Contents

Functions

llama2_7b_pretrain_2gpu_h100_bf16_config

Return a pre-training config for Llama-2 7B.

Data

__all__

API

bridge.recipes.llama.h100.llama2.llama2_7b_pretrain_2gpu_h100_bf16_config() → megatron.bridge.training.config.ConfigContainer

Return a pre-training config for Llama-2 7B.

Recommended parallelism: TP=2, PP=1.

bridge.recipes.llama.h100.llama2.__all__

[‘llama2_7b_pretrain_2gpu_h100_bf16_config’]