Jais#
Jais is an Arabic-English bilingual language model from Inception (formerly G42/Inception AI), trained on a large Arabic and English corpus.
Task |
Text Generation |
Architecture |
|
Parameters |
13B – 30B |
HF Org |
Available Models#
jais-30b-chat-v3: 30B
jais-30b-v3: 30B base
jais-13b-chat: 13B
jais-13b: 13B base
Architecture#
JAISLMHeadModel
Example HF Models#
Model |
HF ID |
|---|---|
Jais 13B |
|
Jais 13B Chat |
|
Jais 30B v3 |
|
Jais 30B Chat v3 |
Try with NeMo AutoModel#
Install NeMo AutoModel and follow the fine-tuning guide to configure a recipe for this model.
1. Install (full instructions):
pip install nemo-automodel
2. Clone the repo to get example recipes you can adapt:
git clone https://github.com/NVIDIA-NeMo/Automodel.git
cd Automodel
3. Fine-tune by adapting a base LLM recipe — override the model ID on the CLI:
automodel --nproc-per-node=8 examples/llm_finetune/llama3_2/llama3_2_1b_squad.yaml \
--model.pretrained_model_name_or_path <MODEL_HF_ID>
Replace <MODEL_HF_ID> with the model ID from Example HF Models above.
Run with Docker
1. Pull the container and mount a checkpoint directory:
docker run --gpus all -it --rm \
--shm-size=8g \
-v $(pwd)/checkpoints:/opt/Automodel/checkpoints \
nvcr.io/nvidia/nemo-automodel:26.02.00
2. The recipes are at /opt/Automodel/examples/ — navigate there:
cd /opt/Automodel
3. Fine-tune:
automodel --nproc-per-node=8 examples/llm_finetune/llama3_2/llama3_2_1b_squad.yaml \
--model.pretrained_model_name_or_path <MODEL_HF_ID>
See the Installation Guide and LLM Fine-Tuning Guide.
Fine-Tuning#
See the LLM Fine-Tuning Guide.