Fixes for the following issues will be released shortly:
Evaluation for GPT has been tested for PP <=2 and may have issues for PP >2. It is recommended to convert to TP only for Evaluation.
Data preparation for GPT models cannot proceed due to the inability to access The Pile dataset. There are alternative datasets available online.
Some packages in the container with known CVEs will be updated.