We recommend you try the GLUE Benchmark model in a Jupyter notebook (can run on Google’s Colab): NeMo/tutorials/nlp/GLUE_Benchmark.ipynb.
Connect to an instance with a GPU (Runtime -> Change runtime type -> select GPU for the hardware accelerator).
An example script on how to train the model can be found here: NeMo/examples/nlp/glue_benchmark/glue_benchmark.py.