DL Final Project

Install optimaizer frome souce

git clone https://github.com/zhanglejun02/DL-Fall-25-Final-Project.git
pip install -e .

Install experiment dependencies

pip install -r exp_requirements.txt

Usage

More details can be found in torchrun_main.py. Our experiment scripts are tested on Python 3.8 with PyTorch 2.1.

Fine-Tuning RoBERTa on GLUE tasks

bash run2.sh

change the task name to test different tasks