Run on GPU

[chiragagarwal1999]

Can this model run on GPU? If yes, how do i connect my GPU to it

[senwu]

Yes, if you use transformers package here is one note: https://huggingface.co/docs/transformers/perf_infer_gpu_one