Want to Run vLLM on a New 50 Series GPU?

5 months ago
7

No need to wait for a stable release. Instead, install vLLM from source with PyTorch Nightly cu128 for 50 Series GPUs. Same steps can help for any GPU that's not supported out of the box.

Loading 2 comments...