deploy_container.ipynb
you will need to input two things: 1. Your Shadeform API Key from here, and 2. A huggingface_token
if the model you need is gated (like Llama2 or Gemma).
The notebook kicks off a VM request and runs the container specifically on a 1xA6000 Machine which are quite afforable on our platform. The container will download the model and run the benchmark for us.
The notebook leverages a lot of the principles found in this guide for using the platform to find affordable GPU’s.
ssh
into the instance by leveraging this ip address and our shadeform .pem
file.
-a
flag is if it has already finished.