Q Blocks Documentation
  • 👋Welcome to Q Blocks
  • 🌐GPU Computing at Scale
  • 💻Launch a Q Blocks GPU instance
    • Using Dashboard UI
    • Using Rest APIs
  • 💰GPU Instance Pricing
  • 🤖Fine-tuning Falcon 7B/40B LLM
  • 🔑IAM: Share access with team
  • 🤔Q Blocks How To Guide
    • Create a new user
    • Upload data using SCP command
    • Use Visual Studio Code with Q Blocks instances
    • Port forwarding to run web services
    • Launch Jupyter Hub in Q Blocks Instance
    • Launch TensorBoard in Q Blocks instance
    • Setup Horovod and OpenMPI in Q Blocks Instance
    • Setup AIM for ML experiment tracking
    • Disco Diffusion AI Art on Q Blocks
    • Stable Diffusion Text to Image GPU server on Q Blocks
    • Setup Docker with Nvidia GPU support
    • Enable port forwarding on a Docker container in Q Blocks instance
    • Run production ready lightweight kubernetes using K3s in Q Blocks instance
    • ↗️Upgrade CUDA to v12.2
Powered by GitBook
On this page
  • How to install Docker engine with GPU support?
  • How to use Docker with GPUs?
  1. Q Blocks How To Guide

Setup Docker with Nvidia GPU support

Setup time less than 5 minutes

Docker containers are currently supported on Data Center nodes only. On Consumer nodes, docker containers are supported only when rented on a monthly basis.

Docker is a tool designed to make it easier to create, deploy, and run applications by using containers.

To run docker containerized applications inside your Q Blocks instance you'd need the docker engine to be installed correctly with Nvidia GPU support.

How to install Docker engine with GPU support?

Follow the steps below for successful installation:

  1. Go to your Q Blocks instance and open the bash terminal in it.

  2. Run the following command:

wget 'https://www.qblocks.cloud/resources/setup-docker-gpu.sh' --no-check-certificate -O - | bash

It should take 2-3 minutes of installation time and should return the following output:

"SUCCESSFULLY INSTALLED DOCKER WITH GPU SUPPORT."

How to use Docker with GPUs?

Once you have installed docker engine with GPU support in your Q Blocks instance, running a GPU enabled docker container is fairly straightforward.

For example, if you have 4 GPUs in your instance and you plan to use the first 2 GPUs out of them for a docker Image then simply run a command like this in your instance:

docker run --runtime=nvidia -e NVIDIA_VISIBLE_DEVICES=0,1 -it DOCKER_IMAGE
PreviousStable Diffusion Text to Image GPU server on Q BlocksNextEnable port forwarding on a Docker container in Q Blocks instance

Last updated 1 year ago

🤔