Q Blocks Documentation
  • 👋Welcome to Q Blocks
  • 🌐GPU Computing at Scale
  • 💻Launch a Q Blocks GPU instance
    • Using Dashboard UI
    • Using Rest APIs
  • 💰GPU Instance Pricing
  • 🤖Fine-tuning Falcon 7B/40B LLM
  • 🔑IAM: Share access with team
  • 🤔Q Blocks How To Guide
    • Create a new user
    • Upload data using SCP command
    • Use Visual Studio Code with Q Blocks instances
    • Port forwarding to run web services
    • Launch Jupyter Hub in Q Blocks Instance
    • Launch TensorBoard in Q Blocks instance
    • Setup Horovod and OpenMPI in Q Blocks Instance
    • Setup AIM for ML experiment tracking
    • Disco Diffusion AI Art on Q Blocks
    • Stable Diffusion Text to Image GPU server on Q Blocks
    • Setup Docker with Nvidia GPU support
    • Enable port forwarding on a Docker container in Q Blocks instance
    • Run production ready lightweight kubernetes using K3s in Q Blocks instance
    • ↗️Upgrade CUDA to v12.2
Powered by GitBook
On this page
  1. Q Blocks How To Guide

Setup Horovod and OpenMPI in Q Blocks Instance

PreviousLaunch TensorBoard in Q Blocks instanceNextSetup AIM for ML experiment tracking

Last updated 1 year ago

Horovod is a free and open-source software framework for distributed deep learning training using TensorFlow, Keras, PyTorch, and Apache MXNet.

Horovod is hosted under the Linux Foundation AI.

Setting up Horovod in your Q Blocks instance is as simple as running a single bash command.

We have prepared a quick and easy to use bash script that installs and configures Horovod along with openMPI in your instance.

Horovod uses openMPI for message passing during the distributed training process.

Installation and setup will take anywhere between 5-10 minutes.

Follow the steps below for successful installation:

  1. Go to your Q Blocks instance and open the bash terminal in it.

  2. Run the following command:

wget https://www.qblocks.cloud/resources/setup-horovod.sh --no-check-certificate -O - | sh

The above command would perform the following tasks:

  • Install any missing dependencies to build OpenMPI

  • Install OpenMPI

  • Install Horovod with support NCCL, Tensorflow and PyTorch

Installation can be verified by running the command:

horovodrun --help

If you face issues with the installation then reach out to us at .

🤔
support@qblocks.cloud