Something similar to CUDA_VISIBLE_DEVICES

Training
1

Hello there,

I hope everybody is doing great, is there a way to “hide” HPU devices similar to CUDA_VISIBLE_DEVICES?

Thanks,

Cheers,

Fra

2

Please refer to this doc.

3

Thanks a lot, I’ve tried it but it doesn’t seem to do the trick

import os

os.environ["HABANA_VISIBLE_DEVICES"] = "0,1"

print(hpu.device_count()) # prints 8
4

Thanks @Fra_Zuppi, will take a look and get back to you.

1 Like
5

Hey @Sayantan_S , any luck? :slight_smile:

6

Can you using -e HABANA_VISIBLE_DEVICES=6,7 --runtime=habana in your docker command and try hl-smi and see if you have 2 visible cards

7

This solution is for running the container, but how can we select the device within the container? In other words, how to select the device within the container?

8

Here is a reference

One can use HABANA_VISIBLE_DEVICES to create a docker that is limited to certain cards, and inside the docker one can use HABANA_VISIBLE_MODULES to select from cards available within that docker