Hpu_backend not found on torch.compile

Sayantan_S · July 9, 2024, 4:07am

torch.compile support is new. Lets make sure it is running in your setup by trying this example:

HabanaAI/Model-References/blob/1.15.1/PyTorch/examples/computer_vision/hello_world/mnist.py#L55


      
                      x = self.fc1(x)
                      x = F.relu(x)
                      x = self.dropout2(x)
                      x = self.fc2(x)
                      output = F.log_softmax(x, dim=1)
                      return output
          
          
          def train(args, model, device, train_loader, optimizer, epoch):
              model.train()
              if args.use_torch_compile:
                  model = torch.compile(model,backend="hpu_backend")
          
              def train_function(data, target):
                  optimizer.zero_grad()
                  output = model(data)
                  loss = F.nll_loss(output, target)
                  loss.backward()
                  optimizer.step()
                  return loss

ie, run the mnist example with --use_torch_compile. You also probably have to add PT_HPU_LAZY_MODE=0 to get across this assert: Model-References/PyTorch/examples/computer_vision/hello_world/mnist.py at 1.15.1 · HabanaAI/Model-References · GitHub

Topic		Replies	Views
A question about how to use "wrap_in_hpu_graph" Inference pytorch	3	651	April 25, 2023
AttributeError: module 'habana_frameworks.torch.hpu' has no attribute 'wrap_in_hpu_graph PyTorch	4	92	January 19, 2025
PyTorch model works on CPU/CUDA but not on HPU Training pytorch	5	1732	January 19, 2022
AttributeError : 'HabanaParameterWrapper' object has no attribute 'change_device_placement' Training pytorch	6	121	October 23, 2024
SyncBatchNorm Error PyTorch	5	325	March 21, 2024

Hpu_backend not found on torch.compile

Related topics