# SynapseAI 1.9.0 Release

**URL:** https://forum.habana.ai/t/synapseai-1-9-0-release/632
**Category:** Announcements
**Created:** [March 30, 2023, 6:35pm UTC](https://forum.habana.ai/t/synapseai-1-9-0-release/632 "2023-03-30T18:35:04Z")
**Posts on this page:** 1
**Page:** 1

<div class="post-metadata">

### Author: ![Sayantan\_S](https://avatars.discourse-cdn.com/v4/letter/s/a3d4f5/32.png) [@Sayantan\_S](https://forum.habana.ai/u/Sayantan_S)
#### Post date: [March 30, 2023, 6:35pm UTC](https://forum.habana.ai/t/synapseai-1-9-0-release/632/1 "2023-03-30T18:35:04Z")

</div>

The Habana team is happy to announce the release of SynapseAI® Software version 1.9.0.

In the 1.9 release, we’ve upgraded versions of several libraries, including PyTorch Lightning 1.9.4, DeepSpeed 0.7.7, fairseq 0.12.3, and Horovod v0.27.0.

We have added support for RHEL8 on Gaudi2; support for TensorFlow 2.8.4 is deprecated and will not be available starting this release.

Habana now provides a GPU Migration toolkit, which simplifies migrating PyTorch models that contain Python API calls with dependencies on GPU libraries (for e.g. torch.cuda calls). See [GPU Migration Toolkit](https://docs.habana.ai/en/latest/PyTorch/PyTorch_Model_Porting/GPU_Migration_Toolkit/GPU_Migration_Toolkit.html#gpu-migration-toolkit). We have enabled native [PyTorch autocast](https://docs.habana.ai/en/latest/PyTorch/PyTorch_Mixed_Precision/index.html#pytorch-mixed-precision-training) support for Gaudi and have demonstrated the same on several reference models. For users interested in tracking memory usage, we have added monitoring HPU memory utilization metrics during training on TensorBoard.

Habana’s fork of DeepSpeed now includes support for ZeRO-3 as well as ZeRO-Offload with ZeRO-1 or ZeRO-2 for training. In addition, DeepSpeed activation checkpointing is validated with activation partitioning and contiguous memory optimization flags. See [Habana DeepSpeed User Guide](https://docs.habana.ai/en/latest/PyTorch/DeepSpeed/index.html).

Several [reference models](https://github.com/HabanaAI/Model-References/) have been updated with instructions to train and infer on Habana Gaudi2 and Gaudi first-gen; for training, this includes stable diffusion scaling up to 64 cards and HuBERT, and for inference, BLOOM-176B with beam search, stable diffusion v2.1, UNet2D, UNet3D and ResNext101. We have enhanced the performance of many models with this release. Check out Habana’s [model performance page](https://developer.habana.ai/resources/habana-models-performance/).

You can find more information on SynapseAI 1.9.0 on Habana’s [release notes page](https://docs.habana.ai/en/latest/Release_Notes/GAUDI_Release_Notes.html).