Accelerating Codegen training and inference on Habana Gaudi2

Optimum Habana  makes it easy to achieve fast training and inference of large language models (LLMs) on Habana Gaudi2 accelerators. In this blog, we will walk through the process of performing Low-Rank Adaptation (LoRA) training of Codegen , an open-source LLM for program synthesis. We will also benchmark the training and inference efficiency of Habana Gaudi2 using Codegen