Large Language Model (LLM) based coding tools have gained success as software development assistants, but struggle in specialized domains like high performance computing (HPC).
This study focuses on fine-tuning a specialized HPC LLM to understand the challenges of generating parallel code.
The study identifies hurdles that hold back LLMs in HPC and proposes solutions to overcome them.
Based on the findings, a specialized HPC LLM is created and evaluated, showing superior performance in open-source parallel code generation.