LightPROF is a lightweight AI framework that enables small-scale language models to perform complex reasoning over knowledge graphs (KGs) using structured prompts.
Current approaches to large language model (LLM) reasoning on KGs face challenges in representing KG content and requiring multiple LLM calls and substantial reasoning power.
LightPROF introduces the RetrieveEmbed-Reason framework, which consists of retrieval, embedding, and reasoning modules to perform stable retrieval and efficient reasoning on KGs.
LightPROF outperforms state-of-the-art models in KG question answering tasks, achieving high accuracy while reducing processing time and input token usage.