<ul data-eligibleForWebStory="true">EditInspector is introduced as a benchmark to evaluate text-guided image edits by leveraging human annotations and a comprehensive framework.The benchmark assesses text-guided edits based on various factors like accuracy, artifact detection, visual quality, and more.Current state-of-the-art vision and language models face challenges in evaluating edits thoroughly and often provide inaccurate descriptions.Two novel methods proposed within EditInspector outperform existing models in artifact detection and difference caption generation.