There is significant current research focused on determining meaningful evaluation metrics for generative models.
A unifying perspective is needed to allow for easier comparison and clearer explanation of metric benefits and drawbacks.
A class of kth-nearest-neighbors (kNN)-based metrics is unified under an information-theoretic lens.
A tri-dimensional metric composed of Precision Cross-Entropy (PCE), Recall Cross-Entropy (RCE), and Recall Entropy (RE) is proposed to measure fidelity and diversity.