<ul><li>Gecko is a rubric-based auto-rater for evaluating generative AI models, available on Google Cloud’s Vertex AI Evaluation Service.</li><li>Traditional human evaluation of generative models can be slow and costly, hindering development cycles.</li><li>Gecko offers a customizable and transparent evaluation process for image and video generation models.</li><li>Gecko's interpretability allows developers to understand model behavior and improve performance.</li><li>It leverages a rubric-based approach to evaluate image and video generation skills efficiently.</li><li>Gecko uses semantic prompt decomposition and question-answer generation for evaluation.</li><li>Evaluation with Gecko involves scoring generated media against question-answer pairs.</li><li>Gecko is integrated into Vertex AI's Gen AI Evaluation Service for assessing generative models.</li><li>Setting up Gecko evaluation on Vertex AI involves rubric generation and dataset preparation.</li><li>Detailed insights and visualizations of evaluation results are provided by Vertex AI Gen AI service.</li></ul>

Evaluate your gen media models with multimodal evaluation on Vertex AI

Discover more