Triage Multimodal Submissions with Gemini

Table of Contents

1. Challenge

   Submit image-and-text reports and verify what evidence the model can reliably extract

   1. Submit the four pending damage reports to the Gemini triage service.
   2. Compare Gemini's description of each photo and note with the originals.

   At the end of this objective, you'll know which parts of Gemini's answer you can check directly against the evidence.

2. Challenge

   Apply the supplied rubric to classify each report

   1. Rate the three evidence requirements for each pending report from its photo and note.
   2. Choose the one outcome the rubric allows and compare it with Gemini's outcome and confidence.
   3. Open the auto-routed folder to confirm that the starting rule settled all four reports.

   At the end of this objective, you'll have seen the service settle every report automatically, including the reports whose evidence does not support Gemini's outcome.

3. Challenge

   Identify reports with missing, insufficient, or contradictory evidence

   1. Match each pending report to the kind of problem it has, whether missing, insufficient, or contradictory evidence.
   2. Compare the evidence fields of the three problem reports with those of the complete report.
   3. Compare the four confidence scores with the starting threshold.

   At the end of this objective, you'll know that the evidence fields separate the problem reports from the complete one and the confidence threshold does not.

4. Challenge

   Configure the routing rule to send insufficient-evidence reports for human review

   1. Review the routing rule in the environment variables of the report-triage service.
   2. Switch on the three evidence requirements and lower the instance limit.
   3. Deploy the change and confirm that the new revision serves all traffic.

   At the end of this objective, you'll have a new revision live that settles a report automatically only when every evidence requirement is shown.

5. Challenge

   Test complete and incomplete reports and verify that each reaches the expected outcome

   1. Resubmit the four pending reports under the new rule.
   2. Submit the two test reports the rule has not seen.
   3. Check which folder each report reached and read the condition that decided it.

   At the end of this objective, you'll have verified that complete reports settle automatically and incomplete reports go to a person, and you'll know which rule condition decided each route.