AI-Generated Metadata on Images

Overview

The AI Image Module automatically analyzes each photo and generates valuable metadata. This includes categories, tags, captions, descriptions, extracted text, and more. When a user views a photo in the web app, this metadata will be displayed if available, enhancing context, documentation, and validation capabilities.


User Experience in the Photo Viewer

When a user opens an image in the Photo Manager, the presence of AI-generated metadata triggers an enhanced view with structured sections for ease of review.

What Users Will See (When AI Metadata Exists)

1. AI Metadata Header

  • A clearly visible header label "Image Analysis Results":         Screenshot 2025-04-15 at 12.10.19 PM.png
  • This header signals to the user that the content below has been automatically generated by AI.

2. Tags and Category Section

  • Tags: A list of key concepts, objects, or features identified highlighted in yellow.
    • Example: service panel, roof, wiring, crew member
  • Category: The primary classification the AI assigns to the image.
    • Example: Equipment, etc.Screenshot 2025-04-15 at 2.37.54 PM.png

3. Caption and Description Section

  • Caption: A concise label or summary suitable for image labeling or reporting.
    • Example: “Solar combiner panel”
  • Description: A brief overview or narrative about what the image depicts.
    • Example: “A solar combiner panel with clear labeling and wiring, indicating rapid shutdown capability.”
      Screenshot 2025-04-15 at 2.35.06 PM.png

4. Extracted Text Section

  • Text Detection: Any visible text in the image is extracted and shown.
    • Example:
      Screenshot 2025-04-15 at 2.32.24 PM.png
  • This can be used for compliance, validation, or documentation purposes.

5. Validation Failures Section

  • If the AI detects any non-conformities or missing requirements, they will be listed here.
  • Example:
    • Object 
    • Instruction
    • Proximity
    • See this article for more infoScreenshot 2025-04-15 at 2.50.40 PM.png

6. Video Summaries (if applicable)

  • For any image associated with a video capture, it may include tags, category, duration, key moments, transcript, and summary. 
    • Example screen shot of a video summary:  Screenshot 2025-04-15 at 12.27.26 PM.png

Key Notes for Users

  • AI-generated content is meant to assist and does not replace human judgment.
  • Always verify critical data or validation messages during the review process.
  • Only photos with associated AI metadata will show this expanded view.
Have more questions? Submit a request

Comments