Mandala
Tools

Vision

Analyze images with vision models

Usage Instructions

Integrate Vision into the workflow. Can analyze images with vision models.

Tools

vision_tool

Process and analyze images using advanced vision models. Capable of understanding image content, extracting text, identifying objects, and providing detailed visual descriptions.

Input

ParameterTypeRequiredDescription
apiKeystringYesAPI key for the selected model provider
imageUrlstringNoPublicly accessible image URL
imageFilefileNoImage file to analyze
modelstringNoVision model to use (gpt-4o, claude-3-opus-20240229, etc)
promptstringNoCustom prompt for image analysis

Output

ParameterTypeDescription
contentstringThe analyzed content and description of the image
modelstringThe vision model that was used for analysis
tokensnumberTotal tokens used for the analysis
usageobjectDetailed token usage breakdown

Notes

  • Category: tools
  • Type: vision
Vision