Reading Images: Analyzing Screenshots, Charts, and Handwritten Notes

AI Navigate Original / 3/23/2026

💬 OpinionTools & Practical UsageModels & Research
共有:

Key Points

  • Claude's multimodal capabilities support not only text extraction but also graph and handwritten note analysis.
  • Image uploading is easy on web and mobile, with a wide range of supported formats.
  • Transcribing screenshots and summarizing charts can boost work efficiency.
  • The digitization feature for handwritten notes is convenient for meeting records and idea management.
  • UI design reviews are also possible, with AI providing concrete improvement suggestions.

Introduction: What Claude's Multimodal Capabilities Are

The latest AI as of 2025, Claude, equips multimodal capabilities that can analyze not only text but also images. With this feature, you can convert and comprehend various visual information such as screenshots, charts, and handwritten notes into text. This article explains practical usage from image uploading to concrete analysis examples in an easy-to-understand way.

1. How to Upload Images in Claude

To use Claude's image analysis feature, first upload an image to the chat screen. Supported formats are primarily JPEG, PNG, GIF, and BMP.
The upload methods are as follows:

  • Web version: Click the attachment button (the clip icon) in the chat input field, then select an image.
  • Mobile app version: Tap the + button next to the input field to launch the camera, or choose from the gallery.
  • Drag & Drop: If your PC supports it, you can drag and drop the image directly onto the chat screen.

After uploading, once the image is loaded, sending instructions in text will start the analysis.

2. Text Extraction from Screenshots (OCR)

For example, when you want to extract text from a screenshot of a website, instruct as follows:

Please extract the text portions from this screenshot.

Claude uses cutting-edge OCR technology to read text with high accuracy. It supports not only Japanese and English but many languages. It is highly useful for transcribing texts from invoices, email screens, chat histories, and other images.

Examples

Extract the meeting agenda titles and key points shown in the screenshot

Please tell me the meeting agenda, date, and person in charge from this image.

3. Analysis and Summarization of Graphs and Charts

You can analyze bar graphs, pie charts, line graphs, or tables depicted in the image as well. Read the numbers and trends and summarize them in clear prose.

Examples

The following image is the sales trend graph for fiscal year 2024. If you instruct as follows:

Provide a concise description of the upward or downward trend in sales for this graph.

Claude will read the data points in the image and report in prose such as “From January to March, sales gradually increased, April saw a sharp rise, and the latter half leveled off.”

Comparison Table: Points to Read by Graph Type

Graph TypeContent to ReadUse Cases
Bar graphValues for each item, comparisonsSales comparisons, survey results
Pie chartProportions, composition sharesMarket share analysis
Line graphTrends and changesSales trends, temperature changes
TableExtraction of values and text from rows and columnsCost calculations, data organization

4. Digitizing Handwritten Notes

Claude’s Vision capability can recognize handwritten text as well. If you take photos of whiteboards or notes during meetings and upload them, handwritten text can be converted to text for editing and sharing.

Use Cases

  • Scan drafts of meeting minutes and copy/paste into Word or email
  • Extract key points from idea maps or flowcharts and organize
  • Convert handwritten checklists to To-Do lists

Note: The recognition accuracy depends on the writer’s handwriting, so always verify the content after reading.

5. UI Design Screen Reviews and Feedback

Claude can analyze UI screenshots from mobile or web and provide design improvements and accessibility feedback. For example, it can give concrete comments on button placement, readability of text, color balance, and more.

Use Cases

Upload a UI screenshot and:

Please provide improvement ideas to enhance the user experience on this screen.

Claude would respond with suggestions such as “The button color blends with the background and isn’t prominent, so adjust the color tone” and “The text size is small and hard to read, so increase the font size.”

6. Practical Prompt Examples

  • Text Extraction:
    Please transcribe all text from this image.
  • Graph Summary:
    Summarize the key points of this graph in three items.
  • Handwritten Reading:
    Format the content of this handwritten memo into a polished sentence.
  • UI Review:
    Please provide concrete improvements to enhance usability for this UI screen.

Conclusion

Claude's multimodal Vision feature makes highly advanced analysis almost immediately available once you upload an image. It can be effectively used in a variety of real-world scenarios, such as transcription, data summarization, digitizing handwritten notes, and design reviews. It is intuitive enough for AI beginners to use, so consider adopting it to improve everyday work efficiency.

(This article is created based on the latest Claude Vision features as of 2025 and is part of the “Claude Usage Guide #9: Basic Utilization” series.)