Skip to content

Add Open Terminal image analysis to Vision Bridge - #84

Open
d3cker wants to merge 3 commits into
Classic298:mainfrom
d3cker:feature/term-vision
Open

Add Open Terminal image analysis to Vision Bridge#84
d3cker wants to merge 3 commits into
Classic298:mainfrom
d3cker:feature/term-vision

Conversation

@d3cker

@d3cker d3cker commented Aug 22, 2026

Copy link
Copy Markdown

Description

Summary

This PR adds analyze_terminal_image, allowing Vision Bridge to inspect images created or stored in the currently connected Open Terminal.
It also adds system instructions that tell the model when to use:

  • analyze_image for images attached to the conversation.
  • analyze_terminal_image for image files located in Open Terminal.

Motivation

Images generated through the Open WebUI -> Open Terminal workflow are terminal files, not chat attachments with a file_id. As a result, analyze_image could not resolve them: the bridge returned a missing-image error and the workflow stalled.
The new tool reads the image directly from the connected terminal and forwards it to the configured vision model. This lets the text-only model continue the workflow and visually verify generated or modified images.

Testing

Execute the following prompt:

Create a visually interesting Mandelbrot fractal image in the terminal and save it as a PNG - test.png. Use vivid colors and add a subtle glow around the fractal edges.
After creating it, visually inspect the actual rendered result and decide whether the colors, contrast, and glow look good. If they do not, improve the image and inspect it again.
Do not assume the image looks correct just because the code ran successfully. Base your final answer on actual visual inspection of the rendered image.

Contributor License Agreement (REQUIRED)

By submitting this pull request, I agree to the following terms:

By submitting my contributions to this repository in any form, I grant Classic298 a perpetual, worldwide, irrevocable, royalty-free license, under copyright and patent, to use, modify, distribute, sublicense, and commercialize my work under any terms they choose, both now and in the future.

I represent that my contributions are my original work (or that I have sufficient rights to grant this license) and that I have the authority to enter into this agreement.

To the fullest extent permitted by law, my contributions are provided on an "as is" basis, with no warranties or guarantees of any kind, and I disclaim any liability for any issues or damages arising from their use or incorporation into the project, regardless of the type of legal claim.

  • I have read and agree to the Contributor License Agreement above

@Classic298

Copy link
Copy Markdown
Owner

will have time to review soon

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants