GitHub Hot Board

GitHub Hot Board · Repository archive

abnste/mewu_ai

MewuAI 喵呜AI | 跨平台开源 AI 屏幕协作软件:AI 圈选重点、截图问答、离线 OCR、原位翻译、录屏与视频标注。Cross-platform open-source AI screen collaboration software: AI key point selection, screenshot Q&A, offline OCR, in-place translation, screen recording, and video annotation (This description comes from the repository itself.)

Rust#ai-screenshot#annotation#artificial-intelligence

Data at October 28abnste

Best

#138

Underappreciated Gems

100

Total stars

7

Total forks

1

Days on boards (30d)

License: MPL-2.0Last push: October 27Open issues: 4Collected since 2026-10-25; unknown = not yet harvested

README

MewuAI

MewuAI — Personal Agent & AI Creative Canvas

An open-source, LLM-powered desktop app for conversation, visual annotation, creative tools, and desktop actions.

Latest release Windows x64 macOS ARM64 Linux x64 MPL-2.0

Windows installer  ·  Windows portable  ·  macOS ARM64  ·  Linux x64

简体中文 · English · Website · Release notes · Report an issue

MewuAI is an open-source desktop Agent app for Windows, macOS, and Linux. Select screen content and express what you need through annotations, freehand drawings, and files. Chat, organize references, generate interactive tools, and use plugins to act in the same space. Mewu with you — working alongside you.

At a glance Details
Platforms Windows x64, macOS ARM64, Linux x64; Simplified Chinese and English UI
Core capabilities Personal Agent, AI creative canvas, visual annotation, interactive HTML, CLI, and plugins
Workflow Select to reference → describe the task → use, annotate, or refine the result
Local tools Capture, manual drawing, pinning, local OCR, and recording need no AI account
AI connections Choose model services, external Agents, MCP tools, and independent memory providers
Official sources Latest release · Plugin marketplace

MewuAI cover: capture an image, ask a question, and annotate in place.
Capture, ask, and annotate in place.

Features

  • Personal Agent: choose a role, model, tools, and memory. Reference images, videos, and files; retain conversation history; read Markdown, formulas, and collapsible public reasoning. Use the official Agent's persistent local memory or connect an independent memory service.
  • AI creative canvas: arrange, resize, pin, or save images, videos, text, and generated objects. Describe an HTML / SVG / Canvas tool, use the resulting calculator, experiment, or game, and ask for further changes.
  • Capture and multiple selections: capture a region, multiple areas, scrolling content, or supported windows. Selections automatically become references while the surrounding screen dims, with no separate “Reference” click.
  • Drawing and annotation: pens, arrows, shapes, text, numbering, highlights, and mosaic, with undo, redo, and object editing. Add marks yourself or ask AI to explain and highlight specific details in worksheets, code, and other references.
  • Text and tables: local OCR, capture translation, chart understanding, and table extraction. Windows/macOS also offer actionable recognition of links, emails, phone numbers, QR codes, and barcodes.
  • Recording and video annotation: capture system audio and microphone input; pause, resume, trim, and export MP4 / MP3 / GIF. Add rectangles and text for time ranges, then click conversation timestamps to revisit them. Audio support varies by system.
  • Blackboard: draw and explain on a full-screen board, combining questions, formulas, and AI analysis. A setting lets screen-sharing apps see selections and annotations.
  • CLI and region AI operations: local Agents can inspect scenes, capture, add selections, draw, and export. The region plugin lets a model observe a selected target, act, and check a fresh screenshot before continuing.
  • Plugins and event triggers: extend Agents, memory, tools, and UI independently. Official Hooks supports schedules, prompts, completed replies, global shortcuts, and app/plugin events, connecting Mewu operations, MCP, commands, and keyboard/mouse actions.
  • Skills and self-made plugins: the built-in Agent can read portable SKILL.md skills, create and validate plugin projects, and prepare an installable package. Review permissions before installation under Installed → Self-made. Plugins can reorder the original screenshot toolbar through the generic layout service. See skills and authoring.

The native Agent loads image/video annotation skills on demand, keeps original conversation history when compacting context, and exposes paginated session recall separately from long-term memory. See Agent runtime and repeatable evaluation.

Capture, drawing, and recording work without AI setup. AI conversations, translation, and generated content require a configured service.

In development / TODO

  • Reference-guided generation and dedicated image/video model connections.
  • Circle-to-search, a desktop companion plugin, and more desktop collaboration workflows.
  • Broader platform coverage, language support, and performance improvements.

Feature demos

Exam annotation

Explain a worksheet and add construction lines, reasoning, and annotations to the original.

Exam annotation: Explain a worksheet and add construction lines, reasoning, and annotations to the original.

Generate HTML tools

Describe a tool, generate interactive content, and keep using and refining it.

Generate HTML tools: Describe a tool, generate interactive content, and keep using and refining it.

AI creative canvas

Arrange storyboards, images, and conversations to develop a creative project.

AI creative canvas: Arrange storyboards, images, and conversations to develop a creative project.

Blackboard

Draw axes, curves, and notes by hand to explain your reasoning.

Blackboard: Draw axes, curves, and notes by hand to explain your reasoning.

Video annotations

Annotate time ranges, play the result, and click timestamps to revisit the relevant frames.

Video annotations: Annotate time ranges, play the result, and click timestamps to revisit the relevant frames.

CLI capture and drawing

Call capture, selection, and drawing operations from a terminal and see the results in Mewu.

CLI capture and drawing: Call capture, selection, and drawing operations from a terminal and see the results in Mewu.

Text recognition

Extract the text you need from a capture using local OCR.

Text recognition: Extract the text you need from a capture using local OCR.

Code explanation

Select code, explain its logic, mark the failing line, and show a correction beside the original.

Code explanation: Select code, explain its logic, mark the failing line, and show a correction beside the original.

Table extraction

Turn a captured table into structured data you can copy, compare, and use for further analysis.

Table extraction: Turn a captured table into structured data you can copy, compare, and use for further analysis.

External Agents

Connect Codex, MiniMax Code, WorkBuddy / CodeBuddy, or Hermes to the existing conversation bar.

External Agents: Connect Codex, MiniMax Code, WorkBuddy / CodeBuddy, or Hermes to the existing conversation bar.
About the demos

Animations use Mewu interface components with prepared example content; generated results vary by model and prompt. Video annotations appear over assigned time ranges and do not imply automatic object tracking. Exam annotation retains the original README screenshot; code explanation is newly recorded with the current Mewu UI. The External Agents image is a published native screenshot from that plugin. Assets and credits.

Get started

  1. Install and launch. Choose your platform above. Windows uses WebView2; on macOS, move the app into Applications; on Linux, make the AppImage executable. Downloads follow the latest stable release.
  2. Enter the workspace. Open Mewu from the tray or a capture shortcut to select, draw, save, or open a blackboard. Configure capture shortcuts in Hooks and grant system capture/recording permissions when requested.
  3. Connect AI. Add a model in Settings → Agents & Connections, choose a role and memory, or connect a client through External Agents. Selections become references automatically; send your task from the conversation bar.

For Linux dependencies and permissions, see the AppImage guide and recording guide. Region AI operations support Windows, macOS, and compatible GNOME 50 Wayland x64 setups; Linux also requires Desktop Witness and Portal authorization.

Supported AI

Connection How to use it
Model APIs Configure Chat Completions, OpenAI Responses, or Anthropic Messages services, save independent connections, and choose a model.
External Agents Use the independent plugin to connect Codex, MiniMax Code, WorkBuddy / CodeBuddy, or Hermes with the client's own login and configuration.
Memory Choose the Agent and memory separately: use official persistent local memory or connect Hindsight and other providers through plugins.
MCP and tools Add services in Agents & Connections → MCP, or enable plugin tools for the current Agent to call.

Image, video, and tool capabilities, limits, and fees depend on the selected service. External Agents require the corresponding client to be installed and signed in; consult each plugin's documentation for platform support.

Plugin marketplace

Browse, install, and manage extensions in Settings → Plugins, or import a release ZIP. Browse the full marketplace.

Plugin What it adds
Hooks · event triggers Included and enabled by default. Combine triggers and actions; enable, edit, and review the history of each rule independently.
External Agents Connect an existing client to Mewu's roles and conversations.
Region AI operations Select a target and describe a task; the model acts based on successive observations.
Hindsight memory Connect your Hindsight service and memory banks.
Journal memory Choose an independent journal-based memory provider for an Agent.
Mewu toolbox Save images, videos, HTML, and drawings; organize folders and drag out copies for reuse.
Research notes Write notes, drag in reference objects, and save them in the workspace.
Interactive ruler Use a movable, adjustable HTML / SVG measuring tool on the canvas.

Command line

Start the desktop app, then open a terminal. The CLI shares the same Mewu workspace with you:

mewu                         # Start an Agent conversation
mewu status                  # Inspect the app and current scene
mewu schema                  # Discover operations and parameters
mewu call capture.open --json '{}' --wait

Plain mewu chat sends text by default; screenshots and files require explicit references. See the CLI guide and operation catalog for setup, platform requirements, and parameters.

FAQ

Do I need an AI account? Is it paid?

Capture, manual drawing, recording, and local OCR need no AI account. AI conversations and generation use your chosen service or external Agent, which determines usage limits and charges. MewuAI itself is open source.

Why are selections and annotations missing from a screen share?

Enable Settings → General → Allow screen sharing to see selections and annotations. Visibility also depends on the operating system and screen-sharing app.

Where do my captures and conversations go?

Capture and manual drawing happen locally. When you use AI, referenced content and relevant context are sent to your selected service. Plugins use granted permissions, and external Agents retain their own runtime configuration.

How do I update or report a problem?

Check Settings → About, or download the latest release. The Windows portable build's built-in updater switches to the installed edition; download a new portable ZIP to keep using it portably.

Report an Issue with your system, app version, reproduction steps, and relevant screenshots.

Contributing

Bug reports, use cases, code, plugins, and documentation contributions are welcome. The desktop app uses Rust + Tauri 2 + SolidJS / TypeScript + SQLite and renders through the system WebView.

Desktop development · Extension SDK · Extension interfaces · Plugin packaging · Release guide

Browser previews support interface development; native capture, recording, and system input require the desktop runtime.

Project members

Abner Stephen Yandi 数字与星星 Cobb tljsj

License

MewuAI's own source uses MPL-2.0, which permits commercial use subject to its terms. Distributions must provide covered source and preserve copyright and license notices as required. Third-party notices ship with the app.

Acknowledgments

Thanks to Lin Wenjie (林文杰) for subject-matter guidance, Zhang Wenbiao (张文彪) for feature-development suggestions, and blueling0 for testing.

Current rankings

  • 138

    Underappreciated Gems

    100 stars · 7 fork · Total stars (ascending)

    Underrated →

Momentum, past 30 days

Cumulative stars

Rank movement

Put your badge on the README · abnste/mewu_ai[![Put your badge on the README](https://git.vaiox.xyz/api/badge/abnste/mewu_ai.svg)](https://git.vaiox.xyz/en/repo/abnste/mewu_ai)

Badge · 任何仓库都可以挂 —— 未上榜的仓库显示灰章,上完榜会自动点亮。

<a href="https://git.vaiox.xyz/en/repo/abnste/mewu_ai"><img src="https://git.vaiox.xyz/api/badge/abnste/mewu_ai.svg" alt="Put your badge on the README" height="20"></a>

← Back to boards

GitHub Hot BoardTime MachineDiscover联系我们 · Contact