777genius/os-ai-computer-use
AI controls your OS. OS AI Computer Use, OS and API agnostic. For now on Anthropic (Claude) API. Desktop app ready.
What's novel
AI controls your OS. OS AI Computer Use, OS and API agnostic. For now on Anthropic (Claude) API. Desktop app ready.
Code Analysis
7 files read · 4 roundsAn OS-agnostic Python agent that translates LLM tool calls into native system actions (screenshot, click, type) using platform-specific drivers like Quartz on macOS and PyAutoGUI on Windows.
Strengths
Excellent separation of concerns with a clean abstraction layer between the LLM and the OS. The code handles coordinate calibration and driver fallbacks robustly. The architecture is modular, allowing easy addition of new OS drivers without modifying core logic.
Weaknesses
Lacks a comprehensive test suite, which is risky for an automation tool where edge cases (window focus changes, rapid UI updates) are critical. Some dependencies like `pyautogui` and specific OS modules are tightly coupled in the fallback logic.
Score Breakdown
Signal breakdown
Innovation
Craft
Traction
Scope
Evidence
Commits
47
Contributors
1
Files
327
Active weeks
5
Repository
Language
Python
Stars
139
Forks
8
License
Apache-2.0