Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
A simple screen parsing tool towards pure vision based GUI agent
| Date | Stars |
|---|---|
| 2026-07-31 | 25211 |
| 2026-08-01 | 25211 |
| 2026-08-04 | 25219 |
| 2026-08-06 | 25219 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# OmniParser: Screen Parsing tool for Pure Vision Based GUI Agent <p align="center"> <img src="imgs/logo.png" alt="Logo"> </p> <!-- <a href="https://trendshift.io/repositories/12975" target="_blank"><img src="https://trendshift.io/api/badge/repositories/12975" alt="microsoft%2FOmniParser | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a> --> [](https://arxiv.org/abs/2408.00203) [](https://opensource.org/licenses/MIT) 📢 [[Project Page](https://microsoft.github.io/OmniParser/)] [[V2 Blog Post](https://www.microsoft.com/en-us/research/articles/omniparser-v2-turning-any-llm-into-a-computer-use-agent/)] [[Models V2](https://huggingface.co/microsoft/OmniParser-v2.0)] [[Models V1.5](https://huggingface.co/microsoft/OmniParser)] [[HuggingFace Space Demo](https://huggingface.co/spaces/microsoft/OmniParser-v2)] **OmniParser** is a comprehensive method for parsing user interface screenshots into structured and easy-to-understand elements, which significantly enhances the ability of GPT-4V to generate actions that can be accurately grounded in the corresponding regions of the interface. ## News - [2026/7] We add a YOLOv9-E interactive region detector. Its inference-only weight is available in [Hugging Face PR #37](https://huggingface.co/microsoft/OmniParser-v2.0/discussions/37). - [2025/3] We support local logging of trajecotry so that you can use OmniParser+OmniTool to build training data pipeline for your favorate agent in your domain. [Documentation WIP] - [2025/3] We are gradually adding multi agents orchstration and improving user interface in OmniTool for better experience. - [2025/2] We release OmniParser V2 [checkpoints](https://huggingface.co/microsoft/OmniParser-v2.0). [Watch Video](https://1drv.ms/v/c/650b027c18d5a573/EWXbVESKWo9Buu6OYCwg06wBeoM97C6EOTG6RjvWLEN1Qg?e=alnHGC) - [2025/2] We introduce OmniTool: Control a Windows 11 VM with OmniParser + your vision model of choice. OmniTool supports out of the box the following large language models - OpenAI (4o/o1/o3-mini), DeepSeek (R1), Qwen (2.5VL) or Anthropic Computer Use. [Watch Video](https://1drv.ms/v/c/650b027c18d5a573/EehZ7RzY69ZHn-MeQHrnnR4BCj3by-cLLpUVlxMjF4O65Q?e=8LxMgX) - [2025/1] V2 is coming. We achieve new state of the art results 39.5% on the new grounding benchmark [Screen Spot Pro](https://github.com/likaixin2000/ScreenSpot-Pro-GUI-Grounding/tree/main) with OmniParser v2 (will be released soon)! Read more details [here](https://github.com/microsoft/OmniParser/tree/master/docs/Evaluation.md). - [2024/11] We release an updated version, OmniParser V1.5 which features 1) more fine grained/small icon detection, 2) prediction of whether each screen element is interactable or not. Examples in the demo.ipynb. - [2024/10] OmniParser was the #1 trending model on huggingface model hub (starting 10/29/2024). - [2024/10] Feel free to checkout our demo on [huggingface space](https://huggingface.co/spaces/microsoft/OmniParser)! (stay tuned for OmniParser + Claude Computer Use) - [2024/10] Both Interactive Region Detection Model and Icon functional description model are released! [Hugginface models](https://huggingface.co/microsoft/OmniParser) - [2024/09] OmniParser achieves the best performance on [Windows Agent Arena](https://microsoft.github.io/WindowsAgentArena/)! ## Install First clone the repo, and then install environment: ```python cd OmniParser conda create -n "omni" python==3.12 conda activate omni pip install -r requirements.txt ``` Until [Hugging Face PR #37](https://huggingface.co/microsoft/OmniParser-v2.0/discussions/37) is merged, download the latest YOLOv9-E detector from the PR: ``` huggingface-cli download microsoft/OmniParser-v2.0 icon_detect_v3/model.pt \ --revision refs/pr/37 --local-dir weights ``` OmniParser prefers this local weight. After the PR is merged, it will download the same weight automat
Excerpt of 5,746 characters
Read on GitHub
60
Thomas Dhome-Casanova · Microsoft · United States
40
Alexey Taymanov · Microsoft
5
Billy Cao · Nanyang Technological University | @Semianalysis · Singapore
4
Neil Stoker · United Kingdom
2
1
1
1
Adam · University of California, Irvine
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:bb355d3f794f2c4c, desc:gui agent