Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
[ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision).
| Date | Stars |
|---|---|
| 2026-07-31 | 850 |
| 2026-08-06 | 850 |
| 2026-08-25 | 851 |
| 2026-08-27 | 852 |
| 2026-09-01 | 850 |
| 2026-09-04 | 851 |
| 2026-09-16 | 851 |
| 2026-09-23 | 852 |
| 2026-10-05 | 853 |
| 2026-10-07 | 852 |
| 2026-10-12 | 852 |
| 2026-10-28 | 853 |
| 2026-11-04 | 853 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
[//]: # (# SeeAct <br> GPT-4V(ision) is a Generalist Web Agent, if Grounded) <h1 align="center">SeeAct <br> GPT-4V(ision) is a Generalist Web Agent, if Grounded</h1> <p align="center"> <a href="https://osu-nlp-group.github.io/Mind2Web/"><img src="https://img.shields.io/badge/Mind2Web-Homeage-red.svg" alt="Mind2Web Benchmark"></a> <a href="https://www.licenses.ai/ai-licenses"><img src="https://img.shields.io/badge/OPEN RAIL-License-green.svg" alt="Open RAIL License"></a> <a href="https://huggingface.co/datasets/osunlp/Mind2Web"><img src="https://img.shields.io/badge/Mind2Web-Dataset-yellow.svg" alt="Mind2Web Benchmark"></a> <a href="https://huggingface.co/datasets/osunlp/Multimodal-Mind2Web"><img src="https://img.shields.io/badge/Multimodal Mind2Web-Dataset-blue.svg" alt="Mind2Web Benchmark"></a> <a href="https://pypi.org/project/seeact/"><img src="https://img.shields.io/badge/seeact-PyPI-red.svg" alt="Python 3.10"></a> </p> <p align="center"> <a href="https://www.python.org/downloads/release/python-3109/"><img src="https://img.shields.io/badge/python-3.10-blue.svg" alt="Python 3.10"></a> <a href="https://playwright.dev/python/docs/intro"><img src="https://img.shields.io/badge/Playwright-1.44-green.svg" alt="Playwright"></a> <a href="https://github.com/OSU-NLP-Group/SeeAct"><img src="https://img.shields.io/github/stars/OSU-NLP-Group/SeeAct?style=social" alt="GitHub Stars"></a> <a href="https://github.com/OSU-NLP-Group/SeeAct/issues"><img src="https://img.shields.io/github/issues-raw/OSU-NLP-Group/SeeAct" alt="Open Issues"></a> <a href="https://twitter.com/osunlp"><img src="https://img.shields.io/twitter/follow/OSU_NLP_Group" alt="Twitter Follow"></a> </p> SeeAct is a system for <a href="https://osu-nlp-group.github.io/Mind2Web/">generalist web agents</a> that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision). It consists of two main components: (1) A robust codebase that supports running web agents on live websites, and (2) an innovative framework that utilizes LMMs as generalist web agents.  <p align="center"> <a href="https://osu-nlp-group.github.io/SeeAct/">Website</a> • <a href="https://arxiv.org/abs/2401.01614">Paper</a> • <a href="https://huggingface.co/datasets/osunlp/Multimodal-Mind2Web">Dataset</a> • <a href="https://twitter.com/ysu_nlp/status/1742398541660639637">Twitter</a> </p> <h3>Updates</h3> - 2024/11/10: We have open-sourced SeeAct Chrome Extension source code! Try and have fun at [SeeActChromeExtension](https://github.com/OSU-NLP-Group/SeeActChromeExtension)! - 2024/9/30: [WebOlympus: An Open Platform for Web Agents on Live Websites](https://aclanthology.org/2024.emnlp-demo.20/) has been accepted to EMNLP'24 Demo Track! - 2024/8/17: Crawler mode added! - 2024/7/9: Support SoM (Set-of-Mark) grounding strategy! - 2024/5/18: Support for Gemini and LLaVA! - 2024/5/1: SeeAct has been accepted to ICML'24! - 2024/4/28: Released [SeeAct Python Package](https://pypi.org/project/seeact/#history), with many updates and many features on the way. Have a try with `pip install seeact` - 2024/3/18: [Multimodal-Mind2Web](https://huggingface.co/datasets/osunlp/Multimodal-Mind2Web) dataset released. We have paired each HTML document with the corresponding webpage screenshot image and saved the trouble of downloading [Mind2Web Raw Dump](https://github.com/OSU-NLP-Group/Mind2Web?tab=readme-ov-file#raw-dump-with-full-traces-and-snapshots). # SeeAct Tool The SeeAct tool enables running web agents on live websites through [PlayWright](https://playwright.dev/), serving as an interface between an agent and a web browser. It efficiently tunnels inputs from the browser to the agent, and translates predicted actions of the agent into browser events for execution. This tool can be used for running web agent demos and evaluating th
Excerpt of 18,688 characters
Read on GitHub
Boyuan Zheng · xAI · United States
71
38
23
Yu Su · The Ohio State University
2
Shaw · Tsinghua University · China
2
Ikko Eltociear Ashimine · Japan
1
1
Naoya Muramatsu · University of Cape Town · South Africa
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:beb9e4e0e574ce84, desc:multimodal