Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Tokenization, parsing, classical NLP pipelines, translation and information extraction.
Signals: nlp, natural-language-processing, tokenizer, named-entity-recognition, text-classification, machine-translation, sentiment-analysis, spacy
637 results
适配轻小说/Galgame的日中翻译大模型
Machine learning for multivariate data through the Riemannian geometry of positive definite matrices in Python
A persistent, network resilient, full text search library for the browser and Node.js
This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.
NLP tools for Turkish.
The most popular spellchecking library.
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
Must-read Papers on LLM Agents.
Self-contained Japanese Morphological Analyzer written in pure Go
Fast and customizable framework for automatic ML model creation (AutoML)
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
:herb: NodeJS PHP Parser - extract AST or tokens
A micro-library of stream components for building custom JSON and JSONC processing pipelines with a minimal memory footprint — parse, filter, and transform JSON far larger than available memory with a SAX-inspired token API, on Node.js or Web Streams.
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
A curated list of resources for Japanese natural language processing (NLP): Python libraries, LLMs, dictionaries, corpora, and datasets. Includes Claude Code skills to search resources.
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
llms 大模型 笔记50篇 此仓库包含关于机器学习、深度学习、计算机视觉、自然语言处理、大模型 爬虫等领域 项目实战
Awesome Artificial Intelligence, Machine Learning and Deep Learning as we learn it. Study notes and a curated list of awesome resources of such topics.
Portfolio of data science projects completed by me for academic, self learning, and hobby purposes.
Parser Building Toolkit for JavaScript
Query your data in plain English with a fine-tuned Text2SQL model
Data augmentation for NLP
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
Final Year Fake News Detection using Machine learning Project with Report, PPT, Code, Research Paper, Documents and Video Explanation.
24,535 repositories in the index in total.
