kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
quality grade D, 44 out of 100Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
- stars
- 970
- stars gained this week
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Released model weights, reference implementations and architecture research.
Signals: large-language-models, llm, foundation-models, transformer, gpt, llama, mistral, qwen
1,442 results
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local or in the cloud
Code and datasets for "Character-LLM: A Trainable Agent for Role-Playing"
An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案,包含从训练到推理的完整代码和脚本,以及实践中积累一些经验和结论。)
Connectionist Temporal Classification (CTC) decoder with dictionary and language model.
ChatGPT at home! A better alternative to commercial smart home assistants, built on the Raspberry Pi using LiteLLM and LangGraph.
Connectionist Temporal Classification (CTC) decoding algorithms: best path, beam search, lexicon search, prefix search, and token passing. Implemented in Python.
An editing tool that uses AI to transcribe, understand content and search for anything in your footage, integrated with ChatGPT and other AI models
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
Official code base for MinD-Video
A collection of one-click self-hosted AI
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
Speed Always Wins: A Survey on Efficient Architectures for Large Language Models
[IEEE TGRS 2024] ChangeMamba: Remote Sensing Change Detection Based on Spatio-Temporal State Space Model
This chatbot app is built using the Llama 2 open source LLM from Meta.
Enhance your résumé with Large Language Models
A collection of apps powered by the LangChain LLM framework.
Querying local documents, powered by LLM
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
Verbalized Sampling, a training-free prompting strategy to mitigate mode collapse in LLMs by requesting responses with probabilities. Achieves 2-3x diversity improvement while maintaining quality. Model-agnostic framework with CLI/API for creative writing, synthetic data generation, and dialogue simulation.
A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.
AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.
Automate the tedious development tasks with AI
🌌️Fuzz4All: Universal Fuzzing with Large Language Models
24,545 repositories in the index in total.