wangzhaode/mnn-llm
quality grade D, 47 out of 100llm deploy project based mnn. This project has merged into MNN.
- stars
- 1.6k
- stars gained this week
- —this week
- forks, open issues and contributors
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Cluster scheduling, GPU sharing, serverless compute and the distributed execution layer.
Signals: gpu, cuda, distributed-computing, kubernetes, ray, slurm, serverless, hpc
651 results
llm deploy project based mnn. This project has merged into MNN.
Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization
A tensor-aware point-to-point communication primitive for machine learning
A Simple High Performance Computing Framework for [Federated] Machine Learning
Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).
This repository contains information about Cloud GPU offerings for Machine Learning practitioners.
A machine learning library for Rust.
Prophecis is a one-stop cloud native machine learning platform.
Reliable Allreduce and Broadcast Interface for distributed machine learning
⚠️DirectML is in maintenance mode ⚠️ DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tasks across a broad range of supported hardware and drivers, including all DirectX 12-capable GPUs from vendors such as AMD, Intel, NVIDIA, and Qualcomm.
The Hacker's Machine Learning Engine
Scripts to setup a GPU / CUDA-enabled compute server with libraries for deep learning
A simple memory manager for CUDA designed to help Deep Learning frameworks manage memory
A fast Clojure Tensor & Deep Learning library
AI Infra主要是指AI的基础建设,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术。
Open, Modular, Deep Learning Accelerator
Deep Learning Benchmark for comparing the performance of DL frameworks, GPUs, and single vs half precision
🔥🔥🔥AidLearning is a powerful AIOT development platform, AidLearning builds a linux env supporting GUI, deep learning and visual IDE on Android...Now Aid supports CPU+GPU+NPU for inference with high performance acceleration...Linux on Android or HarmonyOS
NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
An all-in-one Docker image for deep learning. Contains all the popular DL frameworks (TensorFlow, Theano, Torch, Caffe, etc.)
Instructions for setting up the software on your deep learning machine
Benchmarking Deep Learning operations on different hardware
No description
24,535 repositories in the index in total.