Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
A Slurm cluster using docker-compose
| Date | Stars |
|---|---|
| 2026-07-24 | 529 |
| 2026-07-25 | 530 |
| 2026-07-28 | 530 |
| 2026-07-30 | 530 |
| 2026-08-06 | 530 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
10.0
growth rate 0.00%/day
# Slurm Docker Cluster **Slurm Docker Cluster** is a multi-container Slurm cluster designed for rapid deployment using Docker Compose. This repository simplifies the process of setting up a robust Slurm environment for development, testing, or lightweight usage. ## 🏁 Quick Start **Requirements:** [Docker](https://docs.docker.com/get-docker/) and [Docker Compose](https://docs.docker.com/compose/install/) ```bash git clone https://github.com/giovtorres/slurm-docker-cluster.git cd slurm-docker-cluster cp .env.example .env # optional: edit to change version, enable GPU, etc. # Option A: Pull pre-built image from Docker Hub (fastest) docker pull giovtorres/slurm-docker-cluster:latest docker tag giovtorres/slurm-docker-cluster:latest slurm-docker-cluster:25.11.4 # Option B: Build from source make build # Then, start the cluster make up ``` **Supported Slurm versions:** 25.11, 25.05 **Supported architectures (auto-detected):** AMD64, ARM64 ## 📦 What's Included **Containers:** - **mysql** - Job and cluster database - **slurmdbd** - Database daemon for accounting - **slurmctld** - Controller for job scheduling - **slurmrestd** - REST API daemon (HTTP/JSON access) - **c1, c2** - CPU compute nodes (dynamically scalable) - **g1** - (optional) GPU compute node with NVIDIA support (dynamically scalable) - **ondemand** - (optional) Open OnDemand web portal - **elasticsearch** - (optional) indexing jobs - **kibana** - (optional) visualization for elasticsearch **Persistent volumes:** - Configuration (`etc_slurm`) - Logs (`var_log_slurm`) - Job files (`slurm_jobdir`) - Database (`var_lib_mysql`) - Authentication (`etc_munge`) - OOD user home (`home_ood`) ## 🖥️ Using the Cluster ```bash # Access controller make shell # Inside controller: sinfo # View cluster status sbatch --wrap="hostname" # Submit job squeue # View queue sacct # View accounting # Or run example jobs make run-examples ``` ## 📈 Scaling Compute nodes use Slurm's dynamic registration (`slurmd -Z`) and self-register with sequential hostnames (c1, c2, c3... for CPU; g1, g2... for GPU). Scale up or down at any time without rebuilding. ### Scale CPU Workers ```bash # Scale to 5 CPU workers (default is 2) make scale-cpu-workers N=5 # Or set the default count in .env CPU_WORKER_COUNT=4 make up ``` ### Scale GPU Workers ```bash # Scale to 3 GPU workers (requires GPU_ENABLE=true) make scale-gpu-workers N=3 ``` Verify with `make status`. ## 📊 Monitoring ### REST API Query cluster via REST API (version auto-detected: v0.0.44 for 25.11.x, v0.0.42 for 25.05.x): ```bash # Get JWT Token JWT_TOKEN=$(docker exec slurmctld scontrol token 2>&1 | grep "SLURM_JWT=" | cut -d'=' -f2) # Get nodes docker exec slurmrestd curl -s -H "X-SLURM-USER-TOKEN: $JWT_TOKEN" \ http://localhost:6820/slurm/v0.0.42/nodes | jq .nodes # Get partitions docker exec slurmrestd curl -s -H "X-SLURM-USER-TOKEN: $JWT_TOKEN" \ http://localhost:6820/slurm/v0.0.42/partitions | jq .partitions ``` ### Elasticsearch and Kibana (Optional) Enable job completion monitoring and visualization: ```bash # 1. Setting ELASTICSEARCH_HOST in .env enables the monitoring profile ELASTICSEARCH_HOST=http://elasticsearch:9200 # 2. Start cluster (monitoring auto-enabled) make up # 3. Access Kibana at http://localhost:5601 # After loading, click: Elasticsearch → Index Management → slurm → Discover index # 4. Query job completions directly docker exec elasticsearch curl -s "http://localhost:9200/slurm/_search?pretty" # Test monitoring make test-monitoring ``` **Indexed data:** Job ID, user, partition, state, times, nodes, exit code ## 🌐 Open OnDemand (Optional) Enable the [Open OnDemand](https://openondemand.org/) web portal for browser-based cluster access — submit jobs, manage files, and monitor the queue without the command line: ```bash # Enable in .env OOD_ENABLE=true # Build and start (OOD profile auto-enabled) make b
Excerpt of 8,313 characters
Read on GitHub
44
3
2
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:ffdf2cfe08bbe623, topic:gpu, topic:cuda, topic:slurm