Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
| Date | Stars |
|---|---|
| 2026-07-31 | 16141 |
| 2026-08-01 | 16141 |
| 2026-08-06 | 16142 |
Today
+1 stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# RagaAI Catalyst   
RagaAI Catalyst is a comprehensive platform designed to enhance the management and optimization of LLM projects. It offers a wide range of features, including project management, dataset management, evaluation management, trace management, prompt management, synthetic data generation, and guardrail management. These functionalities enable you to efficiently evaluate, and safeguard your LLM applications.
## Table of Contents
- [RagaAI Catalyst](#ragaai-catalyst)
- [Installation](#installation)
- [Configuration](#configuration)
- [Usage](#usage)
- [Project Management](#project-management)
- [Dataset Management](#dataset-management)
- [Evaluation Management](#evaluation)
- [Trace Management](#trace-management)
- [Agentic Tracing](#agentic-tracing)
- [Prompt Management](#prompt-management)
- [Synthetic Data Generation](#synthetic-data-generation)
- [Guardrail Management](#guardrail-management)
- [Red-teaming](#red-teaming)
## Installation
To install RagaAI Catalyst, you can use pip:
```bash
pip install ragaai-catalyst
```
## Configuration
Before using RagaAI Catalyst, you need to set up your credentials. You can do this by setting environment variables or passing them directly to the `RagaAICatalyst` class:
```python
from ragaai_catalyst import RagaAICatalyst
catalyst = RagaAICatalyst(
access_key="YOUR_ACCESS_KEY",
secret_key="YOUR_SECRET_KEY",
base_url="BASE_URL"
)
```
you'll need to generate authentication credentials:
1. Navigate to your profile settings
2. Select "Authenticate"
3. Click "Generate New Key" to create your access and secret keys
**Note**: Authetication to RagaAICatalyst is necessary to perform any operations below.
## Usage
### Project Management
Create and manage projects using RagaAI Catalyst:
```python
# Create a project
project = catalyst.create_project(
project_name="Test-RAG-App-1",
usecase="Chatbot"
)
# Get project usecases
catalyst.project_use_cases()
# List projects
projects = catalyst.list_projects()
print(projects)
```
### Dataset Management
Manage datasets efficiently for your projects:
```py
from ragaai_catalyst import Dataset
# Initialize Dataset management for a specific project
dataset_manager = Dataset(project_name="project_name")
# List existing datasets
datasets = dataset_manager.list_datasets()
print("Existing Datasets:", datasets)
# Create a dataset from CSV
dataset_manager.create_from_csv(
csv_path='path/to/your.csv',
dataset_name='MyDataset',
schema_mapping={'column1': 'schema_element1', 'column2': 'schema_element2'}
)
# Get project schema mapping
dataset_manager.get_schema_mapping()
```
For more detailed information on Dataset Management, including CSV schema handling and advanced usage, please refer to the [Dataset Management documentation](docs/dataset_management.md).
### Evaluation
Create and manage metric evaluation of your RAG application:
```python
from ragaai_catalyst import Evaluation
# Create an experiment
evaluation = Evaluation(
project_name="Test-RAG-App-1",
dataset_name="MyDataset",
)
# Get list of available metrics
evaluation.list_metrics()
# Add metrics to the experiment
schema_mapping={
'Query': 'prompt',
'response': 'response',
'Context': 'context',
'expectedResponse': 'expected_response'
}
# Add single metric
evaluation.add_metrics(
metrics=[
{"name": "Faithfulness", "config": {"model": "gpt-4o-mini", "provider": "openai", "threshold": {"gte": 0.232323}}, "column_name": "Faithfulness_v1", "schema_maExcerpt of 15,360 characters
Read on GitHub
490
140
99
61
53
43
41
23
Rehan
19
17
Joel Robin P
17
Parteek Kamboj
13
10
7
7
5
Bharanikarthick · RagaAi · India
5
4
4
3
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:6dfff3c91e381b04, topic:agents, topic:agentic-ai, desc:agentic