Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
A proof-of-concept project that showcases the potential for using small, locally trainable LLMs to create next-generation documentation tools.
| Date | Stars |
|---|---|
| 2026-07-31 | 548 |
| 2026-08-02 | 548 |
| 2026-08-06 | 548 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# Unreal Engine 5 Llama LoRA ## Table of Contents - [Project Description](#project-description) - [How to Replicate](#how-to-replicate) - [Results and Examples](#results-and-examples) - [Limitations and Future Improvements](#limitations-and-future-improvements) - [License](#license) - [Acknowledgements](#acknowledgements) # Project Description A proof of concept for using natural language processing (NLP) to create a documentation assistant that can intelligently respond to user queries. Specifically, I webscraped all of Unreal Engine 5.1's documentation into a single text file to use a dataset for finetuning Meta's llama-7b in [oobabooga's text generation webui](https://github.com/oobabooga/text-generation-webui). I think that locally hosted and trained LoRAs have the potential to be an interesting alternative to OpenAI API calls and vector databases for building context aware assistants to help with niche tasks and information. # How to Replicate You'll need to have [oobabooga's text generation webui](https://github.com/oobabooga/text-generation-webui) set up, it's a great tool with the goal of being the stable-diffusion-webui equivalent for locally running and training large language models. I suppose you could also train the LoRA some other way, but this is what I used. If you're on windows, the new one-click installer is very helpful. Once you have it up and running, you'll need to pick a base model. I used Llama-7b loaded in 8bit mode, but other models should work. Download the unreal_docs.txt file from this repository and put it in text-generation-webui/training/datasets. Then navigate over to the training tab in the webui and configure the settings: <img src="assets/TrainingSettings.PNG" width="1200"> These are just the settings I used, I can't say for certain they are the best settings and I plan to continue to experiment with the options. As you can see, training took roughly 8 hours on a 3090ti. ## Training data | Loss | Learning Rate | | --- | --- | | <img src="assets/LossChart.png" width="600"> | <img src="assets/LearningRateChart.png" width="600"> # Results and Examples I fully expected complete gibberish from the first attempt, but I am pleasantly surprised by the quality of the results: | Base Llama7b | ue5-llama-lora | ChatGPT | | --- | --- | --- | | <img src="assets/BaseLlama7b.PNG" width="300"> | <img src="assets/ue5Lora.PNG" width="300"> | <img src="assets/ChatGPT.PNG" width="300"> | Clearly, base Llama 7b has no idea what's going on and can't provide information about Unreal Engine 5 or it's new features. However, when augmented with ue5-llama-lora, it has no issues generating high quality responses that are clearly derived from Unreal Engine 5.1's up-to-date documentation. While Unreal Engine 5 was released after ChatGPT's training cutoff date, it is impressively familiar with nanite, as nanite had been announced prior to September 2021. ChatGPT fails to recognize mass avoidance in the context of Unreal Engine however, as that is a much newer experimental feature in the engine. # Limitations and Future Improvements Being a language model, ue5-llama-lora is prone to hallucinations and can make up details or give incorrect information. That being said, this is still very much in the early stages, and the output could be improved and refined in a number of ways. The obvious thing being that it's not really advisable to use the default chat assistant from the webui for prompting. By generating a UE5-tailored character yaml file, I expect that you could slightly reduce hallucinations and have better control over the length and level of detail in the responses. Additionally, the dataset could be improved in a number of ways. Specifically if the dataset was somehow formatted as a instruction > response json like [Stanford's Alpaca](https://github.com/tatsu-lab/stanford_alpaca) I could have a lot more control through prompting. Lastly, I included the webscraping script in the repository as well, but the
Excerpt of 4,764 characters
Read on GitHub
5
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:c63f3dc1161ae3e5, name:lora