Resources
Here you can find various resources i am using/i used/i suggest using.
Overview
ML#
LLM#
- HuggingFace - NeverSleep ~ Org by me and Undi.
- Ask max ~ If you don't know how something works, ask max!
- Character Tools ~ A collection of tools for creating and managing characters for AI Roleplay.
- Snombler ~ Model ratings.
- BestERP ~ Nice site for model ratings.
- Ayumi ERP rating ~ An Erotic Roleplay model rating by weicon.
- Chub ~ A site full of chars you can download.
- koboldcpp ~ My new main backend for LLM stuff, only for llama.cpp.
- Aphrodite ~ Aphrodite is the official backend engine for PygmalionAI.
- Tabby ~ Backend for exllamav2.
- OobaBooga-textgen webui ~ (old)My main backend for LLM stuff.
- Kalo's sampler post ~ Your sampler settings are probably hurting your model, why?
- HuggingFace - TheBloke ~ here you can find various GGUF quantizations.
- Sillytavern ~ A really good RP/ERP ui. Based on TavernAI, but sillytavern is much better.
- Vali's ChatterUI ~ Basically SillyTavern but hosted on your phone.
- Chatbots Webring ~ Webring for charcard websites.
- HuggingFace - AzureBlack ~ The TheBloke of exl2 quants.
- OSGA ~ OSGA(Open-Source Generative Agents) is a community-driven initiative that builds upon the foundation of 'Generative Agents', for local LLM models. It is based on this Paper (https://arxiv.org/abs/2304.03442) (Video: https://www.youtube.com/watch?v=nKCJ3BMUy1s).
- Llama.cpp ~ Inference of LLaMA model in pure C/C++. It can run on cpu+gpu, good option if other model loaders require too much vram.
- HuggingFace - Undi / Undi's Kofi ~ A shit-ton of high quality merged models.
- Thoughts guide (kinda outdated) ~ A guide by me on how you can implement characters thoughts into sillytavern.
- annotated-transformer ~ Idk what to write here, but someone said i should link it here.
- Gryphe/MythoMax-L2-13b ~ Was once the best model available for RP/ERP, some still consider it best.
- LambdaLabs ~ Really cost efficient gpu cluster (for example: 1x H100 for $1.99/hr).
Various discords#
- NeverSleep ~ NeverSleep server, by me and undi.
- SillyTavern ~ SillyTavern server.
- TheBlock ~ TheBloke server.
- KoboldAI ~ KoboldAI server.
News#
- HuggingFace Daily Papers ~ Daily papers.
- 4chan Lmg ~ Sometimes maybe good sometimes maybe sheet.
- LocalLLaMA ~ Subreddit to discuss about Llama, the large language model created by Meta AI. Often really hangs behind news.
Learn#
- Neural Networks: Zero to Hero ~ Learning the basics of how AI works.
- Attention is all you need ~ A complete explanation of all the layers of a Transformer Model: Multi-Head Self-Attention, Positional Encoding, including all the matrix multiplications and a complete description of the training and inference process.
Model creation/Dataset Creation#
- MergeKit ~ Suite of merging scripts. With those scripts you can merge LLM models with a variety of different merging methods.
- MergeMonster ~ An unsupervised merging algorithm for Transformers-based language models, using a list of phrases (both good and bad) and a fully automated strategy that strives to decrease (or increase) the probability of these phrases occurring in the final merge.
- Quantization script ~ Bunch of Colab/Laggle notebooks for quanting models, applying loras and bunch of other stuff.
- Huggingface Generation config documentation ~ If you use smth like oobabooga, and you dont know what each gen setting does, well... here is the place.
- Augmentoolkit ~ Generate multi-turn training data, about any subject, using Open Source LLMs.
- airoboros ~ using large language models to fine-tune large language models.
Datasets#
- Dampf's list ~ A collection of datasets.
- ERP/RP and erotica rawdata collection ~ A collection of datasets.
- PygmalionAI/PIPPA ~ Official Pygmalion dataset.
- Xilabs/pippa-alpaca ~ Pygmalion PIPPA dataset with alpaca format instead of metharme.
Stable Diffusion#
- AUTOMATIC1111 ~ A really good ui.
- vladmandic ~ A fork of AUTOMATIC1111 which does things differently. Try which fits best for you.
- ComfyUI ~ Yet another powerful SD UI, here you have way more control than in vlad, or auto1111. ComfyUI will let you design and execute advanced stable diffusion pipelines using a graph/nodes/flowchart based interface.
- kohya_ss ~ A tool for training sd Loras/Locon/whatever.
- CivitAi ~ A place where you can get various loras/models/whatever.
- YameroYandere Lora ~ A really good Yandere lora, made by me with the around 500 images.
Web development#
Neocities#
Neocities type of sites.
- sadgrl.online ~ Bunch of stuff neocities related.
- y2k ~ Like the last one but not sorted.
- gifcities ~ Archive of neocities-like gifs you can use on your website.
- ezgif ~ A really good online tool for modifying gifs.