/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>99356488 & >>99348520

►News
>(02/28) The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits https://arxiv.org/abs/2402.17764
>(02/27) Mistral readds the notice to their website https://www.reddit.com/r/LocalLLaMA/comments/1b18817/mistral_changing_and_then_reversing_website/
>(02/26) Mistral partners with Microsoft, removes mentions of open models from website https://siliconangle.com/2024/02/26/now-microsoft-partner-mistral-ai-challenges-openai-three-new-llms/
>(02/21) Google releases two open models https://blog.google/technology/developers/gemma-open-models/

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
General Purpose:
https://hf.co/spaces/HuggingFaceH4/open_llm_leaderboard
https://hf.co/spaces/lmsys/chatbot-arena-leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►ERP/RP Datasets
https://rentry.org/qib8f
https://rentry.org/ashh2

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/GGUF-VRAM-Calculator

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp