/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>103747569 & >>103735845

►News
>(12/26) CogAgent-9B updated version released: https://hf.co/THUDM/cogagent-9b-20241220
>(12/26) DeepSeek-V3 instruct released: https://hf.co/deepseek-ai/DeepSeek-V3
>(12/25) DeepSeek-V3-Base 671B-A37B released: https://hf.co/deepseek-ai/DeepSeek-V3-Base
>(12/24) QVQ: 72B visual reasoning model released: https://qwenlm.github.io/blog/qvq-72b-preview
>(12/24) Infinity 2B, bitwise autoregressive text-to-image model: https://hf.co/FoundationVision/Infinity

►News Archive: https://rentry.org/lmg-news-archive
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService
https://rentry.org/tldrhowtoquant

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
LiveBench: https://livebench.ai
Programming: https://livecodebench.github.io/leaderboard.html
Code Editing: https://aider.chat/docs/leaderboards
Context Length: https://github.com/hsiehjackson/RULER
Japanese: https://hf.co/datasets/lmg-anon/vntl-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler Visualizer: https://artefact2.github.io/llm-sampling

►Text Gen. UI, Inference Engines
https://github.com/lmg-anon/mikupad
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/ggerganov/llama.cpp
https://github.com/theroyallab/tabbyAPI
https://github.com/vllm-project/vllm

Why is it that FOSS coders seem allergic to good UX?

My cooler does not have stock screws long enough to reach past the CPU socket back plate into the cooler screw holes, i need to remove the socket retention mechanics, will something bad happen if I just put my cpu in and just screw my cooler down?

I’m using a Dell motherboard for a home server setup but it didn’t come with a cooler so I’m using a noctua

Previous /sdg/ thread : >>103746275

>Beginner UI local install
EasyDiffusion: https://easydiffusion.github.io
Metastable: https://metastable.studio
SwarmUI: https://github.com/mcmonkeyprojects/SwarmUI

>Local install
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
ComfyUI: https://github.com/comfyanonymous/ComfyUI
SD.Next: https://github.com/vladmandic/automatic
InvokeAI: https://github.com/invoke-ai/InvokeAI

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>SD 3.5 info & download
https://rentry.org/sdg-link#sd35
https://civitai.com/models/896953/stable-diffusion-35-medium
https://huggingface.co/city96/stable-diffusion-3.5-medium-gguf
---
https://civitai.com/models/878387/stable-diffusion-35-large
https://huggingface.co/city96/stable-diffusion-3.5-large-gguf

>Try online without registration
sd3.5-medium: https://replicate.com/stability-ai/stable-diffusion-3.5-medium
sd3.5-large: https://replicate.com/stability-ai/stable-diffusion-3.5-large
sd3.5-turbo: https://replicate.com/stability-ai/stable-diffusion-3.5-large-turbo
flux-dev: https://huggingface.co/spaces/black-forest-labs/FLUX.1-dev
txt2img: https://www.mage.space

>Models, LoRAs & upscaling
https://civitai.com
https://huggingface.co
https://aitracker.art
https://openmodeldb.info

>Index of guides and other tools
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>View and submit GPU performance data
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

>Share image prompt info
4chan removes prompt info from images, share them with the following guide/site...
https://rentry.org/hdgcb
https://catbox.moe

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/u/udg
>>>/tg/slop
>>>/trash/sdg
>>>/vp/napt

prev: >>103655531

Sanely priced full size edition

>Keyboard recommendation template:
https://pastebin.com/n220xk9V (embed) (embed)
(Helps also to mention if you're open to soldering or not)

>Find vendors
https://www.alexotos.com/keyboard-vendor-list
https://keycaplendar.firebaseapp.com

>This keyboard stuff is so expensive!
https://aliexpress.com (or Taobao if you are China-savvy)

>Layouts and switches
https://compare.splitkb.com
https://keyboard-design.com
https://www.theremingoat.com
https://www.switchesdb.com

>Practice typing
https://monkeytype.com
https://www.keybr.com
https://thetypingcat.com
https://play.typeracer.com

>What does ______ do to a keyboard's sound
https://blacksimon.tv/science (Google sheet by a twitch streamer)

>What's the deal with backlighting?
https://rentry.org/mkg_backlight (WIP, suggestions/corrections welcome)

>3 days away

Well, /g/?

Everyone hates GNOME for libadwaita which is fucking GNOME cancer infesting itself on every desktop forcing itself to stick out like a sore thumb.

COSMIC is having it's own "libadwaita" calling it "libcosmic" and I hope it fucks off and dies and becomes irrelevant like Unity because the last thing the Linux desktop needs is a cancerous GUI toolkit that does not integrate with other desktops as well as the desktop environment it was designed for. GNOME should die too.

What watches do you wear on a daily basis, /g/?

>UPGRADE & BUILD ADVICE
Post build list or current specs including MONITOR: https://pcpartpicker.com/
Provide specific use cases (e.g. 4K editing, high FPS gaming)
State budget and COUNTRY or you will not be helped

>NEWS
RTX 50 and RX 8000 announcements at CES in early Jan.
Arc B580 reviews live

>12VHPWR
DO NOT USE ANGLED 12VHPWR ADAPTERS
Fully seat a 12VHPWR connector in its socket, otherwise the connection can melt.

>Intel Raptor Lake / RPL Refresh
Instability reported with 13th and 14th gen, i5 K SKUs and above (incl non-K). Update BIOS and apply Intel Baseline settings. Avoid purchases.

>CPUS
HTPC(4K60)/Web Browsing: i3 12100
Gaming: R5 7600; budget: i5 12600K; eXtreme: R7 9800X3D
Multicore: R9 7950X; budget: i5 13400
>Avoid iGPU-less CPUs
>Existing AM4 board with an old chip? Consider a Zen 3 CPU

>GRAPHICS CARDS
1080p: RTX 3060 12 GB / RTX 4060; beta tester: Arc B580; ultra budget: used RTX 2060 Super
1440p & 2160p: WaitTM on RTX 50
Amateur production: RTX 3060 12GB, RTX 4060 Ti 16GB, used RTX 3090, RTX 4090 (upcoming RTX 5090)

>RAM
DDR4: Zen3/AM4 - 2x 16GB 3600 MT/s CL18; for locked "non-K" 12th/13th/LGA1700 - 2x 16GB 3200 MT/s CL16
DDR5: Zen4/AM5 - 2x 16GB 6000 MT/s CL30; for unlocked "K" 13th/14th/LGA1700 - 2x 16GB 6400MT/s CL32

>COOLERS
Standout: Phantom Spirit (or variant)
https://linustechtips.com/topic/891730-cpu-cooler-performance-tier-list/

>PSUS
A new PSU should be ATX 3.X compliant
Aim for 50-75% PSU utilization at full system load
https://hwbusters.com/best_picks/best-atxv3-pcie5-ready-psus-picks-hardware-busters/

>SSDS
Samsung 990 Evo Plus 2 TB
Avoid: cheapest NVMe SSDs
https://ssd.borecraft.com/

>MOTHERBOARDS
Good power delivery is required for Intel CPUs like the i5 13600K and above
Don't pair a K CPU with a B mobo chipset

>GAMING MONITORS
AOC Q27G3XMN, MSI MPG 321URX, Dell G2724D
https://pcpartpicker.com/user/pcbg/saved/dP3v4D

Previous: >>103753207

>Lisp is a family of programming languages with a long history and a distinctive parenthesized prefix notation. There are many dialects of Lisp, including Common Lisp, Scheme, Clojure and Elisp.

>Emacs is an extensible, customizable, self-documenting free/libre text editor and computing environment, with a Lisp interpreter at its core.

>Emacs Resources
https://gnu.org/s/emacs
https://github.com/emacs-tw/awesome-emacs
https://github.com/systemcrafters/crafted-emacs

>Learning Emacs
C-h t (Interactive Tutorial)
https://emacs.amodernist.com
https://systemcrafters.net/emacs-from-scratch
http://xahlee.info/emacs
https://emacs.tv

>Emacs Distros
https://www.spacemacs.org
https://doomemacs.org

>Elisp
Docs: C-h f [function] C-h v [variable] C-h k [keybinding] C-h m [mode] M-x ielm [REPL]
https://gnu.org/s/emacs/manual/eintr.html
https://gnu.org/s/emacs/manual/elisp.html
https://github.com/p3r7/awesome-elisp

>Common Lisp
https://lispcookbook.github.io/cl-cookbook
https://cs.cmu.edu/~dst/LispBook
https://gigamonkeys.com/book
https://lem-project.github.io
https://stumpwm.github.io
https://nyxt-browser.com
https://awesome-cl.com

>Scheme
https://scheme.org
https://try.scheme.org
https://get.scheme.org
https://books.scheme.org
https://standards.scheme.org
https://go.scheme.org/awesome
https://research.scheme.org/lambda-papers

>Clojure
https://clojure.org
https://tryclojure.org
https://clojure-doc.org
https://www.clojure-toolbox.com
https://mooc.fi/courses/2014/clojure
https://clojure.org/community/resources

>Other
https://github.com/dundalek/awesome-lisp-languages

>Guix
https://guix.gnu.org
https://gitlab.com/nonguix/nonguix
https://systemcrafters.net/craft-your-system-with-guix
https://futurile.net/resources/guix
https://github.com/franzos/awesome-guix

>SICP/HtDP
https://web.mit.edu/6.001/6.037/sicp.pdf
https://htdp.org

>More Lisp Resources
https://paste.textboard.org/52b08691

(set! prev-bread (quote >>103642917))