zaakir.io | blog

My thoughts

Tag: llms

Abliteration: Uncensoring an LLM (and Why You Might Want To)

Commercial models refuse a lot of legitimate requests. Here's why "uncensoring" an open-weight model is useful and how I achieved it. ⚠️ A note before we start. An uncensored model will answer almost...

LLMs, AI, abliteration, local ai

1 Month into Local LLM - What I've learned.

One Month Into Local LLMs: What I've Learned It's been about a month since I went down the local-LLM rabbit hole. In that time I've: Built llama.cpp from source Written my own benchmarking software to...

AI, LLMs, LLM, local ai

The Two-File LLM

Andrej Karpathy's hour-long LLM talk is from late 2023. Most of it still holds up. A reread two-and-a-half years on.

LLMs, AI, Inference