1 Month into Local LLM - What I've learned.
One Month Into Local LLMs: What I've Learned It's been about a month since I went down the local-LLM rabbit hole. In that time I've: Built llama.cpp from source Written my own benchmarking software to...
My thoughts
One Month Into Local LLMs: What I've Learned It's been about a month since I went down the local-LLM rabbit hole. In that time I've: Built llama.cpp from source Written my own benchmarking software to...