We have LLM at home
Peter UnterthurnerFull Stack Software Engineer · KONVERTO
In this talk, we’ll explore what it takes to run your own LLM locally. Along the way, we’ll unpack the core principles that shape model selection, from attention and the KV cache to post-processing methods and quantization. We’ll examine how these factors help you choose the right model for your use case and hardware, discuss the limitations you’re likely to encounter, and learn how to make informed trade-offs.
