Tag

local-llm

1 article tagged "local-llm"

LLM Cognition

Building mullama: What We Learned Replacing Ollama from Scratch

A post-mortem on building a local LLM serving layer — llama.cpp integration, model management, and where existing tools constrain research.

llama.cppinferencelocal-llm