Tag

inference

2 articles tagged "inference"

LLM Cognition

Building mullama: What We Learned Replacing Ollama from Scratch

A post-mortem on building a local LLM serving layer — llama.cpp integration, model management, and where existing tools constrain research.

llama.cppinferencelocal-llm
Edge Intelligence

Running Language Models on Your Phone: The llamafu Experiment

What happens when you run a full LLM on mobile hardware with zero cloud dependency — memory, latency, and model quality on consumer devices.

mobilellama.cppflutter