Tag
inference
2 results tagged "inference"
Articles
LLM Cognition
Building mullama: What We Learned Replacing Ollama from Scratch
Why mullama is a Rust runtime on llama.cpp with native bindings for six languages and an Ollama-compatible CLI, and what in-process inference changes.
Edge Intelligence
Running Language Models on Your Phone: The llamafu Experiment
What it takes to run an LLM on a phone with no cloud dependency: the memory arithmetic, quantisation trade-offs, and how llamafu brings llama.cpp to Flutter.