Back to the ticker

MLC LLM brings local language models to iPhone, browsers and consumer GPUs

The MLC project released MLC LLM on May 1, 2023, a compiler and runtime that deploys language models natively on phones, browsers and consumer hardware rather than serving them from a data centre. The team pointed users to a TestFlight build to try the chat app on iOS.

Video: MLC. The iOS app generating a reply on the phone. Open the MLC post

MLC LLM compiles models through the Apache TVM Unity stack and maps them to the Vulkan and Metal graphics APIs, which the team says covers the majority of consumer platforms. Targets named at launch include Windows, Linux, macOS and iOS, plus AMD, NVIDIA, Intel and Apple GPUs and a Steam Deck. A companion project, WebLLM, offloads the same models into web browsers through WebGPU.

Three weeks later the team added RedPajama-3B across the same set of targets, with a browser demo and a command line tool for desktop machines.

The code is on GitHub under the Apache 2.0 license. The project now exposes an OpenAI-compatible API through a REST server as well as Python, JavaScript, iOS and Android bindings, and covers Android GPUs via OpenCL alongside CUDA and ROCm on the desktop.

  1. George Hotz starts tinygrad, a framework that ports to an accelerator in about 25 ops
  2. Sherpa runs LLaMA on an Android phone through a Flutter chat app
  3. Georgi Gerganov publishes llama.cpp, LLM inference in plain C and C++