Agents
18 updates on Agents.
Apple opens its on-device model to all apps with the Foundation Models framework
Any app can call the roughly 3-billion-parameter on-device model from Swift, offline and free of charge, with guided generation and tool calling.
PhoneLM searches for a fast architecture before training it and hits 58 tok/s
BUPT researchers picked their 0.5B and 1.5B transformer shapes by measuring speed on a Snapdragon 8 Gen 3 first, then pre-training the winner.
Mistral puts Ministral 3B and 8B on devices with 128k context
Ministral 3B and 8B handle up to 128k tokens for on-device work, but only the 8B Instruct weights were published, and for research use.
Octopus v3 picks an action from an image and a query in under 1B parameters
A technical report describes a sub-billion multimodal agent that turns an image and a text query into a function call, shown through ten worked examples.
Octopus v2 is a 2B model that calls Android APIs with one token per function
A 2B Gemma fine-tune gives every Android API its own token, and the authors report 99.524% accuracy and 0.38 seconds per call, ahead of GPT-4.
Octopus fine-tunes a 2B model to 93 percent on API function calls
Stanford and Harvard authors fine-tuned open 2B to 7B models on 20,000 RapidAPI functions and report up to 97 percent function call accuracy.