Graphcore
1 update on Graphcore.
Graphcore runs Llama 3.2 11B Vision on a Pixel 8a with 2.7-bit quantisation
Graphcore Research fits Llama-3.2-11B-Vision-Instruct into 3.6 GB with a 2.7-bit format and runs it on a Pixel 8a at 3.8 tok/s.
Cutting edge on edge devices.
1 update on Graphcore.
Graphcore Research fits Llama-3.2-11B-Vision-Instruct into 3.6 GB with a 2.7-bit format and runs it on a Pixel 8a at 3.8 tok/s.