Fine-tuning boosts tiny LLM to 90% accuracy for on-device agents

Function Gemma, a 270M parameter model, achieves nearly 2,000 tokens/sec prefill on a Pixel 7. Out-of-the-box accuracy of 46% on app intents jumps to over 90% on eight of ten functions after synthetic data fine-tuning.