Cloud writes the program, a small on-device model answers the questions: AppWorld success rises up to 14.9 points with user data kept local
Letting a cloud model write the program while a small on-device model answers bounded questions about user data that appear only at run time improved a code-only agent's success rate on AppWorld in all six backbone-model and test-partition combinations, by up to 14.9 percentage points, with user data staying on the device.