Cost Efficient Use of Gen AI
Here’s the path to cost efficient use of Gen AI. We need to create work automation that increases human autonomy and rewards integrity and ingenuity while minimizing token waste.
1- empower people to champion where their expertise and judgment create value. Make automation entirely subservient to them where doing so leads to better, more predictable outcomes
2- develop automation workflows to decompose complex tasks into steps with as much programmatic implementation as possible and only as much reasoning-based compute as necessary
3- ensure human participation in these workflows occurs at a batch size that the human brain can comprehend and over which people can make thoughtful decisions
4- build fluency through deliberate practice so that people can consistently use complex models to break work down so that less sophisticated models can execute it
5- measure delivery stability, adoption, and quality but focus on feeding the information back to the workers themselves so they can optimize their workflows and tool use
6- improve model switching to use advanced cloud based frontier models when necessary and delegate to local models when not so we are ready for when consumer compute power meets effective local models with better tool support
