Nava Labradors at Policy2Code Demo Day at BenCon 2024
The team developed an AI solution to assist benefit navigators with in-the-moment program information, finding that while LLMs are useful for summarizing and interpreting text, they are not ideal for implementing strict formulas like benefit calculations, but can accelerate the eligibility process by leveraging their strengths in general tasks.
Benefit navigators (like caseworkers, social workers, call center specialists, and peer coaches) need in-the-moment access to program information when working with families. Navigators take years to build confidence, and training is resource intensive. The team worked on an AI solution to help retrieve program rules and provide plain language explanations. From their experiments, the team concluded that: LLMs are not good tools to implement a strict formula, like benefit calculation, but are useful at summarizing and interpreting text. And, LLMs are not going to replace subject matter expertise but we can use their strength in general tasks to speed up the eligibility process.
Share this Resource: