The team explored using LLMs to interpret the Program Operations Manual System (POMS) into plain language logic models and flowcharts as educational resources for SSI and SSDI eligibility, benchmarking LLMs in RAG methods for reliability in answering queries and providing useful instructions to users.
The team introduced an AI assistant for benefits navigators to streamline the process and improve outcomes by quickly assessing client eligibility for benefits programs.
The Policy2Code Prototyping Challenge explored utilizing generative AI technology to translate U.S. government policies for public benefits into plain language and code, culminating in a Demo Day where twelve teams showcased their projects for feedback and evaluation.
The team examined how AI, specifically LLMs, could streamline the case review process for SNAP applications to alleviate the burden on case workers while potentially improving accuracy.
The team developed an AI solution to assist benefit navigators with in-the-moment program information, finding that while LLMs are useful for summarizing and interpreting text, they are not ideal for implementing strict formulas like benefit calculations, but can accelerate the eligibility process by leveraging their strengths in general tasks.
The team developed an application to simplify Medicaid and CHIP applications through LLM APIs while addressing limitations such as hallucinations and outdated information by implementing a selective input process for clean and current data.
The team developed an AI-powered explanation feature that effectively translates complex, multi-program policy calculations into clear and accessible explanations, enabling users to explore "what-if" scenarios and understand key factors influencing benefit amounts and eligibility thresholds.
At Rules as Code Demo Day we heard from Song Hia of the NYC Mayor’s Office for Economic Opportunity and Ethan Lo of the NYC Office of Technology and Innovation who demoed the NYC Benefits Platform Screening API which provides machine-readable calculations and criteria for benefits screening that power the ACCESS NYC screening questionnaire. This makes it easier for NYC residents to discover multiple benefits they may be eligible for. The City is now extending the API to support the new MyCity platform, a one-stop shop for all services and benefits.
The team introduced "Policy Pulse," a tool to help policy analysts understand laws and regulations better by comparing current policies with their original goals to identify implementation issues.
The team explored the performance of various AI chatbots and LLMs in supporting the adoption of Rules as Code for SNAP and Medicaid policies using policy data from Georgia and Oklahoma.
The team conducted experiments to determine whether clients would be responsive to proactive support offered by a chatbot, and identify the ideal timing of the intervention.